-- Logs begin at Wed 2022-05-11 06:09:37 UTC, end at Wed 2022-05-11 07:43:34 UTC. -- May 11 06:40:16.665644 dv-cinder-778193-26-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 11 06:40:16.673175 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 11 06:40:16.677845 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 11 06:40:16 2022] *** May 11 06:40:16.677845 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 11 06:40:16.677845 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 11 06:40:16.677845 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: nodename: dv-cinder-778193-26-iscsi May 11 06:40:16.677845 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: machine: x86_64 May 11 06:40:16.677845 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: clock source: unix May 11 06:40:16.677845 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: pcre jit disabled May 11 06:40:16.677845 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: detected number of CPU cores: 4 May 11 06:40:16.677845 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: current working directory: / May 11 06:40:16.677845 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: detected binary path: /usr/bin/uwsgi-core May 11 06:40:16.677845 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: your processes number limit is 47680 May 11 06:40:16.677845 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: your memory page size is 4096 bytes May 11 06:40:16.677845 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: detected max file descriptor number: 2048 May 11 06:40:16.677845 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: lock engine: pthread robust mutexes May 11 06:40:16.677845 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: thunder lock: enabled May 11 06:40:16.677845 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 11 06:40:16.677845 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 11 06:40:16.721477 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: Python main interpreter initialized at 0x56064f7569c0 May 11 06:40:16.721477 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: python threads support enabled May 11 06:40:16.721477 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: your server socket listen backlog is limited to 100 connections May 11 06:40:16.721477 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: your mercy for graceful operations on workers is 90 seconds May 11 06:40:16.721883 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: mapped 403077 bytes (393 KB) for 2 cores May 11 06:40:16.721883 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: *** Operational MODE: preforking *** May 11 06:40:16.722177 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: *** uWSGI is running in multiple interpreter mode *** May 11 06:40:16.722177 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: spawned uWSGI master process (pid: 80049) May 11 06:40:16.722353 dv-cinder-778193-26-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 11 06:40:16.727012 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: spawned uWSGI worker 1 (pid: 80058, cores: 1) May 11 06:40:16.727012 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: spawned uWSGI worker 2 (pid: 80059, cores: 1) May 11 06:40:16.727012 dv-cinder-778193-26-iscsi devstack@keystone.service[80049]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 11 06:40:22.371623 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 06:40:22.371623 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: from cryptography.utils import int_from_bytes May 11 06:40:22.372415 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 06:40:22.372415 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: from cryptography.utils import int_from_bytes May 11 06:40:22.372978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 06:40:22.372978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: from cryptography.utils import int_from_bytes May 11 06:40:22.373123 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 06:40:22.373123 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: from cryptography.utils import int_from_bytes May 11 06:40:22.421588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 06:40:22.421781 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 06:40:22.421855 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 06:40:22.421937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 06:40:22.422012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] command line args: [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 06:40:22.422074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] command line args: [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 06:40:22.422326 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 06:40:22.422410 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 06:40:22.422471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ================================================================================ {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 06:40:22.422536 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ================================================================================ {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 06:40:22.422607 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] admin_token = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.422788 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] admin_token = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.422869 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] config_dir = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.422936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] config_dir = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.423109 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.423199 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.423272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] config_source = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.423337 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] config_source = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.423395 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] debug = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.423550 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] debug = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.423635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.425981 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.425981 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.426135 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.426202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.426267 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.426338 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.426403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.426467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.426526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.426589 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] list_limit = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.426655 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.426719 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] log_config_append = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.426783 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] log_config_append = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.426783 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.426886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.426944 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] log_dir = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.427365 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] log_dir = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.427434 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] log_file = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.427500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] log_file = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.427559 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.427617 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.427681 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.427750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.427810 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.427873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.427937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.428004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.428064 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.428177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.428252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.428320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.428386 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.428450 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.428450 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.428565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.428631 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.428690 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.428690 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.428792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.428856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.428920 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.428984 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.429055 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.429115 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.429187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.429257 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.429321 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.429385 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.429456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.429520 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.429587 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.429647 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] publish_errors = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.429710 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] publish_errors = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.429775 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.429834 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.429891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.429947 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.430009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.430066 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.430691 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.431013 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.431180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.431370 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.431558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] standard_threads = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.431785 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] standard_threads = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.431950 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.432136 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.432324 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.432517 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.432705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.432933 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.433094 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] use_journal = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.433287 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] use_journal = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.433475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] use_json = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.433674 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] use_json = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.433868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] use_stderr = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.434066 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] use_stderr = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.434261 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] use_syslog = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.434458 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] use_syslog = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.434646 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.434833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:40:22.435101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.435272 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.435437 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.435573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.435736 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.435869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.436043 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.436208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.436343 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.436471 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.436598 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.436724 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.436927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.437058 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.437185 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.437312 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.437445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.437578 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.437720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.437853 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.437991 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.438125 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.438262 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.438488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.438626 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.438760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.438895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.439081 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.439211 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.439347 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.439483 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.439617 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.439745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.439882 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.440010 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.440137 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.440273 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.440406 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.440533 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.440659 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.440792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.440918 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.441057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.441190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.441335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.441558 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.441728 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.441858 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.441995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.442123 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.442250 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.442377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.442510 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.442637 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.442772 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.442900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.443057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.443185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.443312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.443448 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.443669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.443896 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.444027 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.444159 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.444287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.444421 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.444558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.444692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.444819 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.444945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.445074 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.445200 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.445337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.445476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.445604 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.445736 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.445864 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.446011 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.446145 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.446273 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.446405 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.446539 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.446667 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.446801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.446935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.447109 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.447237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.448788 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.448958 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.449190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.449354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.449542 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.449731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.449926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.450116 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.450312 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.450508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.450705 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.450895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.451085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.451284 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.451512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.451675 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.451930 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.452133 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.452295 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.452483 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.452705 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.452877 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.453068 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.453257 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.453466 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.453653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.453821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.453996 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.454127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.454302 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.454431 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.454589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.454730 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.454875 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.455045 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.455190 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.455353 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.455485 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.455624 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.455765 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.455916 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.456046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.456174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.456344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.456477 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.456605 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.456775 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.456904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.457033 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.457161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.457289 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.457457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.457600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.457739 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.457868 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.457996 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.458130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.458267 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.458267 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.458549 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.458931 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.459109 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.459109 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.459451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.459451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.459761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.459891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.460030 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.460160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.460287 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.460498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.460629 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.460757 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.460886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.461021 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.461151 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.461289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.461418 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.461552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.461680 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.461814 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.461964 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.462094 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.462224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.462352 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.462480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.462608 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.462744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.462872 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.463110 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.463276 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.463408 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.463537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.463676 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.463819 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.463969 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.464099 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.464227 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.464356 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.464484 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.464612 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.464749 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.464878 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.465005 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.465133 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.465267 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.465396 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.465533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.465680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.465809 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.465936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.466064 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.466192 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.466327 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.466457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.466585 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.466713 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.466841 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.467022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.467169 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.467299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.external = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.467426 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.467566 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.467695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] auth.external = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.467823 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.467961 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.468117 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.468264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.468397 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.password = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.468527 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.468655 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.token = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.468784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] auth.password = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.468920 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.469058 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] auth.token = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.469188 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.469331 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.469460 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.469590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.469718 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.469855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.469990 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.470119 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.470248 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.470431 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.470575 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.470705 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.470836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.470983 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.471118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.471257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] credential.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.471398 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.471528 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.471657 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.471786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.471915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.472044 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.472180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.472309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.472437 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.472565 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.472694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.472831 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.472981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.473111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.473239 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.473368 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.473496 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.473624 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.473765 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.473895 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.474023 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.474152 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.474280 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.474408 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.474545 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.474674 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.474813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.474942 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.475191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.475323 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.475464 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.475594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.475723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.475852 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.475980 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.476117 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.476321 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.476453 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.476589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.476718 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.476866 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.477008 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.477147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.477277 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.477406 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.477406 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.477657 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.477786 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.477922 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.478059 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.478194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.478333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.478462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.478605 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.478743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.478877 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.479028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.479162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.479302 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.479438 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.479574 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.479704 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.479838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.479973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.480102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.480231 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.480377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.480507 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.480636 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.480765 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.480893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.481021 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.481159 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.481288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.481416 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.481545 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.481672 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.481813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.481943 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.482070 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.482214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.482343 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.482471 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.482608 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.482738 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.482867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.483011 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.483153 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.483320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.483462 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.483591 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.483721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.483848 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.483987 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.484116 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.484255 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.484384 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.484512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.484640 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.484779 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.484908 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.485046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.485176 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.485310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.485438 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.485567 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.485695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.485842 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.485972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.486101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.486230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.486361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.486489 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.486628 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.486757 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.486885 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.487076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.487210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.487340 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.487480 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.487610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.487750 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.487880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.488009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.488137 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.488284 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.488417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.488547 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.488675 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.488803 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.488932 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.489069 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.489198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.489327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.489467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.489597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.489727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.489864 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.489993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.490121 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.490249 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.490378 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.490507 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.490725 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.490861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.491022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.491157 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.491285 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.491429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.491569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.491699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.491828 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.491956 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.492084 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.492212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.492348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.492477 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.492605 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.492735 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.492862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.492990 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.493129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.493268 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.493397 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.493531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.493660 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.493789 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.493926 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.494055 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.494184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.494311 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.494439 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.494576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.494705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.494836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.495086 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.495235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.495367 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.495508 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.495640 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.495770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.495899 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.496028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.496157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.496295 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.496424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.496553 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.496681 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.496811 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.497004 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.497144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.497274 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.497403 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.497532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.497660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.497788 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.497926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.498055 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.498186 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.498321 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.498453 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.498582 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.498719 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.498858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.499006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.499140 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.499269 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.499399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.499543 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.499674 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.499803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.499931 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.500061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.500190 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.500327 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.500456 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.500456 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.500712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.500712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.500955 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.501095 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.501225 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.501354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.501482 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.501482 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.501768 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.501975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.502109 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.502238 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.502367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.502367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.502621 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.502621 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.502875 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.502875 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.503166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.503295 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.503424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.503563 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.503693 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.503821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.503950 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.504078 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.504207 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.504357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.504487 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.504615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.504744 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] role.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.504872 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.505000 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] role.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.505140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.505270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.505398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] role.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.505527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.505655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] role.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.505783 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.505921 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.506059 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.506188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.506357 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.506488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.506618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.506756 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.506885 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.507034 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.507166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.507296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.507425 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.507566 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.507696 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.507824 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.507963 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.508094 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.508223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.508368 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.508500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.508630 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.508758 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.508887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.509024 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.509160 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.509289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.509419 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.509548 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.509687 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.509825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.509955 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.510083 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.510213 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.510342 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.510472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.510609 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.510739 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.510868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.511013 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.511147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.511277 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.511426 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.511558 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.511686 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.511686 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.511930 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.512059 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.512195 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.512325 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.512454 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.512454 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.512698 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.512827 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.512965 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.513109 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.513286 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.513286 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.513535 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.513667 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.513804 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.513933 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] token.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.514063 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.514190 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.514318 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.514464 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.514709 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.514858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.515006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] token.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.515154 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.515285 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.515424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.515554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.515683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.515811 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.515938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.516066 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.516203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.516333 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.516461 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.516620 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.516773 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.516906 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.517053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.517183 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.517311 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.517481 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.517609 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.517737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.517875 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.518012 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.518147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.518277 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.518413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.518542 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.518679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.518820 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.518820 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.519131 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.connection = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.519273 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.519443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.519443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.519729 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.519869 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.520000 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.connection = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.520137 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.520275 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.520404 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.520533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.520662 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.520809 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.520945 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.521074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.521202 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.521399 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.521538 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.521676 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.521806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.522028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.522164 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.522293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.522421 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.522559 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.522694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.522833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.522981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.523118 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.523246 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.523460 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.523593 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.523722 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.523851 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.523979 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.524109 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.524246 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.524377 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 06:40:22.524515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.524515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.524515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:40:22.524515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 06:40:22.536018 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.536256 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.536396 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.536529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.536664 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.536810 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.545473 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.545767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.574357 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.574573 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.574841 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.575106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.627649 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.627940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.679300 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.679592 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.679762 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.679988 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.745998 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.746292 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.746443 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.746607 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.746744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.746877 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.747039 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.747175 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.747321 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.747456 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.747587 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.747733 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.770866 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.771230 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.771382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.771518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.771736 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.771977 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.772185 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.774131 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.774333 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.774586 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.774797 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.775052 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.775266 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.775411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.783911 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.784302 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.798687 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.799037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.799200 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.799377 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.799529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.799664 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.799797 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.799949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.800084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.800215 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.800347 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.800479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.800621 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.800621 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:40:22.817360 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.817664 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 06:40:22.817894 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.818109 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 06:40:22.818347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.818574 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.818940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.819202 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.822978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.823199 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 06:40:22.823533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.823729 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 06:40:22.823997 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.824239 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.824527 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.824766 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.830542 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.830823 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.831124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.831369 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.835993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.836252 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.836547 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.836833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.839566 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.842830 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.843084 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.843404 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.843788 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.844069 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.844282 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.844586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.844863 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.845060 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.845221 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.845360 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.845639 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.848341 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.848626 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.848908 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.849298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.849594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.849827 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.850161 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.850451 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.850704 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.851004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.851284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.872172 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.873781 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.874064 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.878086 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.879366 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.879621 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.879786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.879931 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.880086 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.885450 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.885732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.886020 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.887238 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.887524 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.892166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.892458 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.892736 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.893015 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.893265 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.893427 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.893588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.893731 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.893872 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.894041 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.898380 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.898633 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.898940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.899259 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.899496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.899800 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.900021 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.900319 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.913134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.913492 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.918082 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.919390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.919688 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.921753 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.922053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.924260 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.927006 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.927918 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.928245 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.930620 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.933247 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.934360 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.934668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.934915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.935259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.935507 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.935817 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.937015 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.940611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.940911 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.941202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.941546 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.941735 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.942026 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.955184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.955559 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.955842 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.956062 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.961445 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.961824 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.962105 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.962350 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.963987 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.965688 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.965971 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.969072 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.969326 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.969639 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.969900 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.970205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.970410 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.972068 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.972350 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.975626 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.975893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.976193 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.976477 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.976726 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.983743 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.983997 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.984303 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.984590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.984876 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.985124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.985423 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.990228 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:22.990514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.990818 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.991105 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.991427 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.991723 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:22.992009 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.003389 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:23.006706 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:23.010047 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.010253 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:23.011689 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.013323 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:23.013546 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:23.013772 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.013924 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.016813 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.018432 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.020114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:23.020330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.020643 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.021301 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.022940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:23.026192 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.026426 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.026740 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.026988 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.028157 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.029763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:23.033029 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.033333 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.033617 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.033866 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.036269 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:23.036568 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.036833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.044866 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:23.045120 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.045424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.045708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.045912 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:23.046082 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.046228 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.046371 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.046522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.046677 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.046827 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.047025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.047302 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.047552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.047853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.048214 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.048387 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.054402 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:40:23.054624 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.054834 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.055164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.055413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.055720 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.056102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.056387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.056610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.056901 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.057143 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.057436 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.057677 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.057948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:40:23.088950 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56064f7569c0 pid: 80058 (default app) May 11 06:40:23.092597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e6f0b-905a-401a-84c3-3ff0cdaa7c69 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:23.093006 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e6f0b-905a-401a-84c3-3ff0cdaa7c69 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:23.093399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e6f0b-905a-401a-84c3-3ff0cdaa7c69 None None] PATH_INFO: `/v3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:23.096851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56064f7569c0 pid: 80059 (default app) May 11 06:40:23.097885 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 791 bytes} [Wed May 11 06:40:23 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:31.065149 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8ed39-1b33-4a2e-bb25-84e630dc5ff7 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:31.065744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8ed39-1b33-4a2e-bb25-84e630dc5ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:31.065744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8ed39-1b33-4a2e-bb25-84e630dc5ff7 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:31.070070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1/2] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:40:31.075702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b1d2a-8bac-429a-9f0f-f2994e0f52a4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:31.076127 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b1d2a-8bac-429a-9f0f-f2994e0f52a4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:31.076237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b1d2a-8bac-429a-9f0f-f2994e0f52a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:31.108281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG oslo_db.sqlalchemy.engines [None req-649b1d2a-8bac-429a-9f0f-f2994e0f52a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 06:40:31.289048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG passlib.handlers.bcrypt [None req-649b1d2a-8bac-429a-9f0f-f2994e0f52a4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80058) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 11 06:40:31.289441 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG passlib.handlers.bcrypt [None req-649b1d2a-8bac-429a-9f0f-f2994e0f52a4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80058) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 11 06:40:31.346308 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-649b1d2a-8bac-429a-9f0f-f2994e0f52a4 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:31.347869 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-649b1d2a-8bac-429a-9f0f-f2994e0f52a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:31.471007 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 2/3] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 11 06:40:31.613615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8ed39-1b33-4a2e-bb25-84e630dc5ff7 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:31.648723 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG oslo_db.sqlalchemy.engines [None req-8bc8ed39-1b33-4a2e-bb25-84e630dc5ff7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 06:40:31.771561 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8ed39-1b33-4a2e-bb25-84e630dc5ff7 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:31.776288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0aa67e-6670-4555-bc6b-68f4fe81d965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:31.776948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0aa67e-6670-4555-bc6b-68f4fe81d965 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:31.777227 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0aa67e-6670-4555-bc6b-68f4fe81d965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:31.777499 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0aa67e-6670-4555-bc6b-68f4fe81d965 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:31.785621 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0aa67e-6670-4555-bc6b-68f4fe81d965 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:31.836493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3d0aa67e-6670-4555-bc6b-68f4fe81d965 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 11 06:40:31.836827 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0aa67e-6670-4555-bc6b-68f4fe81d965 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:31.846680 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 2/4] 10.222.0.77 () {58 vars in 1324 bytes} [Wed May 11 06:40:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:40:31.853599 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b1d2a-8bac-429a-9f0f-f2994e0f52a4 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:31.868745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b1d2a-8bac-429a-9f0f-f2994e0f52a4 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:31.874482 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e7b3c-29c7-4907-9faf-5ea9e97f70fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:31.875671 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e7b3c-29c7-4907-9faf-5ea9e97f70fb admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:31.875958 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e7b3c-29c7-4907-9faf-5ea9e97f70fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:31.876234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e7b3c-29c7-4907-9faf-5ea9e97f70fb admin admin] PATH_INFO: `/v3/projects/486e01030b5e4bfaac8284834098ad35` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:31.877911 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e7b3c-29c7-4907-9faf-5ea9e97f70fb admin admin] RBAC: Authorizing `identity:get_project(project_id=486e01030b5e4bfaac8284834098ad35)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:31.927449 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d90e7b3c-29c7-4907-9faf-5ea9e97f70fb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 11 06:40:31.927785 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e7b3c-29c7-4907-9faf-5ea9e97f70fb admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:31.932371 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 3/5] 10.222.0.77 () {56 vars in 1207 bytes} [Wed May 11 06:40:31 2022] GET /identity/v3/projects/486e01030b5e4bfaac8284834098ad35 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:34.103392 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaaa43-d614-4106-b792-92813022fd22 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:34.104276 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaaa43-d614-4106-b792-92813022fd22 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:34.104276 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaaa43-d614-4106-b792-92813022fd22 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:34.111056 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 3/6] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:40:34.118839 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bd667-fbfa-4f38-aa66-db98b13796f9 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:34.119318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bd667-fbfa-4f38-aa66-db98b13796f9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:34.119419 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bd667-fbfa-4f38-aa66-db98b13796f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:34.140513 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d15bd667-fbfa-4f38-aa66-db98b13796f9 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:34.142034 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d15bd667-fbfa-4f38-aa66-db98b13796f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:34.151516 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 4/7] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 11 06:40:34.174140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaaa43-d614-4106-b792-92813022fd22 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:34.195605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaaa43-d614-4106-b792-92813022fd22 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:34.201650 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16c7ce-adee-47b0-8580-21f1d51f25a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:34.202295 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16c7ce-adee-47b0-8580-21f1d51f25a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:34.202580 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16c7ce-adee-47b0-8580-21f1d51f25a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:34.202857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16c7ce-adee-47b0-8580-21f1d51f25a0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:34.210919 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16c7ce-adee-47b0-8580-21f1d51f25a0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:34.212751 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16c7ce-adee-47b0-8580-21f1d51f25a0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:34.221450 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 4/8] 10.222.0.77 () {58 vars in 1324 bytes} [Wed May 11 06:40:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:40:34.226793 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bd667-fbfa-4f38-aa66-db98b13796f9 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:34.235841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bd667-fbfa-4f38-aa66-db98b13796f9 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:34.240805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80e6a8-5108-457b-96f9-c962153ef35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:34.241698 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80e6a8-5108-457b-96f9-c962153ef35b admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:34.241984 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80e6a8-5108-457b-96f9-c962153ef35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:34.242253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80e6a8-5108-457b-96f9-c962153ef35b admin admin] PATH_INFO: `/v3/users/7a9fbdd0a78349c9b11108cb751273ee` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:34.243726 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80e6a8-5108-457b-96f9-c962153ef35b admin admin] RBAC: Authorizing `identity:get_user(user_id=7a9fbdd0a78349c9b11108cb751273ee)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:34.245549 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80e6a8-5108-457b-96f9-c962153ef35b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:34.247141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 5/9] 10.222.0.77 () {56 vars in 1198 bytes} [Wed May 11 06:40:34 2022] GET /identity/v3/users/7a9fbdd0a78349c9b11108cb751273ee => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:36.513154 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4da670-dfab-401e-8b6b-a12334da13c8 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:36.513728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4da670-dfab-401e-8b6b-a12334da13c8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:36.513728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4da670-dfab-401e-8b6b-a12334da13c8 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:36.515077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 5/10] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:40:36.520350 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976feb28-cb4e-4f03-984d-ea0803f100cc None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:36.520785 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976feb28-cb4e-4f03-984d-ea0803f100cc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:36.520886 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976feb28-cb4e-4f03-984d-ea0803f100cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:36.529165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0270cbf-80d4-4a39-ad59-1b4fe757cfad None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:36.529445 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0270cbf-80d4-4a39-ad59-1b4fe757cfad None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:36.529715 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0270cbf-80d4-4a39-ad59-1b4fe757cfad None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:36.531013 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 6/11] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:40:36.536447 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68266b65-2ce6-4ecb-8d57-81cad0989a62 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:36.536711 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68266b65-2ce6-4ecb-8d57-81cad0989a62 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:36.537010 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68266b65-2ce6-4ecb-8d57-81cad0989a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:36.578513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG passlib.handlers.bcrypt [None req-68266b65-2ce6-4ecb-8d57-81cad0989a62 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80059) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 11 06:40:36.578830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG passlib.handlers.bcrypt [None req-68266b65-2ce6-4ecb-8d57-81cad0989a62 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80059) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 11 06:40:36.625853 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-68266b65-2ce6-4ecb-8d57-81cad0989a62 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:36.627512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-68266b65-2ce6-4ecb-8d57-81cad0989a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:36.654117 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-976feb28-cb4e-4f03-984d-ea0803f100cc None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:36.655354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-976feb28-cb4e-4f03-984d-ea0803f100cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:36.734429 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 6/12] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:40:36.739962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 7/13] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:40:36.757690 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976feb28-cb4e-4f03-984d-ea0803f100cc None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:36.761398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68266b65-2ce6-4ecb-8d57-81cad0989a62 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:36.849705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976feb28-cb4e-4f03-984d-ea0803f100cc None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:36.861345 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68266b65-2ce6-4ecb-8d57-81cad0989a62 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:36.882398 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1456dda-813e-4201-a49e-6a788abe7582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:36.883349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1456dda-813e-4201-a49e-6a788abe7582 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:36.884635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1456dda-813e-4201-a49e-6a788abe7582 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:36.885776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1456dda-813e-4201-a49e-6a788abe7582 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:36.896352 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de76b8-ffec-4405-a37f-4818eeb8a256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:36.897317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de76b8-ffec-4405-a37f-4818eeb8a256 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:36.897606 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de76b8-ffec-4405-a37f-4818eeb8a256 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:36.897908 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de76b8-ffec-4405-a37f-4818eeb8a256 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:36.898662 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1456dda-813e-4201-a49e-6a788abe7582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:40:36.909938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c1456dda-813e-4201-a49e-6a788abe7582 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:40:36.909938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:40:36.909938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:40:36.909938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:40:36.909938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:40:36.909938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:40:36.909938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:40:36.909938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:40:36.909938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:40:36.909938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:40:36.909938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:40:36.909938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:40:36.909938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:40:36.909938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:40:36.909938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:40:36.909938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:40:36.911157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:40:36.911157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:40:36.911157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:40:36.911157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:40:36.911157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:40:36.911157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:40:36.911157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:40:36.911157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:40:36.911157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:40:36.911157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:40:36.911157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:40:36.911157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:40:36.911157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:40:36.911157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:40:36.911157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:40:36.911157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:40:36.912147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:40:36.912147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:40:36.912147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:40:36.912147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:40:36.912147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:40:36.912147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:40:36.912147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:40:36.912147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:40:36.912147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:40:36.912147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:40:36.912147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:40:36.912147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:40:36.912147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 7/14] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:40:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:40:36.917005 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1456dda-813e-4201-a49e-6a788abe7582 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:36.971792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de76b8-ffec-4405-a37f-4818eeb8a256 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:36.973327 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de76b8-ffec-4405-a37f-4818eeb8a256 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:37.015215 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1456dda-813e-4201-a49e-6a788abe7582 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:37.048633 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322140ab-b169-47a9-979f-2e1e66b389f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:37.049301 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322140ab-b169-47a9-979f-2e1e66b389f6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:37.049585 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322140ab-b169-47a9-979f-2e1e66b389f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:37.049860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322140ab-b169-47a9-979f-2e1e66b389f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:37.050734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322140ab-b169-47a9-979f-2e1e66b389f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:37.051067 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322140ab-b169-47a9-979f-2e1e66b389f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:37.052467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322140ab-b169-47a9-979f-2e1e66b389f6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:37.064170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 8/15] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:40:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:37.068618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 8/16] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:40:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:40:37.072614 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322140ab-b169-47a9-979f-2e1e66b389f6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:37.074168 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de76b8-ffec-4405-a37f-4818eeb8a256 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:37.177351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322140ab-b169-47a9-979f-2e1e66b389f6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:37.213808 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f8018-9c86-49e3-8f4d-b16e6246ba41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:37.214695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f8018-9c86-49e3-8f4d-b16e6246ba41 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:37.215005 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f8018-9c86-49e3-8f4d-b16e6246ba41 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:37.215279 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f8018-9c86-49e3-8f4d-b16e6246ba41 None admin] PATH_INFO: `/v3/users/7a9fbdd0a78349c9b11108cb751273ee` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:37.216496 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f8018-9c86-49e3-8f4d-b16e6246ba41 None admin] RBAC: Authorizing `identity:get_user(user_id=7a9fbdd0a78349c9b11108cb751273ee)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:37.217963 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f8018-9c86-49e3-8f4d-b16e6246ba41 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:37.219638 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 9/17] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:40:37 2022] GET /identity/v3/users/7a9fbdd0a78349c9b11108cb751273ee => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:40:37.225252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f8018-9c86-49e3-8f4d-b16e6246ba41 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:37.281986 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de76b8-ffec-4405-a37f-4818eeb8a256 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:37.314649 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bb4b0-b519-4137-a59b-3c3dcb8e9125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:37.315490 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bb4b0-b519-4137-a59b-3c3dcb8e9125 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:37.315772 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bb4b0-b519-4137-a59b-3c3dcb8e9125 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:37.316042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bb4b0-b519-4137-a59b-3c3dcb8e9125 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:37.319804 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f8018-9c86-49e3-8f4d-b16e6246ba41 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:37.334516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889bb4b0-b519-4137-a59b-3c3dcb8e9125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:37.336037 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889bb4b0-b519-4137-a59b-3c3dcb8e9125 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:37.351501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c642e-89b6-45d4-aca9-82d17e1c58b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:37.352301 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c642e-89b6-45d4-aca9-82d17e1c58b1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:37.352585 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c642e-89b6-45d4-aca9-82d17e1c58b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:37.352860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c642e-89b6-45d4-aca9-82d17e1c58b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:37.354048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c642e-89b6-45d4-aca9-82d17e1c58b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:37.355523 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c642e-89b6-45d4-aca9-82d17e1c58b1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:37.355976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-889bb4b0-b519-4137-a59b-3c3dcb8e9125 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:40:37.355976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:40:37.355976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:40:37.355976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:40:37.355976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:40:37.355976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:40:37.355976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:40:37.355976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:40:37.355976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:40:37.355976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:40:37.355976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:40:37.355976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:40:37.355976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:40:37.355976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:40:37.355976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:40:37.356743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:40:37.356743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:40:37.356743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:40:37.356743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:40:37.356743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:40:37.356743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:40:37.356743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:40:37.356743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:40:37.356743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:40:37.356743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:40:37.356743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:40:37.356743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:40:37.356743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:40:37.356743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:40:37.356743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:40:37.356743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:40:37.356743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:40:37.359591 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:40:37.359591 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:40:37.359591 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:40:37.359591 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:40:37.359591 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 9/18] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:40:37.359920 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 10/19] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:40:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:40:37.362935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c642e-89b6-45d4-aca9-82d17e1c58b1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:37.363104 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bb4b0-b519-4137-a59b-3c3dcb8e9125 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:37.458210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c642e-89b6-45d4-aca9-82d17e1c58b1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:37.467595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bb4b0-b519-4137-a59b-3c3dcb8e9125 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:37.489468 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298c8de-f168-4160-86da-05907557fec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:37.490136 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298c8de-f168-4160-86da-05907557fec5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:37.490425 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298c8de-f168-4160-86da-05907557fec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:37.490763 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298c8de-f168-4160-86da-05907557fec5 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:37.491525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298c8de-f168-4160-86da-05907557fec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:37.491833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298c8de-f168-4160-86da-05907557fec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:37.493237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298c8de-f168-4160-86da-05907557fec5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:37.500051 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae00070-f857-4272-b77f-310d4f81c9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:37.500738 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae00070-f857-4272-b77f-310d4f81c9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:37.501019 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae00070-f857-4272-b77f-310d4f81c9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:37.501296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae00070-f857-4272-b77f-310d4f81c9c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:37.502126 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae00070-f857-4272-b77f-310d4f81c9c3 None admin] RBAC: Adding query filter params (role.id=5debd8ad07a74bedbf2efd53b11cd7cd, scope.domain.id=default, user.id=7a9fbdd0a78349c9b11108cb751273ee) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:37.502437 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae00070-f857-4272-b77f-310d4f81c9c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:37.503907 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae00070-f857-4272-b77f-310d4f81c9c3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:37.510335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 11/20] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:37.512427 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 10/21] 10.222.0.77 () {56 vars in 1322 bytes} [Wed May 11 06:40:37 2022] GET /identity/v3/role_assignments?user.id=7a9fbdd0a78349c9b11108cb751273ee&scope.domain.id=default&role.id=5debd8ad07a74bedbf2efd53b11cd7cd => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:40.019768 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b9d61-d989-42cb-bf61-35f377caa2f6 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:40.020315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b9d61-d989-42cb-bf61-35f377caa2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:40.020315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b9d61-d989-42cb-bf61-35f377caa2f6 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:40.022071 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 12/22] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:40:40.027482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdbd5d-cc7e-4712-9754-67bd73defb84 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:40.027933 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdbd5d-cc7e-4712-9754-67bd73defb84 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:40.028106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdbd5d-cc7e-4712-9754-67bd73defb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:40.056115 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-59bdbd5d-cc7e-4712-9754-67bd73defb84 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:40.057369 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-59bdbd5d-cc7e-4712-9754-67bd73defb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:40.139626 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 11/23] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:40:40.174036 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b9d61-d989-42cb-bf61-35f377caa2f6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:40.296925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b9d61-d989-42cb-bf61-35f377caa2f6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:40.339491 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c7ffb-4c30-4632-be08-38abe1991aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:40.340315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c7ffb-4c30-4632-be08-38abe1991aba None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:40.340599 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c7ffb-4c30-4632-be08-38abe1991aba None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:40.340878 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c7ffb-4c30-4632-be08-38abe1991aba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:40.355871 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c7ffb-4c30-4632-be08-38abe1991aba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:40:40.367747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-651c7ffb-4c30-4632-be08-38abe1991aba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:40:40.367747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:40:40.367747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:40:40.367747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:40:40.367747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:40:40.367747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:40:40.367747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:40:40.367747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:40:40.367747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:40:40.367747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:40:40.367747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:40:40.367747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:40:40.367747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:40:40.367747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:40:40.367747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:40:40.367747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:40:40.369732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:40:40.369732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:40:40.369732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:40:40.369732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:40:40.369732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:40:40.369732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:40:40.369732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:40:40.369732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:40:40.369732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:40:40.369732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:40:40.369732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:40:40.369732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:40:40.369732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:40:40.369732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:40:40.369732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:40:40.369732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:40:40.371617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:40:40.371617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:40:40.371617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:40:40.371617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:40:40.371617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:40:40.371617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:40:40.371617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:40:40.371617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:40:40.371617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:40:40.371617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:40:40.371617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:40:40.371617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:40:40.371617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 13/24] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:40:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:40:40.375215 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bdbd5d-cc7e-4712-9754-67bd73defb84 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:40.454411 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec0ca5-a330-43ca-9bee-b015effe9618 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:40.455542 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec0ca5-a330-43ca-9bee-b015effe9618 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:40.456063 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec0ca5-a330-43ca-9bee-b015effe9618 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:40.458221 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 14/25] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:40:40.463075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5c21d-be8a-4131-a8b5-bca18cca8f7c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:40.463280 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5c21d-be8a-4131-a8b5-bca18cca8f7c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:40.463563 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5c21d-be8a-4131-a8b5-bca18cca8f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:40.500658 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-eff5c21d-be8a-4131-a8b5-bca18cca8f7c None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:40.504753 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-eff5c21d-be8a-4131-a8b5-bca18cca8f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:40.526978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bdbd5d-cc7e-4712-9754-67bd73defb84 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:40.603424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35533d-145b-4fb1-955b-b30153674749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:40.604140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35533d-145b-4fb1-955b-b30153674749 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:40.604315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35533d-145b-4fb1-955b-b30153674749 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:40.604633 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35533d-145b-4fb1-955b-b30153674749 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:40.605350 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35533d-145b-4fb1-955b-b30153674749 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:40.605656 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35533d-145b-4fb1-955b-b30153674749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:40.607134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35533d-145b-4fb1-955b-b30153674749 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:40.617688 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 15/26] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:40:40.633200 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 12/27] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:40:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:40.639236 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5c21d-be8a-4131-a8b5-bca18cca8f7c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:40.650830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35533d-145b-4fb1-955b-b30153674749 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:40.739739 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5c21d-be8a-4131-a8b5-bca18cca8f7c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:40.778276 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c51fb-b156-42d8-b677-80a041198385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:40.779207 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c51fb-b156-42d8-b677-80a041198385 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:40.779494 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c51fb-b156-42d8-b677-80a041198385 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:40.779775 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c51fb-b156-42d8-b677-80a041198385 None admin] PATH_INFO: `/v3/users/7a9fbdd0a78349c9b11108cb751273ee` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:40.781582 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c51fb-b156-42d8-b677-80a041198385 None admin] RBAC: Authorizing `identity:get_user(user_id=7a9fbdd0a78349c9b11108cb751273ee)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:40.783097 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c51fb-b156-42d8-b677-80a041198385 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:40.788678 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 16/28] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:40:40 2022] GET /identity/v3/users/7a9fbdd0a78349c9b11108cb751273ee => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:40.793256 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c51fb-b156-42d8-b677-80a041198385 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:40.853649 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35533d-145b-4fb1-955b-b30153674749 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:40.918222 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0636439-609c-482a-a586-03e15e3aaa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:40.919166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0636439-609c-482a-a586-03e15e3aaa99 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:40.919620 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0636439-609c-482a-a586-03e15e3aaa99 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:40.920055 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0636439-609c-482a-a586-03e15e3aaa99 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:40.920982 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0636439-609c-482a-a586-03e15e3aaa99 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:40.922583 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0636439-609c-482a-a586-03e15e3aaa99 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:40.944410 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c51fb-b156-42d8-b677-80a041198385 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:40.979598 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef16bbd-8f22-4b82-b54f-0638d68e4862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:40.980655 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef16bbd-8f22-4b82-b54f-0638d68e4862 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:40.981075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef16bbd-8f22-4b82-b54f-0638d68e4862 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:40.981593 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef16bbd-8f22-4b82-b54f-0638d68e4862 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:40.983005 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef16bbd-8f22-4b82-b54f-0638d68e4862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:40.984686 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef16bbd-8f22-4b82-b54f-0638d68e4862 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:40.986469 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 17/29] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:40:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:40.987921 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241a5b5-1966-45be-870f-e4915dce1eda None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:40.988424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241a5b5-1966-45be-870f-e4915dce1eda None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:40.988906 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241a5b5-1966-45be-870f-e4915dce1eda None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:40.990690 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 18/30] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:40:40.996150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03543ee7-8bfd-4a0b-a813-1dfa89515ab7 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:40.996662 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03543ee7-8bfd-4a0b-a813-1dfa89515ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:40.997152 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03543ee7-8bfd-4a0b-a813-1dfa89515ab7 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:40.998940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 19/31] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:40:40.999882 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03543ee7-8bfd-4a0b-a813-1dfa89515ab7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:41.067177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 13/32] 10.222.0.77 () {60 vars in 1131 bytes} [Wed May 11 06:40:40 2022] POST /identity/v3/roles => generated 219 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:41.069689 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245920d8-79e0-492c-91f6-346f53acf750 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:41.070118 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245920d8-79e0-492c-91f6-346f53acf750 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:41.070534 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245920d8-79e0-492c-91f6-346f53acf750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:41.096483 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-245920d8-79e0-492c-91f6-346f53acf750 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:41.098426 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-245920d8-79e0-492c-91f6-346f53acf750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:41.158308 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03543ee7-8bfd-4a0b-a813-1dfa89515ab7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:41.229725 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1506534-3834-4ca3-962a-05702a70c743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:41.230625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1506534-3834-4ca3-962a-05702a70c743 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:41.230901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1506534-3834-4ca3-962a-05702a70c743 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:41.231215 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1506534-3834-4ca3-962a-05702a70c743 None admin] PATH_INFO: `/v3/domains/default/users/7a9fbdd0a78349c9b11108cb751273ee/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:41.233297 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1506534-3834-4ca3-962a-05702a70c743 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7a9fbdd0a78349c9b11108cb751273ee, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:41.234594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 14/33] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:40:41.234845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1506534-3834-4ca3-962a-05702a70c743 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:41.236324 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdf280-2130-429c-ad15-cc7fe5623ab7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:41.236748 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdf280-2130-429c-ad15-cc7fe5623ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:41.237180 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdf280-2130-429c-ad15-cc7fe5623ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:41.265379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3bbdf280-2130-429c-ad15-cc7fe5623ab7 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:41.266833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3bbdf280-2130-429c-ad15-cc7fe5623ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:41.347744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 15/34] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:40:41.349486 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c355e7-4297-48c1-b93b-ed2e93996590 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:41.349941 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c355e7-4297-48c1-b93b-ed2e93996590 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:41.350417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c355e7-4297-48c1-b93b-ed2e93996590 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:41.356088 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 16/35] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:40:41.356942 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c355e7-4297-48c1-b93b-ed2e93996590 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:41.376669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 20/36] 10.222.0.77 () {58 vars in 1361 bytes} [Wed May 11 06:40:40 2022] PUT /identity/v3/domains/default/users/7a9fbdd0a78349c9b11108cb751273ee/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:41.378571 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d0beb-b2de-4398-a49a-ac731225814c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:41.378867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d0beb-b2de-4398-a49a-ac731225814c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:41.379171 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d0beb-b2de-4398-a49a-ac731225814c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:41.412904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6d2d0beb-b2de-4398-a49a-ac731225814c None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:41.414753 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6d2d0beb-b2de-4398-a49a-ac731225814c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:41.483355 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c355e7-4297-48c1-b93b-ed2e93996590 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:41.493306 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 21/37] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:40:41.494524 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d0beb-b2de-4398-a49a-ac731225814c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:41.529989 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab8746-5351-436e-a75b-b6ed38ca05ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:41.530697 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab8746-5351-436e-a75b-b6ed38ca05ef None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:41.531023 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab8746-5351-436e-a75b-b6ed38ca05ef None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:41.531293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab8746-5351-436e-a75b-b6ed38ca05ef None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:41.532368 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab8746-5351-436e-a75b-b6ed38ca05ef None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:41.534134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab8746-5351-436e-a75b-b6ed38ca05ef None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:41.554504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 17/38] 10.222.0.77 () {60 vars in 1131 bytes} [Wed May 11 06:40:41 2022] POST /identity/v3/roles => generated 225 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:41.555976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab8746-5351-436e-a75b-b6ed38ca05ef None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:41.648059 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d0beb-b2de-4398-a49a-ac731225814c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:41.672968 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab8746-5351-436e-a75b-b6ed38ca05ef None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:41.687732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60670b1f-acca-4b7a-9fe7-2272e30be65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:41.688810 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60670b1f-acca-4b7a-9fe7-2272e30be65c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:41.689236 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60670b1f-acca-4b7a-9fe7-2272e30be65c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:41.689611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60670b1f-acca-4b7a-9fe7-2272e30be65c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:41.705621 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60670b1f-acca-4b7a-9fe7-2272e30be65c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:41.711699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7673b4-fad4-4259-9c88-4b20d4cfdd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:41.711918 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60670b1f-acca-4b7a-9fe7-2272e30be65c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:41.712854 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7673b4-fad4-4259-9c88-4b20d4cfdd25 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:41.713355 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7673b4-fad4-4259-9c88-4b20d4cfdd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:41.713771 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7673b4-fad4-4259-9c88-4b20d4cfdd25 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:41.714666 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7673b4-fad4-4259-9c88-4b20d4cfdd25 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:41.716248 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7673b4-fad4-4259-9c88-4b20d4cfdd25 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:41.739013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-60670b1f-acca-4b7a-9fe7-2272e30be65c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:40:41.739013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:40:41.739013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:40:41.739013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:40:41.739013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:40:41.739013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:40:41.739013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:40:41.739013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:40:41.739013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:40:41.739013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:40:41.739013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:40:41.739013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:40:41.739013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:40:41.739013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:40:41.739013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:40:41.740112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:40:41.740112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:40:41.740112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:40:41.740112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:40:41.740112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:40:41.740112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:40:41.740112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:40:41.740112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:40:41.740112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:40:41.740112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:40:41.740112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:40:41.740112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:40:41.740112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:40:41.740112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:40:41.740112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:40:41.740112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:40:41.740112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:40:41.741079 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:40:41.741079 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:40:41.741079 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:40:41.741079 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:40:41.741079 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 22/39] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:40:41.743851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 18/40] 10.222.0.77 () {60 vars in 1131 bytes} [Wed May 11 06:40:41 2022] POST /identity/v3/roles => generated 223 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:41.747048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60670b1f-acca-4b7a-9fe7-2272e30be65c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:41.864308 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60670b1f-acca-4b7a-9fe7-2272e30be65c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:41.901802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604e0bf-26e2-4d5f-b9bd-b40ab41a09b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:41.902795 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604e0bf-26e2-4d5f-b9bd-b40ab41a09b4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:41.903237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604e0bf-26e2-4d5f-b9bd-b40ab41a09b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:41.903671 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604e0bf-26e2-4d5f-b9bd-b40ab41a09b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:41.904545 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604e0bf-26e2-4d5f-b9bd-b40ab41a09b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:41.904989 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604e0bf-26e2-4d5f-b9bd-b40ab41a09b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:41.906564 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604e0bf-26e2-4d5f-b9bd-b40ab41a09b4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:41.923603 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 23/41] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:40:41.929534 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7673b4-fad4-4259-9c88-4b20d4cfdd25 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:42.034386 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0472b-6a74-46df-a883-7194db59f0eb None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:42.034676 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0472b-6a74-46df-a883-7194db59f0eb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:42.034995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0472b-6a74-46df-a883-7194db59f0eb None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:42.036417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 24/42] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:40:42.041908 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa078302-bfc9-43f7-8f04-5e6360f57356 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:42.042199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa078302-bfc9-43f7-8f04-5e6360f57356 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:42.042475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa078302-bfc9-43f7-8f04-5e6360f57356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:42.044414 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7673b4-fad4-4259-9c88-4b20d4cfdd25 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:42.060279 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-aa078302-bfc9-43f7-8f04-5e6360f57356 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:42.061504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-aa078302-bfc9-43f7-8f04-5e6360f57356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:42.078998 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3620b2-705d-48c7-88d4-bd45c4b03e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:42.079684 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3620b2-705d-48c7-88d4-bd45c4b03e12 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:42.079962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3620b2-705d-48c7-88d4-bd45c4b03e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:42.080236 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3620b2-705d-48c7-88d4-bd45c4b03e12 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:42.081220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3620b2-705d-48c7-88d4-bd45c4b03e12 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:42.082684 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3620b2-705d-48c7-88d4-bd45c4b03e12 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:42.111337 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 19/43] 10.222.0.77 () {60 vars in 1141 bytes} [Wed May 11 06:40:41 2022] POST /identity/v3/projects => generated 301 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:40:42.128324 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 25/44] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:40:42.152267 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3620b2-705d-48c7-88d4-bd45c4b03e12 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:42.258611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3620b2-705d-48c7-88d4-bd45c4b03e12 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:42.299537 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0413e-6764-4608-858f-58c0e825da4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:42.300388 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0413e-6764-4608-858f-58c0e825da4f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:42.300671 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0413e-6764-4608-858f-58c0e825da4f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:42.300942 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0413e-6764-4608-858f-58c0e825da4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:42.302140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0413e-6764-4608-858f-58c0e825da4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:42.303706 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0413e-6764-4608-858f-58c0e825da4f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:42.305539 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 20/45] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:40:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:42.311071 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa078302-bfc9-43f7-8f04-5e6360f57356 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:42.408996 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa078302-bfc9-43f7-8f04-5e6360f57356 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:42.442884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029be17b-e5f5-4373-aa58-f60d03c981c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:42.443578 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029be17b-e5f5-4373-aa58-f60d03c981c3 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:42.443941 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029be17b-e5f5-4373-aa58-f60d03c981c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:42.444218 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029be17b-e5f5-4373-aa58-f60d03c981c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:42.444936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029be17b-e5f5-4373-aa58-f60d03c981c3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:42.446409 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029be17b-e5f5-4373-aa58-f60d03c981c3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:42.476225 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 26/46] 10.222.0.77 () {60 vars in 1141 bytes} [Wed May 11 06:40:42 2022] POST /identity/v3/projects => generated 312 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:43.797736 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702d751-15f7-4663-816c-2bdc7a56a74c None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:43.798256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702d751-15f7-4663-816c-2bdc7a56a74c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:43.798367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702d751-15f7-4663-816c-2bdc7a56a74c None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:43.799803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 21/47] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:40:43.805388 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af3bae-149d-49b1-a9ef-584e3e26cd5f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:43.805815 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af3bae-149d-49b1-a9ef-584e3e26cd5f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:43.806053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af3bae-149d-49b1-a9ef-584e3e26cd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:43.823430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d5af3bae-149d-49b1-a9ef-584e3e26cd5f None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:43.824610 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d5af3bae-149d-49b1-a9ef-584e3e26cd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:43.889809 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 27/48] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:40:43.912962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702d751-15f7-4663-816c-2bdc7a56a74c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:44.014774 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702d751-15f7-4663-816c-2bdc7a56a74c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:44.047684 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192aa24d-bf7a-4aa6-a9c8-4da4d32d5937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:44.048536 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192aa24d-bf7a-4aa6-a9c8-4da4d32d5937 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:44.048737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192aa24d-bf7a-4aa6-a9c8-4da4d32d5937 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:44.049010 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192aa24d-bf7a-4aa6-a9c8-4da4d32d5937 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:44.059897 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192aa24d-bf7a-4aa6-a9c8-4da4d32d5937 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:40:44.068571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-192aa24d-bf7a-4aa6-a9c8-4da4d32d5937 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:40:44.068571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:40:44.068571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:40:44.068571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:40:44.068571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:40:44.068571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:40:44.068571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:40:44.068571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:40:44.068571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:40:44.068571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:40:44.068571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:40:44.068571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:40:44.068571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:40:44.068571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:40:44.068571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:40:44.068571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:40:44.069573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:40:44.069573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:40:44.069573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:40:44.069573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:40:44.069573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:40:44.069573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:40:44.069573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:40:44.069573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:40:44.069573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:40:44.069573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:40:44.069573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:40:44.069573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:40:44.069573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:40:44.069573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:40:44.069573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:40:44.069573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:40:44.070342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:40:44.070342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:40:44.070342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:40:44.070342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:40:44.070342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:40:44.070342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:40:44.070342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:40:44.070342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:40:44.070342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:40:44.070342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:40:44.070342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:40:44.070342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:40:44.070342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 22/49] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:40:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:40:44.076183 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af3bae-149d-49b1-a9ef-584e3e26cd5f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:44.176761 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af3bae-149d-49b1-a9ef-584e3e26cd5f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:44.210270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd07f91-62e3-4a3f-ada0-2b6ebd17d845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:44.210950 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd07f91-62e3-4a3f-ada0-2b6ebd17d845 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:44.211253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd07f91-62e3-4a3f-ada0-2b6ebd17d845 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:44.211527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd07f91-62e3-4a3f-ada0-2b6ebd17d845 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:44.212288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd07f91-62e3-4a3f-ada0-2b6ebd17d845 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:44.212596 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd07f91-62e3-4a3f-ada0-2b6ebd17d845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:44.213995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd07f91-62e3-4a3f-ada0-2b6ebd17d845 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:44.222000 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 28/50] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:40:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:44.227721 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192aa24d-bf7a-4aa6-a9c8-4da4d32d5937 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:44.332386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192aa24d-bf7a-4aa6-a9c8-4da4d32d5937 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:44.363337 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e5da0-ea4c-46ee-95fb-03245686a9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:44.364209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e5da0-ea4c-46ee-95fb-03245686a9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:44.364500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e5da0-ea4c-46ee-95fb-03245686a9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:44.364769 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e5da0-ea4c-46ee-95fb-03245686a9b7 None admin] PATH_INFO: `/v3/users/7a9fbdd0a78349c9b11108cb751273ee` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:44.366240 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e5da0-ea4c-46ee-95fb-03245686a9b7 None admin] RBAC: Authorizing `identity:get_user(user_id=7a9fbdd0a78349c9b11108cb751273ee)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:44.367746 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e5da0-ea4c-46ee-95fb-03245686a9b7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:44.369384 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 23/51] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:40:44 2022] GET /identity/v3/users/7a9fbdd0a78349c9b11108cb751273ee => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:44.375110 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd07f91-62e3-4a3f-ada0-2b6ebd17d845 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:44.475548 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd07f91-62e3-4a3f-ada0-2b6ebd17d845 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:44.509890 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329b0ae-6b90-4024-bd11-5414f5fa7449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:44.510704 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329b0ae-6b90-4024-bd11-5414f5fa7449 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:44.510988 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329b0ae-6b90-4024-bd11-5414f5fa7449 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:44.511289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329b0ae-6b90-4024-bd11-5414f5fa7449 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:44.512590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329b0ae-6b90-4024-bd11-5414f5fa7449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:44.514076 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329b0ae-6b90-4024-bd11-5414f5fa7449 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:44.515836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 29/52] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:40:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:44.522215 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e5da0-ea4c-46ee-95fb-03245686a9b7 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:44.623835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e5da0-ea4c-46ee-95fb-03245686a9b7 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:44.659040 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34249b9-fa30-41e6-a497-ef8f63c95aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:44.659722 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34249b9-fa30-41e6-a497-ef8f63c95aba None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:44.660008 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34249b9-fa30-41e6-a497-ef8f63c95aba None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:44.660281 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34249b9-fa30-41e6-a497-ef8f63c95aba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:44.661106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34249b9-fa30-41e6-a497-ef8f63c95aba None admin] RBAC: Adding query filter params (role.id=5debd8ad07a74bedbf2efd53b11cd7cd, scope.domain.id=default, user.id=7a9fbdd0a78349c9b11108cb751273ee) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:44.661429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34249b9-fa30-41e6-a497-ef8f63c95aba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:44.662984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34249b9-fa30-41e6-a497-ef8f63c95aba None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:44.668833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 24/53] 10.222.0.77 () {56 vars in 1322 bytes} [Wed May 11 06:40:44 2022] GET /identity/v3/role_assignments?user.id=7a9fbdd0a78349c9b11108cb751273ee&scope.domain.id=default&role.id=5debd8ad07a74bedbf2efd53b11cd7cd => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:44.696478 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955feb6d-a0d4-447b-a555-8190aa6aea2e None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:44.696741 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955feb6d-a0d4-447b-a555-8190aa6aea2e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:44.697046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955feb6d-a0d4-447b-a555-8190aa6aea2e None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:44.698821 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 30/54] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:40:44.705039 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ab360-bfb9-434d-baca-acb95fa9756e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:44.705332 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ab360-bfb9-434d-baca-acb95fa9756e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:44.705619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ab360-bfb9-434d-baca-acb95fa9756e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:44.723367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-392ab360-bfb9-434d-baca-acb95fa9756e None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:44.724626 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-392ab360-bfb9-434d-baca-acb95fa9756e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:44.795707 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 25/55] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:40:44.819341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955feb6d-a0d4-447b-a555-8190aa6aea2e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:44.926602 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955feb6d-a0d4-447b-a555-8190aa6aea2e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:44.969543 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db685fd-b3c1-4cc1-ac36-66268c430d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:44.970349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db685fd-b3c1-4cc1-ac36-66268c430d19 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:44.970632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db685fd-b3c1-4cc1-ac36-66268c430d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:44.970904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db685fd-b3c1-4cc1-ac36-66268c430d19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:44.972228 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db685fd-b3c1-4cc1-ac36-66268c430d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:44.973699 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db685fd-b3c1-4cc1-ac36-66268c430d19 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:44.975481 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 31/56] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:40:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:44.982093 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ab360-bfb9-434d-baca-acb95fa9756e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:45.094402 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ab360-bfb9-434d-baca-acb95fa9756e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:45.127780 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5ebc1-6ab2-476b-8483-a6a1e422ef16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:45.128430 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5ebc1-6ab2-476b-8483-a6a1e422ef16 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:45.128706 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5ebc1-6ab2-476b-8483-a6a1e422ef16 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:45.128983 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5ebc1-6ab2-476b-8483-a6a1e422ef16 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:45.129702 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5ebc1-6ab2-476b-8483-a6a1e422ef16 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:45.131199 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5ebc1-6ab2-476b-8483-a6a1e422ef16 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:45.159394 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 26/57] 10.222.0.77 () {60 vars in 1140 bytes} [Wed May 11 06:40:44 2022] POST /identity/v3/projects => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:40:47.333554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9716bdd-41b3-451c-8624-9cb1145ccf2a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:47.334036 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9716bdd-41b3-451c-8624-9cb1145ccf2a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:47.334200 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9716bdd-41b3-451c-8624-9cb1145ccf2a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:47.336578 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 32/58] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:40:47.345397 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0fa5e-bda4-4026-927a-65874c85a21e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:47.346078 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0fa5e-bda4-4026-927a-65874c85a21e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:47.346253 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0fa5e-bda4-4026-927a-65874c85a21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:47.371279 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-88c0fa5e-bda4-4026-927a-65874c85a21e None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:47.372471 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-88c0fa5e-bda4-4026-927a-65874c85a21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:47.438030 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 27/59] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:40:47.470620 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9716bdd-41b3-451c-8624-9cb1145ccf2a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:47.577417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9716bdd-41b3-451c-8624-9cb1145ccf2a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:47.614887 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e443e-485e-4e30-b8de-9b924a8e8482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:47.615766 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e443e-485e-4e30-b8de-9b924a8e8482 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:47.616051 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e443e-485e-4e30-b8de-9b924a8e8482 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:47.616337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e443e-485e-4e30-b8de-9b924a8e8482 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:47.617592 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e443e-485e-4e30-b8de-9b924a8e8482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:47.619080 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e443e-485e-4e30-b8de-9b924a8e8482 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:47.620684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 33/60] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:40:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:47.626455 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0fa5e-bda4-4026-927a-65874c85a21e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:47.723458 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0fa5e-bda4-4026-927a-65874c85a21e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:47.756894 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a84ac2-10c0-4571-b132-1dbbd14305ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:47.757556 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a84ac2-10c0-4571-b132-1dbbd14305ba None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:47.757837 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a84ac2-10c0-4571-b132-1dbbd14305ba None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:47.758115 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a84ac2-10c0-4571-b132-1dbbd14305ba None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:47.758821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a84ac2-10c0-4571-b132-1dbbd14305ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:47.760325 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a84ac2-10c0-4571-b132-1dbbd14305ba None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:47.793954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 28/61] 10.222.0.77 () {60 vars in 1132 bytes} [Wed May 11 06:40:47 2022] POST /identity/v3/users => generated 275 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:51.090474 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce77448-e2d7-436c-a7fb-f8adcbf4e764 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:51.091034 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce77448-e2d7-436c-a7fb-f8adcbf4e764 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:51.091145 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce77448-e2d7-436c-a7fb-f8adcbf4e764 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:51.092486 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 34/62] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:40:51.100424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c713a25-4897-4180-8e47-d9541f8129db None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:51.100424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c713a25-4897-4180-8e47-d9541f8129db None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:51.100424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c713a25-4897-4180-8e47-d9541f8129db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:51.124046 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0c713a25-4897-4180-8e47-d9541f8129db None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:51.125616 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0c713a25-4897-4180-8e47-d9541f8129db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:51.208576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 29/63] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:40:51.237567 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce77448-e2d7-436c-a7fb-f8adcbf4e764 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:51.385370 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce77448-e2d7-436c-a7fb-f8adcbf4e764 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:51.433899 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d346f5e-a658-43ed-af6f-d4530802c006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:51.434705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d346f5e-a658-43ed-af6f-d4530802c006 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:51.435009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d346f5e-a658-43ed-af6f-d4530802c006 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:51.435286 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d346f5e-a658-43ed-af6f-d4530802c006 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:51.451443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d346f5e-a658-43ed-af6f-d4530802c006 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:40:51.459039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-9d346f5e-a658-43ed-af6f-d4530802c006 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:40:51.459039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:40:51.459039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:40:51.459039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:40:51.459039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:40:51.459039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:40:51.459039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:40:51.459039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:40:51.459039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:40:51.459039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:40:51.459039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:40:51.459039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:40:51.459039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:40:51.459039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:40:51.459039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:40:51.459039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:40:51.459962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:40:51.459962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:40:51.459962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:40:51.459962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:40:51.459962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:40:51.459962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:40:51.459962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:40:51.459962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:40:51.459962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:40:51.459962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:40:51.459962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:40:51.459962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:40:51.459962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:40:51.459962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:40:51.459962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:40:51.459962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:40:51.460751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:40:51.460751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:40:51.460751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:40:51.460751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:40:51.460751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:40:51.460751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:40:51.460751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:40:51.460751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:40:51.460751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:40:51.460751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:40:51.460751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:40:51.460751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:40:51.460751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 35/64] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:40:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:40:51.466094 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c713a25-4897-4180-8e47-d9541f8129db None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:51.516550 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941770ff-ddb9-4698-8be6-bfcbe460cb3f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:51.516550 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941770ff-ddb9-4698-8be6-bfcbe460cb3f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:51.516832 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941770ff-ddb9-4698-8be6-bfcbe460cb3f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:51.518767 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 36/65] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:40:51.519968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3c40d-1b86-4be0-bb9d-2d31bf607349 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:51.520248 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3c40d-1b86-4be0-bb9d-2d31bf607349 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:51.520521 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3c40d-1b86-4be0-bb9d-2d31bf607349 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:51.521985 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 37/66] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:40:51.526944 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5a3af-8c57-4420-8fd3-c47eac74f03b None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:51.527264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5a3af-8c57-4420-8fd3-c47eac74f03b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:51.527540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5a3af-8c57-4420-8fd3-c47eac74f03b None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:51.529030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 38/67] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:40:51.529933 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee63b14-9aec-4c8d-adbe-1667ef91c8c7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:51.530210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee63b14-9aec-4c8d-adbe-1667ef91c8c7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:51.530483 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee63b14-9aec-4c8d-adbe-1667ef91c8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:51.546682 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7ee63b14-9aec-4c8d-adbe-1667ef91c8c7 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:51.547935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7ee63b14-9aec-4c8d-adbe-1667ef91c8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:51.577421 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c713a25-4897-4180-8e47-d9541f8129db None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:51.613413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe8fb9-ca2d-4e64-942f-b8fa50f5f5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:51.614174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe8fb9-ca2d-4e64-942f-b8fa50f5f5ff None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:51.614457 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe8fb9-ca2d-4e64-942f-b8fa50f5f5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:51.614782 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe8fb9-ca2d-4e64-942f-b8fa50f5f5ff None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:51.615597 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe8fb9-ca2d-4e64-942f-b8fa50f5f5ff None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:51.622996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe8fb9-ca2d-4e64-942f-b8fa50f5f5ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:51.623202 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 39/68] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:40:51.623202 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94493736-af50-41b8-ad6d-08383074b3cd None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:51.623358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe8fb9-ca2d-4e64-942f-b8fa50f5f5ff None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:51.623435 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94493736-af50-41b8-ad6d-08383074b3cd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:51.623435 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94493736-af50-41b8-ad6d-08383074b3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:51.633604 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 30/69] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:40:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:51.635139 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f374a-fe55-4bcf-92eb-6b00682c5537 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:51.635489 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f374a-fe55-4bcf-92eb-6b00682c5537 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:51.635833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f374a-fe55-4bcf-92eb-6b00682c5537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:51.636848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-94493736-af50-41b8-ad6d-08383074b3cd None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:51.638212 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-94493736-af50-41b8-ad6d-08383074b3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:51.658927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-dc9f374a-fe55-4bcf-92eb-6b00682c5537 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:51.660175 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-dc9f374a-fe55-4bcf-92eb-6b00682c5537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:51.716777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 40/70] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:40:51.717631 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94493736-af50-41b8-ad6d-08383074b3cd None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:51.738924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 31/71] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:40:51.738924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f374a-fe55-4bcf-92eb-6b00682c5537 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:51.842194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f374a-fe55-4bcf-92eb-6b00682c5537 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:51.842466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94493736-af50-41b8-ad6d-08383074b3cd None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:51.880312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a95296-9427-4c37-9226-ee0891edf551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:51.880705 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f43db7-829f-4980-863d-240254be16f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:51.881218 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a95296-9427-4c37-9226-ee0891edf551 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:51.881513 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a95296-9427-4c37-9226-ee0891edf551 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:51.881640 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f43db7-829f-4980-863d-240254be16f3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:51.881800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a95296-9427-4c37-9226-ee0891edf551 None admin] PATH_INFO: `/v3/users/5c4ff16e69b74f1f9018258137fba1f3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:51.881921 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f43db7-829f-4980-863d-240254be16f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:51.882048 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f43db7-829f-4980-863d-240254be16f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:51.893394 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f43db7-829f-4980-863d-240254be16f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:40:51.898855 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a95296-9427-4c37-9226-ee0891edf551 None admin] RBAC: Authorizing `identity:get_user(user_id=5c4ff16e69b74f1f9018258137fba1f3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:51.900382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a95296-9427-4c37-9226-ee0891edf551 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:51.901288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-59f43db7-829f-4980-863d-240254be16f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:40:51.901288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:40:51.901288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:40:51.901288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:40:51.901288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:40:51.901288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:40:51.901288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:40:51.901288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:40:51.901288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:40:51.901288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:40:51.901288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:40:51.901288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:40:51.901288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:40:51.901288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:40:51.901288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:40:51.901288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:40:51.902153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:40:51.902153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:40:51.902153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:40:51.902153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:40:51.902153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:40:51.902153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:40:51.902153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:40:51.902153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:40:51.902153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:40:51.902153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:40:51.902153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:40:51.902153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:40:51.902153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:40:51.902153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:40:51.902153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:40:51.902153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:40:51.902926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:40:51.902926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:40:51.902926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:40:51.902926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:40:51.902926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:40:51.902926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:40:51.902926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:40:51.902926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:40:51.902926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:40:51.902926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:40:51.902926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:40:51.902926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:40:51.903575 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 41/72] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:40:51 2022] GET /identity/v3/users/5c4ff16e69b74f1f9018258137fba1f3 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:51.903650 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 32/73] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:40:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:40:51.903723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a95296-9427-4c37-9226-ee0891edf551 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:51.903789 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f43db7-829f-4980-863d-240254be16f3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:52.009989 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f43db7-829f-4980-863d-240254be16f3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:52.010214 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a95296-9427-4c37-9226-ee0891edf551 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:52.043869 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be637f8-caa1-44cb-8ff4-1d35c866406b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:52.044687 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be637f8-caa1-44cb-8ff4-1d35c866406b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:52.044969 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be637f8-caa1-44cb-8ff4-1d35c866406b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:52.045243 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be637f8-caa1-44cb-8ff4-1d35c866406b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:52.045713 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec740d-3cf2-419d-b2ee-45b33ff9894d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:52.046518 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec740d-3cf2-419d-b2ee-45b33ff9894d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:52.046798 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec740d-3cf2-419d-b2ee-45b33ff9894d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:52.047110 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec740d-3cf2-419d-b2ee-45b33ff9894d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:52.055449 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be637f8-caa1-44cb-8ff4-1d35c866406b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:40:52.059368 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec740d-3cf2-419d-b2ee-45b33ff9894d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:40:52.063495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-8be637f8-caa1-44cb-8ff4-1d35c866406b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:40:52.063495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:40:52.063495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:40:52.063495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:40:52.063495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:40:52.063495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:40:52.063495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:40:52.063495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:40:52.063495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:40:52.063495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:40:52.063495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:40:52.063495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:40:52.063495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:40:52.063495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:40:52.063495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:40:52.063495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:40:52.064335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:40:52.064335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:40:52.064335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:40:52.064335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:40:52.064335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:40:52.064335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:40:52.064335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:40:52.064335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:40:52.064335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:40:52.064335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:40:52.064335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:40:52.064335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:40:52.064335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:40:52.064335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:40:52.064335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:40:52.064335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:40:52.065101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:40:52.065101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:40:52.065101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:40:52.065101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:40:52.065101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:40:52.065101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:40:52.065101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:40:52.065101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:40:52.065101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:40:52.065101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:40:52.065101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:40:52.065101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:40:52.065101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 42/74] 10.222.0.77 () {56 vars in 1114 bytes} [Wed May 11 06:40:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:40:52.066104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e35925-f189-44f8-96d3-57ab6f5ae918 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:52.066295 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e35925-f189-44f8-96d3-57ab6f5ae918 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:52.066574 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e35925-f189-44f8-96d3-57ab6f5ae918 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:52.067140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-0dec740d-3cf2-419d-b2ee-45b33ff9894d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:40:52.067140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:40:52.067140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:40:52.067140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:40:52.067140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:40:52.067140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:40:52.067140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:40:52.067140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:40:52.067140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:40:52.067140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:40:52.067140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:40:52.067140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:40:52.067140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:40:52.067140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:40:52.067140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:40:52.067140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:40:52.070610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:40:52.070610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:40:52.070610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:40:52.070610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:40:52.070610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:40:52.070610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:40:52.070610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:40:52.070610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:40:52.070610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:40:52.070610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:40:52.070610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:40:52.070610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:40:52.070610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:40:52.070610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:40:52.070610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:40:52.070610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:40:52.071600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:40:52.071600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:40:52.071600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:40:52.071600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:40:52.071600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:40:52.071600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:40:52.071600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:40:52.071600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:40:52.071600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:40:52.071600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:40:52.071600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:40:52.071600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:40:52.072512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 43/75] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:40:52.072589 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 33/76] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:40:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:40:52.072654 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e35925-f189-44f8-96d3-57ab6f5ae918 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:52.072718 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec740d-3cf2-419d-b2ee-45b33ff9894d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:52.182537 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec740d-3cf2-419d-b2ee-45b33ff9894d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:52.185540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e35925-f189-44f8-96d3-57ab6f5ae918 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:52.219712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6c97b-a795-4de7-be3d-ebfa92a5a176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:52.220397 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6c97b-a795-4de7-be3d-ebfa92a5a176 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:52.220682 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6c97b-a795-4de7-be3d-ebfa92a5a176 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:52.220963 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6c97b-a795-4de7-be3d-ebfa92a5a176 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:52.221741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6c97b-a795-4de7-be3d-ebfa92a5a176 None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:52.222053 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6c97b-a795-4de7-be3d-ebfa92a5a176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:52.223531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6c97b-a795-4de7-be3d-ebfa92a5a176 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:52.224317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8f124-e7b5-4140-9b30-ae405f682282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:52.225089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8f124-e7b5-4140-9b30-ae405f682282 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:52.225388 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8f124-e7b5-4140-9b30-ae405f682282 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:52.225668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8f124-e7b5-4140-9b30-ae405f682282 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:52.234000 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 34/77] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:40:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:52.234796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6c97b-a795-4de7-be3d-ebfa92a5a176 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:52.302891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8f124-e7b5-4140-9b30-ae405f682282 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:52.304462 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8f124-e7b5-4140-9b30-ae405f682282 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:52.342429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6c97b-a795-4de7-be3d-ebfa92a5a176 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:52.383376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0b242-6371-44dc-ab6a-5657c7661cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:52.384061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0b242-6371-44dc-ab6a-5657c7661cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:52.384347 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0b242-6371-44dc-ab6a-5657c7661cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:52.384630 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0b242-6371-44dc-ab6a-5657c7661cf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:52.385389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a0b242-6371-44dc-ab6a-5657c7661cf6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:52.385701 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a0b242-6371-44dc-ab6a-5657c7661cf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:52.387111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a0b242-6371-44dc-ab6a-5657c7661cf6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:52.398051 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 35/78] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:40:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:52.399462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f0108-54d9-4542-a450-5f4567899d4c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:52.399752 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f0108-54d9-4542-a450-5f4567899d4c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:52.400028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f0108-54d9-4542-a450-5f4567899d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:52.415400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 44/79] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:40:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:40:52.416370 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8f124-e7b5-4140-9b30-ae405f682282 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:52.418255 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-719f0108-54d9-4542-a450-5f4567899d4c None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:52.419575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-719f0108-54d9-4542-a450-5f4567899d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:52.491240 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 36/80] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:40:52.492019 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f0108-54d9-4542-a450-5f4567899d4c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:52.525017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8f124-e7b5-4140-9b30-ae405f682282 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:52.562080 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f81bc5-d438-4cdc-a03c-61657a750c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:52.562757 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f81bc5-d438-4cdc-a03c-61657a750c6c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:52.563079 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f81bc5-d438-4cdc-a03c-61657a750c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:52.563357 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f81bc5-d438-4cdc-a03c-61657a750c6c None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:52.564113 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f81bc5-d438-4cdc-a03c-61657a750c6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:52.564417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f81bc5-d438-4cdc-a03c-61657a750c6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:52.565820 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f81bc5-d438-4cdc-a03c-61657a750c6c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:52.574417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 45/81] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:40:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:52.575244 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f81bc5-d438-4cdc-a03c-61657a750c6c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:52.597681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f0108-54d9-4542-a450-5f4567899d4c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:52.631822 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640a8a5-af94-497e-96d2-70539aea8ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:52.632710 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640a8a5-af94-497e-96d2-70539aea8ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:52.632996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640a8a5-af94-497e-96d2-70539aea8ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:52.633265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640a8a5-af94-497e-96d2-70539aea8ed3 None admin] PATH_INFO: `/v3/users/5c4ff16e69b74f1f9018258137fba1f3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:52.634469 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640a8a5-af94-497e-96d2-70539aea8ed3 None admin] RBAC: Authorizing `identity:get_user(user_id=5c4ff16e69b74f1f9018258137fba1f3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:52.635964 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640a8a5-af94-497e-96d2-70539aea8ed3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:52.637605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 37/82] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:40:52 2022] GET /identity/v3/users/5c4ff16e69b74f1f9018258137fba1f3 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:52.638354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640a8a5-af94-497e-96d2-70539aea8ed3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:52.676139 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f81bc5-d438-4cdc-a03c-61657a750c6c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:52.708342 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66f8af-e353-47e5-a122-3404f8196095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:52.709223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66f8af-e353-47e5-a122-3404f8196095 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:52.709563 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66f8af-e353-47e5-a122-3404f8196095 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:52.709838 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66f8af-e353-47e5-a122-3404f8196095 None admin] PATH_INFO: `/v3/users/5c4ff16e69b74f1f9018258137fba1f3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:52.711087 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66f8af-e353-47e5-a122-3404f8196095 None admin] RBAC: Authorizing `identity:get_user(user_id=5c4ff16e69b74f1f9018258137fba1f3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:52.712543 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66f8af-e353-47e5-a122-3404f8196095 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:52.714192 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 46/83] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:40:52 2022] GET /identity/v3/users/5c4ff16e69b74f1f9018258137fba1f3 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:52.714977 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66f8af-e353-47e5-a122-3404f8196095 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:52.737017 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640a8a5-af94-497e-96d2-70539aea8ed3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:52.769259 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39053d-c312-41a1-82d6-77efa79ce9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:52.770063 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39053d-c312-41a1-82d6-77efa79ce9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:52.770345 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39053d-c312-41a1-82d6-77efa79ce9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:52.770621 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39053d-c312-41a1-82d6-77efa79ce9a0 None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:52.771958 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39053d-c312-41a1-82d6-77efa79ce9a0 None admin] RBAC: Authorizing `identity:get_project(project_id=660afb35216c4b94a77b71d73962d86f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:52.773517 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39053d-c312-41a1-82d6-77efa79ce9a0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:52.775267 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 38/84] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:40:52 2022] GET /identity/v3/projects/660afb35216c4b94a77b71d73962d86f => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:52.776025 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39053d-c312-41a1-82d6-77efa79ce9a0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:52.806750 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66f8af-e353-47e5-a122-3404f8196095 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:52.838481 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a2a23-6142-44e0-bf5b-62298c8397e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:52.839335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a2a23-6142-44e0-bf5b-62298c8397e7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:52.839627 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a2a23-6142-44e0-bf5b-62298c8397e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:52.839905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a2a23-6142-44e0-bf5b-62298c8397e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:52.841102 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a2a23-6142-44e0-bf5b-62298c8397e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:52.842555 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a2a23-6142-44e0-bf5b-62298c8397e7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:52.844224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 47/85] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:40:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:52.844985 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a2a23-6142-44e0-bf5b-62298c8397e7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:52.870188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39053d-c312-41a1-82d6-77efa79ce9a0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:52.903197 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c0bde-67e6-404d-9484-d2d37f07fb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:52.904085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c0bde-67e6-404d-9484-d2d37f07fb1c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:52.904370 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c0bde-67e6-404d-9484-d2d37f07fb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:52.904648 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c0bde-67e6-404d-9484-d2d37f07fb1c None admin] PATH_INFO: `/v3/users/7a9fbdd0a78349c9b11108cb751273ee` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:52.905874 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c0bde-67e6-404d-9484-d2d37f07fb1c None admin] RBAC: Authorizing `identity:get_user(user_id=7a9fbdd0a78349c9b11108cb751273ee)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:52.907373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c0bde-67e6-404d-9484-d2d37f07fb1c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:52.909025 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 39/86] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:40:52 2022] GET /identity/v3/users/7a9fbdd0a78349c9b11108cb751273ee => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:52.909814 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c0bde-67e6-404d-9484-d2d37f07fb1c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:52.941800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a2a23-6142-44e0-bf5b-62298c8397e7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:52.973614 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2c3f6-6638-4e7b-9a59-cbbe98f6cfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:52.974265 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2c3f6-6638-4e7b-9a59-cbbe98f6cfb7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:52.974548 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2c3f6-6638-4e7b-9a59-cbbe98f6cfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:52.974821 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2c3f6-6638-4e7b-9a59-cbbe98f6cfb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:53.008453 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c0bde-67e6-404d-9484-d2d37f07fb1c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:53.042949 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e7254-b11b-46d7-85dc-9fcd0aa5747d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:53.043570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e7254-b11b-46d7-85dc-9fcd0aa5747d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:53.043853 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e7254-b11b-46d7-85dc-9fcd0aa5747d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:53.044154 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e7254-b11b-46d7-85dc-9fcd0aa5747d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:53.050536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2c3f6-6638-4e7b-9a59-cbbe98f6cfb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:53.052063 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2c3f6-6638-4e7b-9a59-cbbe98f6cfb7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:53.110752 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e7254-b11b-46d7-85dc-9fcd0aa5747d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:53.112261 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e7254-b11b-46d7-85dc-9fcd0aa5747d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:53.144650 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 48/87] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:40:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:40:53.145530 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2c3f6-6638-4e7b-9a59-cbbe98f6cfb7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:53.209540 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 40/88] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:40:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:40:53.210360 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e7254-b11b-46d7-85dc-9fcd0aa5747d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:53.241973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2c3f6-6638-4e7b-9a59-cbbe98f6cfb7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:53.273357 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea14ed-716e-44fd-bb20-70a6bd2886c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:53.274024 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea14ed-716e-44fd-bb20-70a6bd2886c2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:53.274310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea14ed-716e-44fd-bb20-70a6bd2886c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:53.274592 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea14ed-716e-44fd-bb20-70a6bd2886c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:53.275494 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea14ed-716e-44fd-bb20-70a6bd2886c2 None admin] RBAC: Adding query filter params (role.id=f8d42be71f034e1a88784699c04e7a89, scope.project.id=660afb35216c4b94a77b71d73962d86f, user.id=5c4ff16e69b74f1f9018258137fba1f3) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:53.275808 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea14ed-716e-44fd-bb20-70a6bd2886c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:53.277287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea14ed-716e-44fd-bb20-70a6bd2886c2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:53.284009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 49/89] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:40:53 2022] GET /identity/v3/role_assignments?user.id=5c4ff16e69b74f1f9018258137fba1f3&scope.project.id=660afb35216c4b94a77b71d73962d86f&role.id=f8d42be71f034e1a88784699c04e7a89 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:53.284846 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea14ed-716e-44fd-bb20-70a6bd2886c2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:53.310021 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e7254-b11b-46d7-85dc-9fcd0aa5747d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:53.347189 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c7698-0ded-451d-b492-ab70c3eaa116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:53.347889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c7698-0ded-451d-b492-ab70c3eaa116 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:53.348170 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c7698-0ded-451d-b492-ab70c3eaa116 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:53.348444 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c7698-0ded-451d-b492-ab70c3eaa116 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:53.349183 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c7698-0ded-451d-b492-ab70c3eaa116 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:53.350743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c7698-0ded-451d-b492-ab70c3eaa116 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:53.372828 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 41/90] 10.222.0.77 () {60 vars in 1132 bytes} [Wed May 11 06:40:53 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:53.373703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c7698-0ded-451d-b492-ab70c3eaa116 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:53.409658 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea14ed-716e-44fd-bb20-70a6bd2886c2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:53.447650 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce269cc-1bf4-4a00-8601-6cb5064990d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:53.448383 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce269cc-1bf4-4a00-8601-6cb5064990d9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:53.448671 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce269cc-1bf4-4a00-8601-6cb5064990d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:53.448949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce269cc-1bf4-4a00-8601-6cb5064990d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:53.487587 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c7698-0ded-451d-b492-ab70c3eaa116 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:53.523892 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff34c6e-6a92-4117-a5a3-007ac224115d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:53.524791 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff34c6e-6a92-4117-a5a3-007ac224115d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:53.525077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff34c6e-6a92-4117-a5a3-007ac224115d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:53.525357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff34c6e-6a92-4117-a5a3-007ac224115d None admin] PATH_INFO: `/v3/projects/4985bb9f8e3546c5a46f84a872734222` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:53.525740 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce269cc-1bf4-4a00-8601-6cb5064990d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:53.526679 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff34c6e-6a92-4117-a5a3-007ac224115d None admin] RBAC: Authorizing `identity:get_project(project_id=4985bb9f8e3546c5a46f84a872734222)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:53.527266 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce269cc-1bf4-4a00-8601-6cb5064990d9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:53.528212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff34c6e-6a92-4117-a5a3-007ac224115d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:53.530020 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 42/91] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:40:53 2022] GET /identity/v3/projects/4985bb9f8e3546c5a46f84a872734222 => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:53.530836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff34c6e-6a92-4117-a5a3-007ac224115d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:53.640683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff34c6e-6a92-4117-a5a3-007ac224115d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:53.654242 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 50/92] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:40:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:40:53.654242 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce269cc-1bf4-4a00-8601-6cb5064990d9 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:53.674303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337318c-0fe4-4501-b80c-2a4cc95ca16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:53.675250 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337318c-0fe4-4501-b80c-2a4cc95ca16b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:53.675529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337318c-0fe4-4501-b80c-2a4cc95ca16b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:53.675806 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337318c-0fe4-4501-b80c-2a4cc95ca16b None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:53.677017 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337318c-0fe4-4501-b80c-2a4cc95ca16b None admin] RBAC: Authorizing `identity:get_project(project_id=660afb35216c4b94a77b71d73962d86f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:53.678509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337318c-0fe4-4501-b80c-2a4cc95ca16b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:53.680592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 43/93] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:40:53 2022] GET /identity/v3/projects/660afb35216c4b94a77b71d73962d86f => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:53.681684 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337318c-0fe4-4501-b80c-2a4cc95ca16b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:53.770325 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce269cc-1bf4-4a00-8601-6cb5064990d9 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:53.815427 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337318c-0fe4-4501-b80c-2a4cc95ca16b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:53.816150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dabb49-c1d3-4b7b-9428-411120960ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:53.817222 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dabb49-c1d3-4b7b-9428-411120960ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:53.818528 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dabb49-c1d3-4b7b-9428-411120960ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:53.819168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dabb49-c1d3-4b7b-9428-411120960ca4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:53.820232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dabb49-c1d3-4b7b-9428-411120960ca4 None admin] RBAC: Adding query filter params (role.id=f8d42be71f034e1a88784699c04e7a89, scope.project.id=4985bb9f8e3546c5a46f84a872734222, user.id=5c4ff16e69b74f1f9018258137fba1f3) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:53.820755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dabb49-c1d3-4b7b-9428-411120960ca4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:53.822792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dabb49-c1d3-4b7b-9428-411120960ca4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:53.831114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 51/94] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:40:53 2022] GET /identity/v3/role_assignments?user.id=5c4ff16e69b74f1f9018258137fba1f3&scope.project.id=4985bb9f8e3546c5a46f84a872734222&role.id=f8d42be71f034e1a88784699c04e7a89 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:53.832844 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dabb49-c1d3-4b7b-9428-411120960ca4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:53.864136 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b2eaa-38c6-49ec-94ed-ec7d902eeebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:53.865355 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b2eaa-38c6-49ec-94ed-ec7d902eeebd None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:53.866800 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b2eaa-38c6-49ec-94ed-ec7d902eeebd None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:53.867341 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b2eaa-38c6-49ec-94ed-ec7d902eeebd None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:53.869862 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b2eaa-38c6-49ec-94ed-ec7d902eeebd None admin] RBAC: Authorizing `identity:get_project(project_id=660afb35216c4b94a77b71d73962d86f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:53.873010 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b2eaa-38c6-49ec-94ed-ec7d902eeebd None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:53.877255 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 44/95] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:40:53 2022] GET /identity/v3/projects/660afb35216c4b94a77b71d73962d86f => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:53.889068 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b2eaa-38c6-49ec-94ed-ec7d902eeebd None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:53.983392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dabb49-c1d3-4b7b-9428-411120960ca4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:54.030603 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7483103-7b1d-4358-a01a-59767b57fcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:54.031617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7483103-7b1d-4358-a01a-59767b57fcac None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:54.032082 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7483103-7b1d-4358-a01a-59767b57fcac None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:54.032563 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7483103-7b1d-4358-a01a-59767b57fcac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:54.033614 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7483103-7b1d-4358-a01a-59767b57fcac None admin] RBAC: Adding query filter params (role.id=ae6b211774c34f47a3ac4853538f62ad, scope.project.id=660afb35216c4b94a77b71d73962d86f, user.id=5c4ff16e69b74f1f9018258137fba1f3) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:54.034127 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7483103-7b1d-4358-a01a-59767b57fcac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:54.035852 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7483103-7b1d-4358-a01a-59767b57fcac None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:54.046824 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 52/96] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:40:53 2022] GET /identity/v3/role_assignments?user.id=5c4ff16e69b74f1f9018258137fba1f3&scope.project.id=660afb35216c4b94a77b71d73962d86f&role.id=ae6b211774c34f47a3ac4853538f62ad => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:54.113167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b2eaa-38c6-49ec-94ed-ec7d902eeebd None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:54.154470 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee732c9-7b6b-4825-b842-a50327145f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:54.155177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee732c9-7b6b-4825-b842-a50327145f23 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:54.155467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee732c9-7b6b-4825-b842-a50327145f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:54.155745 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee732c9-7b6b-4825-b842-a50327145f23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:54.156593 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee732c9-7b6b-4825-b842-a50327145f23 None admin] RBAC: Adding query filter params (role.id=5debd8ad07a74bedbf2efd53b11cd7cd, scope.project.id=660afb35216c4b94a77b71d73962d86f, user.id=7a9fbdd0a78349c9b11108cb751273ee) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:54.156905 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee732c9-7b6b-4825-b842-a50327145f23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:54.158373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee732c9-7b6b-4825-b842-a50327145f23 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:54.164567 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 45/97] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:40:53 2022] GET /identity/v3/role_assignments?user.id=7a9fbdd0a78349c9b11108cb751273ee&scope.project.id=660afb35216c4b94a77b71d73962d86f&role.id=5debd8ad07a74bedbf2efd53b11cd7cd => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:40:55.896336 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef9519-7d9e-43ad-a3d4-bb1b0eafbfe4 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:55.897570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef9519-7d9e-43ad-a3d4-bb1b0eafbfe4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:55.898066 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef9519-7d9e-43ad-a3d4-bb1b0eafbfe4 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:55.899983 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 53/98] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:40:55.905823 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208a3c7-fa4d-4740-b869-c3f8e8445cbb None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:55.906682 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208a3c7-fa4d-4740-b869-c3f8e8445cbb None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:55.907213 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208a3c7-fa4d-4740-b869-c3f8e8445cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:55.924396 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0208a3c7-fa4d-4740-b869-c3f8e8445cbb None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:55.925906 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0208a3c7-fa4d-4740-b869-c3f8e8445cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:55.992263 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 46/99] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:40:56.014725 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef9519-7d9e-43ad-a3d4-bb1b0eafbfe4 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:56.121139 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef9519-7d9e-43ad-a3d4-bb1b0eafbfe4 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:56.154494 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db2e71-4044-41a4-9a4f-f396a5d4dd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:56.155682 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db2e71-4044-41a4-9a4f-f396a5d4dd46 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:56.156183 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db2e71-4044-41a4-9a4f-f396a5d4dd46 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:56.156665 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db2e71-4044-41a4-9a4f-f396a5d4dd46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:56.167163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db2e71-4044-41a4-9a4f-f396a5d4dd46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:40:56.175159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a8db2e71-4044-41a4-9a4f-f396a5d4dd46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:40:56.175159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:40:56.175159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:40:56.175159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:40:56.175159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:40:56.175159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:40:56.175159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:40:56.175159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:40:56.175159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:40:56.175159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:40:56.175159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:40:56.175159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:40:56.175159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:40:56.175159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:40:56.175159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:40:56.175159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:40:56.176075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:40:56.176075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:40:56.176075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:40:56.176075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:40:56.176075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:40:56.176075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:40:56.176075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:40:56.176075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:40:56.176075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:40:56.176075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:40:56.176075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:40:56.176075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:40:56.176075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:40:56.176075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:40:56.176075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:40:56.176075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:40:56.176889 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:40:56.176889 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:40:56.176889 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:40:56.176889 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:40:56.176889 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:40:56.176889 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:40:56.176889 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:40:56.176889 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:40:56.176889 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:40:56.176889 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:40:56.176889 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:40:56.176889 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:40:56.179329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 54/100] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:40:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:40:56.185327 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208a3c7-fa4d-4740-b869-c3f8e8445cbb None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:56.288224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208a3c7-fa4d-4740-b869-c3f8e8445cbb None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:56.328054 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298c037-511c-4306-b7e7-14e1f3086913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:56.329140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298c037-511c-4306-b7e7-14e1f3086913 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:56.329633 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298c037-511c-4306-b7e7-14e1f3086913 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:56.330113 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298c037-511c-4306-b7e7-14e1f3086913 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:56.331097 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298c037-511c-4306-b7e7-14e1f3086913 None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:56.331615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298c037-511c-4306-b7e7-14e1f3086913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:56.333226 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298c037-511c-4306-b7e7-14e1f3086913 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:56.342019 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 47/101] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:40:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:56.348025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db2e71-4044-41a4-9a4f-f396a5d4dd46 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:56.454008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db2e71-4044-41a4-9a4f-f396a5d4dd46 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:56.488040 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a4ecd-bf26-4d8c-9c80-c584160132b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:56.489300 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a4ecd-bf26-4d8c-9c80-c584160132b9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:56.489790 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a4ecd-bf26-4d8c-9c80-c584160132b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:56.490270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a4ecd-bf26-4d8c-9c80-c584160132b9 None admin] PATH_INFO: `/v3/users/5c4ff16e69b74f1f9018258137fba1f3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:56.491937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a4ecd-bf26-4d8c-9c80-c584160132b9 None admin] RBAC: Authorizing `identity:get_user(user_id=5c4ff16e69b74f1f9018258137fba1f3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:56.493629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a4ecd-bf26-4d8c-9c80-c584160132b9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:56.495964 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 55/102] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:40:56 2022] GET /identity/v3/users/5c4ff16e69b74f1f9018258137fba1f3 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:56.501814 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298c037-511c-4306-b7e7-14e1f3086913 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:56.601241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298c037-511c-4306-b7e7-14e1f3086913 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:56.634598 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc235702-fb4f-49d2-aa3a-becf077070be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:56.635893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc235702-fb4f-49d2-aa3a-becf077070be None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:56.636391 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc235702-fb4f-49d2-aa3a-becf077070be None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:56.636871 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc235702-fb4f-49d2-aa3a-becf077070be None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:56.638357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc235702-fb4f-49d2-aa3a-becf077070be None admin] RBAC: Authorizing `identity:get_project(project_id=660afb35216c4b94a77b71d73962d86f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:56.640074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc235702-fb4f-49d2-aa3a-becf077070be None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:56.642012 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 48/103] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:40:56 2022] GET /identity/v3/projects/660afb35216c4b94a77b71d73962d86f => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:56.647938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a4ecd-bf26-4d8c-9c80-c584160132b9 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:56.752560 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a4ecd-bf26-4d8c-9c80-c584160132b9 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:56.787612 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61c607-4aa9-4bbc-b7b5-88dde301bd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:56.788877 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61c607-4aa9-4bbc-b7b5-88dde301bd61 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:56.789389 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61c607-4aa9-4bbc-b7b5-88dde301bd61 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:56.789862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61c607-4aa9-4bbc-b7b5-88dde301bd61 None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f/users/5c4ff16e69b74f1f9018258137fba1f3/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:56.792123 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61c607-4aa9-4bbc-b7b5-88dde301bd61 None admin] RBAC: Authorizing `identity:create_grant(project_id=660afb35216c4b94a77b71d73962d86f, user_id=5c4ff16e69b74f1f9018258137fba1f3, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:56.793933 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61c607-4aa9-4bbc-b7b5-88dde301bd61 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:56.820841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 56/104] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:40:56 2022] PUT /identity/v3/projects/660afb35216c4b94a77b71d73962d86f/users/5c4ff16e69b74f1f9018258137fba1f3/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:57.120707 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f510701-efbe-4075-96d3-b14e57052b08 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:57.121228 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f510701-efbe-4075-96d3-b14e57052b08 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:57.121228 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f510701-efbe-4075-96d3-b14e57052b08 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:57.122707 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 49/105] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:40:57.129855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff324690-75bd-4570-b7d5-cc464171db18 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:57.130509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff324690-75bd-4570-b7d5-cc464171db18 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:57.131023 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff324690-75bd-4570-b7d5-cc464171db18 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:57.132711 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 50/106] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:40:57.133398 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c2e69-373d-480a-b46a-b61d7f86ba12 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:57.134244 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c2e69-373d-480a-b46a-b61d7f86ba12 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:57.134727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c2e69-373d-480a-b46a-b61d7f86ba12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:57.138437 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc006e90-7103-4b6e-9833-4857524fdb64 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:57.139019 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc006e90-7103-4b6e-9833-4857524fdb64 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:57.139496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc006e90-7103-4b6e-9833-4857524fdb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:57.157931 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-106c2e69-373d-480a-b46a-b61d7f86ba12 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:57.159553 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-106c2e69-373d-480a-b46a-b61d7f86ba12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:57.162163 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-cc006e90-7103-4b6e-9833-4857524fdb64 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:57.163558 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cc006e90-7103-4b6e-9833-4857524fdb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:57.229395 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 57/107] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:40:57.252683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c2e69-373d-480a-b46a-b61d7f86ba12 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:57.259351 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 51/108] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:40:57.308467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc006e90-7103-4b6e-9833-4857524fdb64 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:57.355812 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c2e69-373d-480a-b46a-b61d7f86ba12 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:57.390882 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20e57a-0c4d-46c8-8ee5-1de909f76017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:57.391692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20e57a-0c4d-46c8-8ee5-1de909f76017 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:57.391980 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20e57a-0c4d-46c8-8ee5-1de909f76017 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:57.392259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20e57a-0c4d-46c8-8ee5-1de909f76017 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:57.403111 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20e57a-0c4d-46c8-8ee5-1de909f76017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:40:57.411776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ec20e57a-0c4d-46c8-8ee5-1de909f76017 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:40:57.411776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:40:57.411776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:40:57.411776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:40:57.411776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:40:57.411776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:40:57.411776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:40:57.411776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:40:57.411776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:40:57.411776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:40:57.411776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:40:57.411776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:40:57.411776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:40:57.411776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:40:57.411776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:40:57.411776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:40:57.412935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:40:57.412935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:40:57.412935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:40:57.412935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:40:57.412935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:40:57.412935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:40:57.412935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:40:57.412935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:40:57.412935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:40:57.412935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:40:57.412935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:40:57.412935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:40:57.412935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:40:57.412935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:40:57.412935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:40:57.412935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:40:57.413732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:40:57.413732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:40:57.413732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:40:57.413732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:40:57.413732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:40:57.413732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:40:57.413732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:40:57.413732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:40:57.413732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:40:57.413732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:40:57.413732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:40:57.413732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:40:57.414770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc006e90-7103-4b6e-9833-4857524fdb64 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:57.416488 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 58/109] 10.222.0.77 () {56 vars in 1114 bytes} [Wed May 11 06:40:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:40:57.417856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd3df6-234a-43c3-92d3-27a133625f7c None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:57.418348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd3df6-234a-43c3-92d3-27a133625f7c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:57.418839 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd3df6-234a-43c3-92d3-27a133625f7c None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:57.424801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 59/110] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:40:57.426595 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd3df6-234a-43c3-92d3-27a133625f7c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:57.455307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47598ec7-c5f6-45a9-b567-c47d0f76c865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:57.456368 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47598ec7-c5f6-45a9-b567-c47d0f76c865 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:57.456805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47598ec7-c5f6-45a9-b567-c47d0f76c865 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:57.457221 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47598ec7-c5f6-45a9-b567-c47d0f76c865 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:57.463757 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47598ec7-c5f6-45a9-b567-c47d0f76c865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:57.465422 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47598ec7-c5f6-45a9-b567-c47d0f76c865 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:57.467264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 52/111] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:40:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:40:57.468585 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b44e1-470a-483b-adfe-0f717fb5d574 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:57.469015 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b44e1-470a-483b-adfe-0f717fb5d574 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:57.469425 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b44e1-470a-483b-adfe-0f717fb5d574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:57.500881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c40b44e1-470a-483b-adfe-0f717fb5d574 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:57.502380 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c40b44e1-470a-483b-adfe-0f717fb5d574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:57.540437 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd3df6-234a-43c3-92d3-27a133625f7c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:57.574997 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7ffdf-70d6-4f42-b281-8592c4612338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:57.576081 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7ffdf-70d6-4f42-b281-8592c4612338 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:57.576583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7ffdf-70d6-4f42-b281-8592c4612338 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:57.577073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7ffdf-70d6-4f42-b281-8592c4612338 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:57.578061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7ffdf-70d6-4f42-b281-8592c4612338 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:57.578610 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7ffdf-70d6-4f42-b281-8592c4612338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:57.580318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7ffdf-70d6-4f42-b281-8592c4612338 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:57.588877 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 53/112] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:40:57.590058 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b44e1-470a-483b-adfe-0f717fb5d574 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:57.590180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 60/113] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:40:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:57.596164 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff04121-8e50-476f-ad28-d4ccedb04e23 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:57.596540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff04121-8e50-476f-ad28-d4ccedb04e23 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:57.596897 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff04121-8e50-476f-ad28-d4ccedb04e23 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:57.598319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 61/114] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:40:57.599147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff04121-8e50-476f-ad28-d4ccedb04e23 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:57.688964 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b44e1-470a-483b-adfe-0f717fb5d574 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:57.702088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff04121-8e50-476f-ad28-d4ccedb04e23 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:57.723073 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654bafb-1dff-4b7e-a3f0-6e135aeca232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:57.724206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654bafb-1dff-4b7e-a3f0-6e135aeca232 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:57.724704 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654bafb-1dff-4b7e-a3f0-6e135aeca232 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:57.725230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654bafb-1dff-4b7e-a3f0-6e135aeca232 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:57.726130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654bafb-1dff-4b7e-a3f0-6e135aeca232 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:57.727796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654bafb-1dff-4b7e-a3f0-6e135aeca232 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:57.735926 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf1233-8164-4c9b-9d81-7c8a93abbe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:57.737160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf1233-8164-4c9b-9d81-7c8a93abbe6e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:57.737649 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf1233-8164-4c9b-9d81-7c8a93abbe6e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:57.738124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf1233-8164-4c9b-9d81-7c8a93abbe6e None admin] PATH_INFO: `/v3/users/5c4ff16e69b74f1f9018258137fba1f3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:57.739624 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf1233-8164-4c9b-9d81-7c8a93abbe6e None admin] RBAC: Authorizing `identity:get_user(user_id=5c4ff16e69b74f1f9018258137fba1f3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:57.741372 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf1233-8164-4c9b-9d81-7c8a93abbe6e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:57.743381 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 62/115] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:40:57 2022] GET /identity/v3/users/5c4ff16e69b74f1f9018258137fba1f3 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:57.749307 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8dc95-ec01-473c-aa60-25df374a22d4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:57.749752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8dc95-ec01-473c-aa60-25df374a22d4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:57.751327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8dc95-ec01-473c-aa60-25df374a22d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:57.760508 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 54/116] 10.222.0.77 () {60 vars in 1141 bytes} [Wed May 11 06:40:57 2022] POST /identity/v3/projects => generated 302 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:57.761846 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654bafb-1dff-4b7e-a3f0-6e135aeca232 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:57.769575 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3fd8dc95-ec01-473c-aa60-25df374a22d4 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:57.770820 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3fd8dc95-ec01-473c-aa60-25df374a22d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:57.843451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 63/117] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:40:57.844346 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8dc95-ec01-473c-aa60-25df374a22d4 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:57.873133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654bafb-1dff-4b7e-a3f0-6e135aeca232 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:57.909847 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c12bea-96d1-4497-82fc-b4dbbfe861ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:57.911111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c12bea-96d1-4497-82fc-b4dbbfe861ca None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:57.911587 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c12bea-96d1-4497-82fc-b4dbbfe861ca None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:57.912063 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c12bea-96d1-4497-82fc-b4dbbfe861ca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:57.924585 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c12bea-96d1-4497-82fc-b4dbbfe861ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:40:57.933232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-f6c12bea-96d1-4497-82fc-b4dbbfe861ca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:40:57.933232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:40:57.933232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:40:57.933232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:40:57.933232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:40:57.933232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:40:57.933232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:40:57.933232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:40:57.933232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:40:57.933232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:40:57.933232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:40:57.933232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:40:57.933232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:40:57.933232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:40:57.933232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:40:57.933232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:40:57.934194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:40:57.934194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:40:57.934194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:40:57.934194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:40:57.934194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:40:57.934194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:40:57.934194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:40:57.934194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:40:57.934194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:40:57.934194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:40:57.934194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:40:57.934194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:40:57.934194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:40:57.934194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:40:57.934194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:40:57.934194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:40:57.934980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:40:57.934980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:40:57.934980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:40:57.934980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:40:57.934980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:40:57.934980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:40:57.934980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:40:57.934980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:40:57.934980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:40:57.934980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:40:57.934980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:40:57.934980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:40:57.937601 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 55/118] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:40:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:40:57.938728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c12bea-96d1-4497-82fc-b4dbbfe861ca None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:57.949090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8dc95-ec01-473c-aa60-25df374a22d4 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:57.984586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1117318-c151-4347-a373-19d74afe0e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:57.985486 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1117318-c151-4347-a373-19d74afe0e2e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:57.985776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1117318-c151-4347-a373-19d74afe0e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:57.986053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1117318-c151-4347-a373-19d74afe0e2e None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:57.987364 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1117318-c151-4347-a373-19d74afe0e2e None admin] RBAC: Authorizing `identity:get_project(project_id=660afb35216c4b94a77b71d73962d86f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:57.988855 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1117318-c151-4347-a373-19d74afe0e2e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:57.991160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 64/119] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:40:57 2022] GET /identity/v3/projects/660afb35216c4b94a77b71d73962d86f => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:57.992346 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68075026-472e-4ba7-9e26-8de166a1156c None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:57.992611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68075026-472e-4ba7-9e26-8de166a1156c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:57.992953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68075026-472e-4ba7-9e26-8de166a1156c None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:57.999193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 65/120] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:40:58.000235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68075026-472e-4ba7-9e26-8de166a1156c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:58.047501 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c12bea-96d1-4497-82fc-b4dbbfe861ca None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:58.097437 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291668d-4603-4e1b-980b-aa7191e65b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:58.098621 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291668d-4603-4e1b-980b-aa7191e65b92 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:58.099176 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291668d-4603-4e1b-980b-aa7191e65b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:58.099640 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291668d-4603-4e1b-980b-aa7191e65b92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:58.110151 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68075026-472e-4ba7-9e26-8de166a1156c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:58.111186 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291668d-4603-4e1b-980b-aa7191e65b92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:40:58.119413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-7291668d-4603-4e1b-980b-aa7191e65b92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:40:58.119413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:40:58.119413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:40:58.119413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:40:58.119413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:40:58.119413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:40:58.119413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:40:58.119413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:40:58.119413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:40:58.119413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:40:58.119413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:40:58.119413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:40:58.119413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:40:58.119413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:40:58.119413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:40:58.119413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:40:58.120272 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:40:58.120272 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:40:58.120272 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:40:58.120272 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:40:58.120272 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:40:58.120272 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:40:58.120272 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:40:58.120272 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:40:58.120272 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:40:58.120272 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:40:58.120272 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:40:58.120272 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:40:58.120272 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:40:58.120272 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:40:58.120272 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:40:58.120272 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:40:58.121570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:40:58.121570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:40:58.121570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:40:58.121570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:40:58.121570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:40:58.121570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:40:58.121570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:40:58.121570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:40:58.121570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:40:58.121570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:40:58.121570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:40:58.121570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:40:58.123956 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 56/121] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:40:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:40:58.125096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291668d-4603-4e1b-980b-aa7191e65b92 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:58.152782 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d2eb8-6716-4fa5-ae0b-bac13ac730b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:58.153583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d2eb8-6716-4fa5-ae0b-bac13ac730b2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:58.153869 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d2eb8-6716-4fa5-ae0b-bac13ac730b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:58.154150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d2eb8-6716-4fa5-ae0b-bac13ac730b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:58.155270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d2eb8-6716-4fa5-ae0b-bac13ac730b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:58.155586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d2eb8-6716-4fa5-ae0b-bac13ac730b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:58.157443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d2eb8-6716-4fa5-ae0b-bac13ac730b2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:58.167952 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 66/122] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:40:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:58.169257 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56aa1d-89c5-44ed-8252-a7f215d5a4ee None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:58.169553 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56aa1d-89c5-44ed-8252-a7f215d5a4ee None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:58.169835 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56aa1d-89c5-44ed-8252-a7f215d5a4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:58.189481 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ca56aa1d-89c5-44ed-8252-a7f215d5a4ee None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:58.190949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ca56aa1d-89c5-44ed-8252-a7f215d5a4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:58.243605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291668d-4603-4e1b-980b-aa7191e65b92 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:58.258283 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 67/123] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:40:58.258949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56aa1d-89c5-44ed-8252-a7f215d5a4ee None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:58.278091 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c46dd-ac17-42dc-8c50-c1ac4305cfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:58.279357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c46dd-ac17-42dc-8c50-c1ac4305cfe9 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:58.279833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c46dd-ac17-42dc-8c50-c1ac4305cfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:58.280308 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c46dd-ac17-42dc-8c50-c1ac4305cfe9 None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f/users/5c4ff16e69b74f1f9018258137fba1f3/roles/ae6b211774c34f47a3ac4853538f62ad` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:58.285004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c46dd-ac17-42dc-8c50-c1ac4305cfe9 None admin] RBAC: Authorizing `identity:create_grant(project_id=660afb35216c4b94a77b71d73962d86f, user_id=5c4ff16e69b74f1f9018258137fba1f3, role_id=ae6b211774c34f47a3ac4853538f62ad)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:58.286710 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c46dd-ac17-42dc-8c50-c1ac4305cfe9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:58.313219 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 57/124] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:40:58 2022] PUT /identity/v3/projects/660afb35216c4b94a77b71d73962d86f/users/5c4ff16e69b74f1f9018258137fba1f3/roles/ae6b211774c34f47a3ac4853538f62ad => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:58.314892 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c46dd-ac17-42dc-8c50-c1ac4305cfe9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:58.438041 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c46dd-ac17-42dc-8c50-c1ac4305cfe9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:58.451658 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56aa1d-89c5-44ed-8252-a7f215d5a4ee None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:58.476950 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed378e5-903e-4d21-924e-26efc6316dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:58.477882 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed378e5-903e-4d21-924e-26efc6316dfb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:58.478174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed378e5-903e-4d21-924e-26efc6316dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:58.478455 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed378e5-903e-4d21-924e-26efc6316dfb None admin] PATH_INFO: `/v3/users/af9e993a8c764478b2c21fdf0af49569` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:58.521140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed378e5-903e-4d21-924e-26efc6316dfb None admin] RBAC: Authorizing `identity:get_user(user_id=af9e993a8c764478b2c21fdf0af49569)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:58.522661 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed378e5-903e-4d21-924e-26efc6316dfb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:58.524752 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 58/125] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:40:58 2022] GET /identity/v3/users/af9e993a8c764478b2c21fdf0af49569 => generated 289 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:58.525344 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed378e5-903e-4d21-924e-26efc6316dfb None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:58.535060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f5da1-5156-4687-b0f0-e0d3c345d6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:58.536023 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f5da1-5156-4687-b0f0-e0d3c345d6ea None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:58.536153 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f5da1-5156-4687-b0f0-e0d3c345d6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:58.536414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f5da1-5156-4687-b0f0-e0d3c345d6ea None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:58.537195 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f5da1-5156-4687-b0f0-e0d3c345d6ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:58.537546 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f5da1-5156-4687-b0f0-e0d3c345d6ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:58.538989 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f5da1-5156-4687-b0f0-e0d3c345d6ea None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:58.562931 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 68/126] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:40:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:58.563853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f5da1-5156-4687-b0f0-e0d3c345d6ea None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:58.688865 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f5da1-5156-4687-b0f0-e0d3c345d6ea None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:58.725660 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907190df-dd79-43e0-9f3f-1d8efe662bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:58.726340 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907190df-dd79-43e0-9f3f-1d8efe662bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:58.726625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907190df-dd79-43e0-9f3f-1d8efe662bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:58.730994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907190df-dd79-43e0-9f3f-1d8efe662bf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:58.733440 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed378e5-903e-4d21-924e-26efc6316dfb None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:58.783817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da795f-5dd3-47f2-915e-c8a5dc75ac85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:58.785057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da795f-5dd3-47f2-915e-c8a5dc75ac85 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:58.785571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da795f-5dd3-47f2-915e-c8a5dc75ac85 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:58.786084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da795f-5dd3-47f2-915e-c8a5dc75ac85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:58.802227 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da795f-5dd3-47f2-915e-c8a5dc75ac85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:40:58.813543 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907190df-dd79-43e0-9f3f-1d8efe662bf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:58.813543 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907190df-dd79-43e0-9f3f-1d8efe662bf0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:58.817779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-f7da795f-5dd3-47f2-915e-c8a5dc75ac85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:40:58.817779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:40:58.817779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:40:58.817779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:40:58.817779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:40:58.817779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:40:58.817779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:40:58.817779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:40:58.817779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:40:58.817779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:40:58.817779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:40:58.817779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:40:58.817779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:40:58.817779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:40:58.817779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:40:58.817779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:40:58.818683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:40:58.818683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:40:58.818683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:40:58.818683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:40:58.818683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:40:58.818683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:40:58.818683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:40:58.818683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:40:58.818683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:40:58.818683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:40:58.818683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:40:58.818683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:40:58.818683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:40:58.818683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:40:58.818683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:40:58.818683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:40:58.819531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:40:58.819531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:40:58.819531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:40:58.819531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:40:58.819531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:40:58.819531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:40:58.819531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:40:58.819531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:40:58.819531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:40:58.819531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:40:58.819531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:40:58.819531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:40:58.822278 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 59/127] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:40:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:40:58.823311 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da795f-5dd3-47f2-915e-c8a5dc75ac85 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:58.921220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da795f-5dd3-47f2-915e-c8a5dc75ac85 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:58.937570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 69/128] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:40:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:40:58.938742 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907190df-dd79-43e0-9f3f-1d8efe662bf0 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:58.962597 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44a82b-c154-44a5-b395-6a4beeaedc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:58.964111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44a82b-c154-44a5-b395-6a4beeaedc3f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:58.964594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44a82b-c154-44a5-b395-6a4beeaedc3f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:58.965086 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44a82b-c154-44a5-b395-6a4beeaedc3f None admin] PATH_INFO: `/v3/users/7a9fbdd0a78349c9b11108cb751273ee` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:58.969499 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44a82b-c154-44a5-b395-6a4beeaedc3f None admin] RBAC: Authorizing `identity:get_user(user_id=7a9fbdd0a78349c9b11108cb751273ee)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:58.971238 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44a82b-c154-44a5-b395-6a4beeaedc3f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:58.973528 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 60/129] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:40:58 2022] GET /identity/v3/users/7a9fbdd0a78349c9b11108cb751273ee => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:58.974493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44a82b-c154-44a5-b395-6a4beeaedc3f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:59.044564 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907190df-dd79-43e0-9f3f-1d8efe662bf0 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:59.077606 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e21a8e-a723-4ef7-8508-7fe852f999d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:59.078297 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e21a8e-a723-4ef7-8508-7fe852f999d5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:59.078573 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e21a8e-a723-4ef7-8508-7fe852f999d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:59.078848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e21a8e-a723-4ef7-8508-7fe852f999d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:59.079641 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e21a8e-a723-4ef7-8508-7fe852f999d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:59.079949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e21a8e-a723-4ef7-8508-7fe852f999d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:59.081342 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e21a8e-a723-4ef7-8508-7fe852f999d5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:59.090452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 70/130] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:40:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:59.091268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e21a8e-a723-4ef7-8508-7fe852f999d5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:59.108867 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44a82b-c154-44a5-b395-6a4beeaedc3f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:59.151784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a96718-d43d-4fc9-bb40-56fb4380502e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:59.153541 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a96718-d43d-4fc9-bb40-56fb4380502e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:59.154042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a96718-d43d-4fc9-bb40-56fb4380502e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:59.154515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a96718-d43d-4fc9-bb40-56fb4380502e None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:59.156225 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a96718-d43d-4fc9-bb40-56fb4380502e None admin] RBAC: Authorizing `identity:get_project(project_id=660afb35216c4b94a77b71d73962d86f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:59.158106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a96718-d43d-4fc9-bb40-56fb4380502e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:59.160635 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 61/131] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:40:58 2022] GET /identity/v3/projects/660afb35216c4b94a77b71d73962d86f => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:59.161816 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a96718-d43d-4fc9-bb40-56fb4380502e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:59.203128 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e21a8e-a723-4ef7-8508-7fe852f999d5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:59.231335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca18ad7-5500-4db8-9fa2-b6b5bf2d2673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:59.232218 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca18ad7-5500-4db8-9fa2-b6b5bf2d2673 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:59.232511 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca18ad7-5500-4db8-9fa2-b6b5bf2d2673 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:59.232779 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca18ad7-5500-4db8-9fa2-b6b5bf2d2673 None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:59.233984 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca18ad7-5500-4db8-9fa2-b6b5bf2d2673 None admin] RBAC: Authorizing `identity:get_project(project_id=660afb35216c4b94a77b71d73962d86f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:59.235483 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca18ad7-5500-4db8-9fa2-b6b5bf2d2673 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:59.237199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 71/132] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:40:59 2022] GET /identity/v3/projects/660afb35216c4b94a77b71d73962d86f => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:59.243119 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca18ad7-5500-4db8-9fa2-b6b5bf2d2673 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:59.348402 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a96718-d43d-4fc9-bb40-56fb4380502e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:59.382144 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca18ad7-5500-4db8-9fa2-b6b5bf2d2673 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:59.414773 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b26ef-9e2f-4ee9-8568-18bee01f7015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:59.415472 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b26ef-9e2f-4ee9-8568-18bee01f7015 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:59.415758 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b26ef-9e2f-4ee9-8568-18bee01f7015 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:59.416046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b26ef-9e2f-4ee9-8568-18bee01f7015 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:59.416874 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b26ef-9e2f-4ee9-8568-18bee01f7015 None admin] RBAC: Adding query filter params (role.id=62544860c24f461a83620d4401a9ca0a, scope.project.id=660afb35216c4b94a77b71d73962d86f, user.id=af9e993a8c764478b2c21fdf0af49569) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:59.417185 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b26ef-9e2f-4ee9-8568-18bee01f7015 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:59.418627 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b26ef-9e2f-4ee9-8568-18bee01f7015 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:59.424098 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 72/133] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:40:59 2022] GET /identity/v3/role_assignments?user.id=af9e993a8c764478b2c21fdf0af49569&scope.project.id=660afb35216c4b94a77b71d73962d86f&role.id=62544860c24f461a83620d4401a9ca0a => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:59.424935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b26ef-9e2f-4ee9-8568-18bee01f7015 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:59.427837 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133459b-8e29-41cc-ad5e-36cdd2db4b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:59.428844 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133459b-8e29-41cc-ad5e-36cdd2db4b9f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:59.429126 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133459b-8e29-41cc-ad5e-36cdd2db4b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:59.429399 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133459b-8e29-41cc-ad5e-36cdd2db4b9f None admin] PATH_INFO: `/v3/users/5c4ff16e69b74f1f9018258137fba1f3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:59.435909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133459b-8e29-41cc-ad5e-36cdd2db4b9f None admin] RBAC: Authorizing `identity:get_user(user_id=5c4ff16e69b74f1f9018258137fba1f3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:59.437419 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133459b-8e29-41cc-ad5e-36cdd2db4b9f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:59.439530 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 62/134] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:40:59 2022] GET /identity/v3/users/5c4ff16e69b74f1f9018258137fba1f3 => generated 275 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:59.448281 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133459b-8e29-41cc-ad5e-36cdd2db4b9f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:59.541349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b26ef-9e2f-4ee9-8568-18bee01f7015 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:59.601455 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7784e-2c57-4048-a9cb-7129138dbd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:59.602305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7784e-2c57-4048-a9cb-7129138dbd26 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:59.602591 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7784e-2c57-4048-a9cb-7129138dbd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:59.602877 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7784e-2c57-4048-a9cb-7129138dbd26 None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f/users/7a9fbdd0a78349c9b11108cb751273ee/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:59.608658 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7784e-2c57-4048-a9cb-7129138dbd26 None admin] RBAC: Authorizing `identity:create_grant(project_id=660afb35216c4b94a77b71d73962d86f, user_id=7a9fbdd0a78349c9b11108cb751273ee, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:59.610157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7784e-2c57-4048-a9cb-7129138dbd26 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:59.650172 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 73/135] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:40:59 2022] PUT /identity/v3/projects/660afb35216c4b94a77b71d73962d86f/users/7a9fbdd0a78349c9b11108cb751273ee/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:59.702892 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133459b-8e29-41cc-ad5e-36cdd2db4b9f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:59.748753 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec9667-f97d-42b0-a299-8a88fcbee6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:59.749649 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec9667-f97d-42b0-a299-8a88fcbee6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:59.749927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec9667-f97d-42b0-a299-8a88fcbee6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:59.750196 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec9667-f97d-42b0-a299-8a88fcbee6b4 None admin] PATH_INFO: `/v3/projects/4985bb9f8e3546c5a46f84a872734222` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:59.751507 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec9667-f97d-42b0-a299-8a88fcbee6b4 None admin] RBAC: Authorizing `identity:get_project(project_id=4985bb9f8e3546c5a46f84a872734222)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:59.753007 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec9667-f97d-42b0-a299-8a88fcbee6b4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:59.755001 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 63/136] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:40:59 2022] GET /identity/v3/projects/4985bb9f8e3546c5a46f84a872734222 => generated 312 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:59.760888 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7784e-2c57-4048-a9cb-7129138dbd26 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:59.842642 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790f8cd-de76-465b-a755-f7fe33359cc7 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:59.842990 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790f8cd-de76-465b-a755-f7fe33359cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:59.843247 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790f8cd-de76-465b-a755-f7fe33359cc7 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:59.845851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 64/137] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:40:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:40:59.853394 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd30b4-a4ae-4173-8043-ab3c7c7acb07 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:59.853674 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd30b4-a4ae-4173-8043-ab3c7c7acb07 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:59.854207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd30b4-a4ae-4173-8043-ab3c7c7acb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:59.876697 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7ecd30b4-a4ae-4173-8043-ab3c7c7acb07 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:59.877958 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7ecd30b4-a4ae-4173-8043-ab3c7c7acb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:59.993021 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 65/138] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:40:59.995569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7784e-2c57-4048-a9cb-7129138dbd26 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:00.017529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd30b4-a4ae-4173-8043-ab3c7c7acb07 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:00.040355 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13320b-9415-4820-a6f2-214674a7c93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:00.041279 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13320b-9415-4820-a6f2-214674a7c93e None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:00.041653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13320b-9415-4820-a6f2-214674a7c93e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:00.041836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13320b-9415-4820-a6f2-214674a7c93e None admin] PATH_INFO: `/v3/projects/4985bb9f8e3546c5a46f84a872734222/users/5c4ff16e69b74f1f9018258137fba1f3/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:00.043897 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13320b-9415-4820-a6f2-214674a7c93e None admin] RBAC: Authorizing `identity:create_grant(project_id=4985bb9f8e3546c5a46f84a872734222, user_id=5c4ff16e69b74f1f9018258137fba1f3, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:00.045383 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13320b-9415-4820-a6f2-214674a7c93e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:00.066258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 74/139] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:40:59 2022] PUT /identity/v3/projects/4985bb9f8e3546c5a46f84a872734222/users/5c4ff16e69b74f1f9018258137fba1f3/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:00.141580 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd30b4-a4ae-4173-8043-ab3c7c7acb07 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:00.177491 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17a4a2-5225-4444-b4f7-0f291a8bc0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:00.178367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17a4a2-5225-4444-b4f7-0f291a8bc0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:00.178651 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17a4a2-5225-4444-b4f7-0f291a8bc0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:00.178932 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17a4a2-5225-4444-b4f7-0f291a8bc0a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:00.190032 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17a4a2-5225-4444-b4f7-0f291a8bc0a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:00.198357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-3e17a4a2-5225-4444-b4f7-0f291a8bc0a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:00.198357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:00.198357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:00.198357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:00.198357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:00.198357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:00.198357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:00.198357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:00.198357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:00.198357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:00.198357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:00.198357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:00.198357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:00.198357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:00.198357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:00.198357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:00.199328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:00.199328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:00.199328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:00.199328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:00.199328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:00.199328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:00.199328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:00.199328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:00.199328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:00.199328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:00.199328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:00.199328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:00.199328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:00.199328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:00.199328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:00.199328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:00.200083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:00.200083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:00.200083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:00.200083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:00.200083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:00.200083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:00.200083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:00.200083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:00.200083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:00.200083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:00.200083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:00.200083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:00.200083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 66/140] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:41:00.205958 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13320b-9415-4820-a6f2-214674a7c93e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:00.314986 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13320b-9415-4820-a6f2-214674a7c93e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:00.351994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc86656-fdd6-4f8c-bbd4-35b449b7a308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:00.352681 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc86656-fdd6-4f8c-bbd4-35b449b7a308 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:00.352965 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc86656-fdd6-4f8c-bbd4-35b449b7a308 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:00.353249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc86656-fdd6-4f8c-bbd4-35b449b7a308 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:00.354018 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc86656-fdd6-4f8c-bbd4-35b449b7a308 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:00.354330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc86656-fdd6-4f8c-bbd4-35b449b7a308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:00.355771 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc86656-fdd6-4f8c-bbd4-35b449b7a308 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:00.364769 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 75/141] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:41:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:00.370506 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17a4a2-5225-4444-b4f7-0f291a8bc0a6 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:00.477618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17a4a2-5225-4444-b4f7-0f291a8bc0a6 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:00.513220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c7757-3e9e-48a2-8d29-0a35ae3fc216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:00.514124 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c7757-3e9e-48a2-8d29-0a35ae3fc216 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:00.514404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c7757-3e9e-48a2-8d29-0a35ae3fc216 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:00.514680 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c7757-3e9e-48a2-8d29-0a35ae3fc216 None admin] PATH_INFO: `/v3/users/5c4ff16e69b74f1f9018258137fba1f3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:00.515935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c7757-3e9e-48a2-8d29-0a35ae3fc216 None admin] RBAC: Authorizing `identity:get_user(user_id=5c4ff16e69b74f1f9018258137fba1f3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:00.517411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c7757-3e9e-48a2-8d29-0a35ae3fc216 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:00.519415 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 67/142] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:00 2022] GET /identity/v3/users/5c4ff16e69b74f1f9018258137fba1f3 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:00.524933 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc86656-fdd6-4f8c-bbd4-35b449b7a308 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:00.626059 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc86656-fdd6-4f8c-bbd4-35b449b7a308 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:00.659650 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2061d-bcc2-46ce-ae13-79e461d9c8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:00.660325 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2061d-bcc2-46ce-ae13-79e461d9c8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:00.660610 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2061d-bcc2-46ce-ae13-79e461d9c8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:00.660887 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2061d-bcc2-46ce-ae13-79e461d9c8b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:00.728194 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2061d-bcc2-46ce-ae13-79e461d9c8b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:00.729600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2061d-bcc2-46ce-ae13-79e461d9c8b3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:00.733206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa74d3-22b4-4d43-924d-9b7f1b2e6080 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:00.733495 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa74d3-22b4-4d43-924d-9b7f1b2e6080 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:00.733774 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa74d3-22b4-4d43-924d-9b7f1b2e6080 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:00.735165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 68/143] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:41:00.740367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afc406-9eef-4179-9455-e2d7246cc76a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:00.740730 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afc406-9eef-4179-9455-e2d7246cc76a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:00.741011 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afc406-9eef-4179-9455-e2d7246cc76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:00.760434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c2afc406-9eef-4179-9455-e2d7246cc76a None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:00.761658 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c2afc406-9eef-4179-9455-e2d7246cc76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:00.836740 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 69/144] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:00.887883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afc406-9eef-4179-9455-e2d7246cc76a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:00.892577 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 76/145] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:41:00.901516 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2061d-bcc2-46ce-ae13-79e461d9c8b3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:00.991677 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afc406-9eef-4179-9455-e2d7246cc76a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:01.007608 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2061d-bcc2-46ce-ae13-79e461d9c8b3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:01.026703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805897ed-b2b4-4616-85dc-7e9d9a4705f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:01.027522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805897ed-b2b4-4616-85dc-7e9d9a4705f3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:01.027903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805897ed-b2b4-4616-85dc-7e9d9a4705f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:01.028277 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805897ed-b2b4-4616-85dc-7e9d9a4705f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:01.029631 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805897ed-b2b4-4616-85dc-7e9d9a4705f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:01.031229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805897ed-b2b4-4616-85dc-7e9d9a4705f3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:01.033297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 70/146] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:01.040100 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805897ed-b2b4-4616-85dc-7e9d9a4705f3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:01.056659 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71709392-80b0-4b95-a938-a56de33265a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:01.058091 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71709392-80b0-4b95-a938-a56de33265a8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:01.058527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71709392-80b0-4b95-a938-a56de33265a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:01.058931 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71709392-80b0-4b95-a938-a56de33265a8 None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:01.060610 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71709392-80b0-4b95-a938-a56de33265a8 None admin] RBAC: Authorizing `identity:get_project(project_id=660afb35216c4b94a77b71d73962d86f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:01.062823 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71709392-80b0-4b95-a938-a56de33265a8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:01.065795 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 77/147] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:00 2022] GET /identity/v3/projects/660afb35216c4b94a77b71d73962d86f => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:01.075078 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71709392-80b0-4b95-a938-a56de33265a8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:01.151379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805897ed-b2b4-4616-85dc-7e9d9a4705f3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:01.184840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b4751-c097-4ea2-8d92-68f3aaac1338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:01.185522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b4751-c097-4ea2-8d92-68f3aaac1338 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:01.185805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b4751-c097-4ea2-8d92-68f3aaac1338 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:01.186078 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b4751-c097-4ea2-8d92-68f3aaac1338 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:01.190983 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b4751-c097-4ea2-8d92-68f3aaac1338 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:01.190983 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b4751-c097-4ea2-8d92-68f3aaac1338 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:01.220919 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 71/148] 10.222.0.77 () {60 vars in 1132 bytes} [Wed May 11 06:41:01 2022] POST /identity/v3/users => generated 283 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:41:01.270574 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71709392-80b0-4b95-a938-a56de33265a8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:01.317017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf2883-92e4-4d5c-939a-7118ababfb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:01.317720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf2883-92e4-4d5c-939a-7118ababfb47 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:01.318008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf2883-92e4-4d5c-939a-7118ababfb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:01.318293 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf2883-92e4-4d5c-939a-7118ababfb47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:01.319255 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf2883-92e4-4d5c-939a-7118ababfb47 None admin] RBAC: Adding query filter params (role.id=f8d42be71f034e1a88784699c04e7a89, scope.project.id=660afb35216c4b94a77b71d73962d86f, user.id=5c4ff16e69b74f1f9018258137fba1f3) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:01.319615 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf2883-92e4-4d5c-939a-7118ababfb47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:01.321101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf2883-92e4-4d5c-939a-7118ababfb47 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:01.328086 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 78/149] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:41:01 2022] GET /identity/v3/role_assignments?user.id=5c4ff16e69b74f1f9018258137fba1f3&scope.project.id=660afb35216c4b94a77b71d73962d86f&role.id=f8d42be71f034e1a88784699c04e7a89 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:01.626123 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf30c2-3812-4ce9-bf49-1b80bd8a4f65 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:01.626469 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf30c2-3812-4ce9-bf49-1b80bd8a4f65 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:01.626579 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf30c2-3812-4ce9-bf49-1b80bd8a4f65 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:01.628194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 72/150] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:01.634115 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6db412-74f7-4f25-aa10-fb585f9048c9 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:01.634424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6db412-74f7-4f25-aa10-fb585f9048c9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:01.634686 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6db412-74f7-4f25-aa10-fb585f9048c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:01.655977 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6a6db412-74f7-4f25-aa10-fb585f9048c9 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:01.657586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6a6db412-74f7-4f25-aa10-fb585f9048c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:01.734888 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 79/151] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:01.758916 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf30c2-3812-4ce9-bf49-1b80bd8a4f65 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:01.876434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf30c2-3812-4ce9-bf49-1b80bd8a4f65 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:01.917112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6d3c1-db52-4871-a343-afef147f206a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:01.917989 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6d3c1-db52-4871-a343-afef147f206a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:01.918274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6d3c1-db52-4871-a343-afef147f206a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:01.918557 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6d3c1-db52-4871-a343-afef147f206a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:01.930112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6d3c1-db52-4871-a343-afef147f206a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:01.938904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-e6a6d3c1-db52-4871-a343-afef147f206a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:41:01.938904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:01.938904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:01.938904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:01.938904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:01.938904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:01.938904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:01.938904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:01.938904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:01.938904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:01.938904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:01.938904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:01.938904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:01.938904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:01.938904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:01.938904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:01.939971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:01.939971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:01.939971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:01.939971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:01.939971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:01.939971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:01.939971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:01.939971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:01.939971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:01.939971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:01.939971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:01.939971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:01.939971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:01.939971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:01.939971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:01.939971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:01.940741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:01.940741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:01.940741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:01.940741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:01.940741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:01.940741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:01.940741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:01.940741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:01.940741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:01.940741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:01.940741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:41:01.940741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:01.943480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 73/152] 10.222.0.77 () {56 vars in 1114 bytes} [Wed May 11 06:41:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:01.952096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6db412-74f7-4f25-aa10-fb585f9048c9 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:02.086263 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6db412-74f7-4f25-aa10-fb585f9048c9 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:02.128826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aea203-b21a-4d15-b0d5-5275f429adb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:02.129432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aea203-b21a-4d15-b0d5-5275f429adb5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:02.129712 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aea203-b21a-4d15-b0d5-5275f429adb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:02.129987 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aea203-b21a-4d15-b0d5-5275f429adb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:02.130759 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aea203-b21a-4d15-b0d5-5275f429adb5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:02.131192 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aea203-b21a-4d15-b0d5-5275f429adb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:02.132605 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aea203-b21a-4d15-b0d5-5275f429adb5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:02.141668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 80/153] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:41:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:02.148148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6d3c1-db52-4871-a343-afef147f206a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:02.278161 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6d3c1-db52-4871-a343-afef147f206a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:02.316471 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e6e45-c632-47d3-9c58-487bf4e8f068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:02.317369 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e6e45-c632-47d3-9c58-487bf4e8f068 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:02.317651 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e6e45-c632-47d3-9c58-487bf4e8f068 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:02.317929 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e6e45-c632-47d3-9c58-487bf4e8f068 None admin] PATH_INFO: `/v3/users/5c4ff16e69b74f1f9018258137fba1f3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:02.319986 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e6e45-c632-47d3-9c58-487bf4e8f068 None admin] RBAC: Authorizing `identity:get_user(user_id=5c4ff16e69b74f1f9018258137fba1f3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:02.321506 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e6e45-c632-47d3-9c58-487bf4e8f068 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:02.323881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 74/154] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:02 2022] GET /identity/v3/users/5c4ff16e69b74f1f9018258137fba1f3 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:02.329322 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aea203-b21a-4d15-b0d5-5275f429adb5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:02.371497 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d2925-6c15-4c66-bc0c-a5e515550430 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:02.371801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d2925-6c15-4c66-bc0c-a5e515550430 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:02.372057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d2925-6c15-4c66-bc0c-a5e515550430 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:02.373622 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 75/155] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:02.381234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa47a25-d82f-4dfb-9c58-5ddd8839d8c2 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:02.381459 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa47a25-d82f-4dfb-9c58-5ddd8839d8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:02.381725 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa47a25-d82f-4dfb-9c58-5ddd8839d8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:02.405577 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9fa47a25-d82f-4dfb-9c58-5ddd8839d8c2 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:02.406793 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9fa47a25-d82f-4dfb-9c58-5ddd8839d8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:02.440334 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aea203-b21a-4d15-b0d5-5275f429adb5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:02.475828 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 76/156] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:41:02.485439 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acf241-c74f-41aa-b54f-ee63aa35657c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:02.486132 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acf241-c74f-41aa-b54f-ee63aa35657c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:02.486407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acf241-c74f-41aa-b54f-ee63aa35657c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:02.486788 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acf241-c74f-41aa-b54f-ee63aa35657c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:02.561598 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acf241-c74f-41aa-b54f-ee63aa35657c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:02.563118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acf241-c74f-41aa-b54f-ee63aa35657c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:02.568264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa47a25-d82f-4dfb-9c58-5ddd8839d8c2 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:02.703074 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 81/157] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:41:02.710550 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acf241-c74f-41aa-b54f-ee63aa35657c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:02.767580 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa47a25-d82f-4dfb-9c58-5ddd8839d8c2 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:02.834821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42957a77-f052-4ffe-9419-46f5c6c24961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:02.835815 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42957a77-f052-4ffe-9419-46f5c6c24961 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:02.836103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42957a77-f052-4ffe-9419-46f5c6c24961 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:02.836372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42957a77-f052-4ffe-9419-46f5c6c24961 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:02.857561 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42957a77-f052-4ffe-9419-46f5c6c24961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:02.866242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-42957a77-f052-4ffe-9419-46f5c6c24961 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:41:02.866242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:02.866242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:02.866242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:02.866242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:02.866242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:02.866242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:02.866242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:02.866242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:02.866242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:02.866242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:02.866242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:02.866242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:02.866242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:02.866242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:02.866242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:02.867214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:02.867214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:02.867214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:02.867214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:02.867214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:02.867214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:02.867214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:02.867214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:02.867214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:02.867214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:02.867214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:02.867214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:02.867214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:02.867214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:02.867214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:02.867214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:02.867974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:02.867974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:02.867974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:02.867974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:02.867974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:02.867974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:02.867974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:02.867974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:02.867974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:02.867974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:02.867974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:41:02.867974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:02.867974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 77/158] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:41:02.873978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42957a77-f052-4ffe-9419-46f5c6c24961 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:02.888919 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acf241-c74f-41aa-b54f-ee63aa35657c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:02.963785 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdf0b6-bdfd-4872-ac38-2d27c1e5f60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:02.965072 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdf0b6-bdfd-4872-ac38-2d27c1e5f60a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:02.965566 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdf0b6-bdfd-4872-ac38-2d27c1e5f60a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:02.966032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdf0b6-bdfd-4872-ac38-2d27c1e5f60a None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:02.967489 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdf0b6-bdfd-4872-ac38-2d27c1e5f60a None admin] RBAC: Authorizing `identity:get_project(project_id=660afb35216c4b94a77b71d73962d86f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:02.969172 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdf0b6-bdfd-4872-ac38-2d27c1e5f60a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:02.971143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 82/159] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:02 2022] GET /identity/v3/projects/660afb35216c4b94a77b71d73962d86f => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:02.986034 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdf0b6-bdfd-4872-ac38-2d27c1e5f60a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:03.070701 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42957a77-f052-4ffe-9419-46f5c6c24961 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:03.142017 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84367c3b-8b1a-476c-9013-38a6c872d135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:03.142718 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84367c3b-8b1a-476c-9013-38a6c872d135 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:03.143020 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84367c3b-8b1a-476c-9013-38a6c872d135 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:03.143297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84367c3b-8b1a-476c-9013-38a6c872d135 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:03.144226 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84367c3b-8b1a-476c-9013-38a6c872d135 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:03.144429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84367c3b-8b1a-476c-9013-38a6c872d135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:03.145830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84367c3b-8b1a-476c-9013-38a6c872d135 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:03.165653 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 78/160] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:41:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:03.167028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4d437-6c05-49d8-bb62-1f2e7881c084 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:03.167317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4d437-6c05-49d8-bb62-1f2e7881c084 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:03.167591 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4d437-6c05-49d8-bb62-1f2e7881c084 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:03.168946 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 79/161] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:03.180466 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4d437-6c05-49d8-bb62-1f2e7881c084 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:03.203939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdf0b6-bdfd-4872-ac38-2d27c1e5f60a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:03.267704 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f7182-bc3a-4156-b293-17c2eb8a3d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:03.268301 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f7182-bc3a-4156-b293-17c2eb8a3d53 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:03.268581 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f7182-bc3a-4156-b293-17c2eb8a3d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:03.268853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f7182-bc3a-4156-b293-17c2eb8a3d53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:03.269707 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f7182-bc3a-4156-b293-17c2eb8a3d53 None admin] RBAC: Adding query filter params (role.id=ae6b211774c34f47a3ac4853538f62ad, scope.project.id=660afb35216c4b94a77b71d73962d86f, user.id=5c4ff16e69b74f1f9018258137fba1f3) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:03.270022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f7182-bc3a-4156-b293-17c2eb8a3d53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:03.271609 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f7182-bc3a-4156-b293-17c2eb8a3d53 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:03.278387 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 83/162] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:41:02 2022] GET /identity/v3/role_assignments?user.id=5c4ff16e69b74f1f9018258137fba1f3&scope.project.id=660afb35216c4b94a77b71d73962d86f&role.id=ae6b211774c34f47a3ac4853538f62ad => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:03.279695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5665cd2-1296-487e-980a-18faa836ea70 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:03.279963 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5665cd2-1296-487e-980a-18faa836ea70 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:03.280239 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5665cd2-1296-487e-980a-18faa836ea70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:03.319203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f5665cd2-1296-487e-980a-18faa836ea70 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:03.320463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f5665cd2-1296-487e-980a-18faa836ea70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:03.334785 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4d437-6c05-49d8-bb62-1f2e7881c084 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:03.369222 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a895c4-4a6b-4336-9372-582634e36c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:03.370171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a895c4-4a6b-4336-9372-582634e36c86 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:03.370451 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a895c4-4a6b-4336-9372-582634e36c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:03.370721 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a895c4-4a6b-4336-9372-582634e36c86 None admin] PATH_INFO: `/v3/users/af9e993a8c764478b2c21fdf0af49569` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:03.371986 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a895c4-4a6b-4336-9372-582634e36c86 None admin] RBAC: Authorizing `identity:get_user(user_id=af9e993a8c764478b2c21fdf0af49569)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:03.373446 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a895c4-4a6b-4336-9372-582634e36c86 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:03.375437 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 80/163] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:03 2022] GET /identity/v3/users/af9e993a8c764478b2c21fdf0af49569 => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:03.384882 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a895c4-4a6b-4336-9372-582634e36c86 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:03.513243 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 84/164] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:03.514784 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d405d3d-ad76-4c62-83f9-2a0b1928a9cc None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:03.515099 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d405d3d-ad76-4c62-83f9-2a0b1928a9cc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:03.515377 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d405d3d-ad76-4c62-83f9-2a0b1928a9cc None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:03.516957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 85/165] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:03.521953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455f50a-b65d-4687-8274-31a7e0eff9d4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:03.522132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a895c4-4a6b-4336-9372-582634e36c86 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:03.522284 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455f50a-b65d-4687-8274-31a7e0eff9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:03.522426 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455f50a-b65d-4687-8274-31a7e0eff9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:03.551390 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c455f50a-b65d-4687-8274-31a7e0eff9d4 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:03.552594 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c455f50a-b65d-4687-8274-31a7e0eff9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:03.569092 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e69353-454c-4245-ade0-641c4dcfe586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:03.570100 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e69353-454c-4245-ade0-641c4dcfe586 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:03.570384 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e69353-454c-4245-ade0-641c4dcfe586 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:03.570709 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e69353-454c-4245-ade0-641c4dcfe586 None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:03.576070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e69353-454c-4245-ade0-641c4dcfe586 None admin] RBAC: Authorizing `identity:get_project(project_id=660afb35216c4b94a77b71d73962d86f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:03.579028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e69353-454c-4245-ade0-641c4dcfe586 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:03.582857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 81/166] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:03 2022] GET /identity/v3/projects/660afb35216c4b94a77b71d73962d86f => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:03.585286 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e69353-454c-4245-ade0-641c4dcfe586 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:03.694669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 86/167] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 11 06:41:03.703243 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455f50a-b65d-4687-8274-31a7e0eff9d4 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:03.729549 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e69353-454c-4245-ade0-641c4dcfe586 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:03.772699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6b5cb-c62e-480b-a3de-54f31c79cac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:03.773447 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6b5cb-c62e-480b-a3de-54f31c79cac2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:03.773725 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6b5cb-c62e-480b-a3de-54f31c79cac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:03.773995 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6b5cb-c62e-480b-a3de-54f31c79cac2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:03.787810 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6b5cb-c62e-480b-a3de-54f31c79cac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:03.796102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-81b6b5cb-c62e-480b-a3de-54f31c79cac2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:41:03.796102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:03.796102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:03.796102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:03.796102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:03.796102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:03.796102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:03.796102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:03.796102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:03.796102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:03.796102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:03.796102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:03.796102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:03.796102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:03.796102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:03.796102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:03.798062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:03.798062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:03.798062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:03.798062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:03.798062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:03.798062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:03.798062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:03.798062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:03.798062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:03.798062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:03.798062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:03.798062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:03.798062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:03.798062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:03.798062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:03.798062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:03.799940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:03.799940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:03.799940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:03.799940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:03.799940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:03.799940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:03.799940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:03.799940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:03.799940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:03.799940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:03.799940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:41:03.799940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:03.799940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 82/168] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:41:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:03.799940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6b5cb-c62e-480b-a3de-54f31c79cac2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:03.852193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455f50a-b65d-4687-8274-31a7e0eff9d4 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:03.912869 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5030292-f488-448e-870e-9617bc0df717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:03.913842 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5030292-f488-448e-870e-9617bc0df717 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:03.914124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5030292-f488-448e-870e-9617bc0df717 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:03.914397 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5030292-f488-448e-870e-9617bc0df717 None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f/users/af9e993a8c764478b2c21fdf0af49569/roles/62544860c24f461a83620d4401a9ca0a` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:03.918085 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5030292-f488-448e-870e-9617bc0df717 None admin] RBAC: Authorizing `identity:create_grant(project_id=660afb35216c4b94a77b71d73962d86f, user_id=af9e993a8c764478b2c21fdf0af49569, role_id=62544860c24f461a83620d4401a9ca0a)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:03.919589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5030292-f488-448e-870e-9617bc0df717 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:03.943285 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 87/169] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:41:03 2022] PUT /identity/v3/projects/660afb35216c4b94a77b71d73962d86f/users/af9e993a8c764478b2c21fdf0af49569/roles/62544860c24f461a83620d4401a9ca0a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:03.945438 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5030292-f488-448e-870e-9617bc0df717 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:03.989495 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6b5cb-c62e-480b-a3de-54f31c79cac2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:04.054691 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38387b83-8daa-41a2-92ea-d5d7fdf94e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:04.055514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38387b83-8daa-41a2-92ea-d5d7fdf94e70 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:04.055790 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38387b83-8daa-41a2-92ea-d5d7fdf94e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:04.056060 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38387b83-8daa-41a2-92ea-d5d7fdf94e70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:04.070751 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38387b83-8daa-41a2-92ea-d5d7fdf94e70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:04.081390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-38387b83-8daa-41a2-92ea-d5d7fdf94e70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:04.081390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:04.081390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:04.081390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:04.081390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:04.081390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:04.081390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:04.081390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:04.081390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:04.081390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:04.081390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:04.081390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:04.081390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:04.081390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:04.081390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:04.081390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:04.083085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:04.083085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:04.083085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:04.083085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:04.083085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:04.083085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:04.083085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:04.083085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:04.083085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:04.083085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:04.083085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:04.083085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:04.083085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:04.083085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:04.083085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:04.083085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:04.083863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:04.083863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:04.083863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:04.083863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:04.083863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:04.083863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:04.083863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:04.083863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:04.083863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:04.083863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:04.083863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:04.083863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:04.083863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 83/170] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:04.089147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38387b83-8daa-41a2-92ea-d5d7fdf94e70 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:04.141612 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5030292-f488-448e-870e-9617bc0df717 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:04.228863 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b76569-af1e-45c4-bba5-a47e42289a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:04.229572 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b76569-af1e-45c4-bba5-a47e42289a37 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:04.229900 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b76569-af1e-45c4-bba5-a47e42289a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:04.230179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b76569-af1e-45c4-bba5-a47e42289a37 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:04.230949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b76569-af1e-45c4-bba5-a47e42289a37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:04.231271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b76569-af1e-45c4-bba5-a47e42289a37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:04.232701 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b76569-af1e-45c4-bba5-a47e42289a37 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:04.240460 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38387b83-8daa-41a2-92ea-d5d7fdf94e70 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:04.250441 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 88/171] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:04.256180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b76569-af1e-45c4-bba5-a47e42289a37 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:04.287298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb243d-783f-4a07-a499-58b5c8d2c1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:04.287298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb243d-783f-4a07-a499-58b5c8d2c1af None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:04.287298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb243d-783f-4a07-a499-58b5c8d2c1af None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:04.287298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb243d-783f-4a07-a499-58b5c8d2c1af None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:04.288076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb243d-783f-4a07-a499-58b5c8d2c1af None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:04.288076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb243d-783f-4a07-a499-58b5c8d2c1af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:04.288076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb243d-783f-4a07-a499-58b5c8d2c1af None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:04.301862 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 84/172] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:41:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:04.307996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb243d-783f-4a07-a499-58b5c8d2c1af None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:04.367759 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b76569-af1e-45c4-bba5-a47e42289a37 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:04.411690 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c3499-ed3f-4f6c-9594-3f3d295926ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:04.412958 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c3499-ed3f-4f6c-9594-3f3d295926ad None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:04.413394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c3499-ed3f-4f6c-9594-3f3d295926ad None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:04.413811 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c3499-ed3f-4f6c-9594-3f3d295926ad None admin] PATH_INFO: `/v3/users/7a9fbdd0a78349c9b11108cb751273ee` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:04.415245 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c3499-ed3f-4f6c-9594-3f3d295926ad None admin] RBAC: Authorizing `identity:get_user(user_id=7a9fbdd0a78349c9b11108cb751273ee)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:04.417072 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c3499-ed3f-4f6c-9594-3f3d295926ad None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:04.417449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb243d-783f-4a07-a499-58b5c8d2c1af None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:04.419237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 89/173] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:04 2022] GET /identity/v3/users/7a9fbdd0a78349c9b11108cb751273ee => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:04.424675 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c3499-ed3f-4f6c-9594-3f3d295926ad None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:04.463685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f1aca-496e-4e6a-a434-2b9628e8647c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:04.464922 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f1aca-496e-4e6a-a434-2b9628e8647c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:04.465348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f1aca-496e-4e6a-a434-2b9628e8647c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:04.465761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f1aca-496e-4e6a-a434-2b9628e8647c None admin] PATH_INFO: `/v3/users/5c4ff16e69b74f1f9018258137fba1f3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:04.467190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f1aca-496e-4e6a-a434-2b9628e8647c None admin] RBAC: Authorizing `identity:get_user(user_id=5c4ff16e69b74f1f9018258137fba1f3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:04.468788 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f1aca-496e-4e6a-a434-2b9628e8647c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:04.470701 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 85/174] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:04 2022] GET /identity/v3/users/5c4ff16e69b74f1f9018258137fba1f3 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:04.478347 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f1aca-496e-4e6a-a434-2b9628e8647c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:04.533963 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c3499-ed3f-4f6c-9594-3f3d295926ad None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:04.577212 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a47c1-1fcb-4e0e-81f1-e953e4c5729e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:04.577763 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a47c1-1fcb-4e0e-81f1-e953e4c5729e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:04.578043 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a47c1-1fcb-4e0e-81f1-e953e4c5729e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:04.578320 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a47c1-1fcb-4e0e-81f1-e953e4c5729e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:04.596678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f1aca-496e-4e6a-a434-2b9628e8647c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:04.642242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25730d-9437-451d-b600-6be670a42c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:04.643181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25730d-9437-451d-b600-6be670a42c5d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:04.643631 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25730d-9437-451d-b600-6be670a42c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:04.644049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25730d-9437-451d-b600-6be670a42c5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:04.699654 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a47c1-1fcb-4e0e-81f1-e953e4c5729e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:04.701387 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a47c1-1fcb-4e0e-81f1-e953e4c5729e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:04.821688 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25730d-9437-451d-b600-6be670a42c5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:04.831063 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25730d-9437-451d-b600-6be670a42c5d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:04.846110 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 90/175] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 06:41:04.851443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a47c1-1fcb-4e0e-81f1-e953e4c5729e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:04.923181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 86/176] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 06:41:04.928996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25730d-9437-451d-b600-6be670a42c5d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:04.986241 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a47c1-1fcb-4e0e-81f1-e953e4c5729e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:05.023565 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25730d-9437-451d-b600-6be670a42c5d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:05.027291 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f414ad-93c0-44f1-8745-5275d93450c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:05.028348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f414ad-93c0-44f1-8745-5275d93450c3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:05.028766 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f414ad-93c0-44f1-8745-5275d93450c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:05.029200 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f414ad-93c0-44f1-8745-5275d93450c3 None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:05.035710 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f414ad-93c0-44f1-8745-5275d93450c3 None admin] RBAC: Authorizing `identity:get_project(project_id=660afb35216c4b94a77b71d73962d86f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:05.037442 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f414ad-93c0-44f1-8745-5275d93450c3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:05.039830 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 91/177] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:04 2022] GET /identity/v3/projects/660afb35216c4b94a77b71d73962d86f => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:05.045329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f414ad-93c0-44f1-8745-5275d93450c3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:05.062983 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f798940-17ba-4d90-bc1e-fffeac9ee950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:05.062983 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f798940-17ba-4d90-bc1e-fffeac9ee950 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:05.062983 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f798940-17ba-4d90-bc1e-fffeac9ee950 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:05.062983 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f798940-17ba-4d90-bc1e-fffeac9ee950 None admin] PATH_INFO: `/v3/projects/4985bb9f8e3546c5a46f84a872734222` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:05.063419 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f798940-17ba-4d90-bc1e-fffeac9ee950 None admin] RBAC: Authorizing `identity:get_project(project_id=4985bb9f8e3546c5a46f84a872734222)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:05.063419 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f798940-17ba-4d90-bc1e-fffeac9ee950 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:05.065127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 87/178] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:04 2022] GET /identity/v3/projects/4985bb9f8e3546c5a46f84a872734222 => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:05.071300 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f798940-17ba-4d90-bc1e-fffeac9ee950 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:05.166484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f414ad-93c0-44f1-8745-5275d93450c3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:05.168148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f798940-17ba-4d90-bc1e-fffeac9ee950 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:05.201904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631dd99-8ed3-4085-bbd3-aa0e36bc1227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:05.202501 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631dd99-8ed3-4085-bbd3-aa0e36bc1227 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:05.202779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631dd99-8ed3-4085-bbd3-aa0e36bc1227 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:05.203169 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631dd99-8ed3-4085-bbd3-aa0e36bc1227 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:05.204065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631dd99-8ed3-4085-bbd3-aa0e36bc1227 None admin] RBAC: Adding query filter params (role.id=f8d42be71f034e1a88784699c04e7a89, scope.project.id=4985bb9f8e3546c5a46f84a872734222, user.id=5c4ff16e69b74f1f9018258137fba1f3) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:05.204418 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631dd99-8ed3-4085-bbd3-aa0e36bc1227 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:05.205968 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631dd99-8ed3-4085-bbd3-aa0e36bc1227 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:05.208623 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142dca7-5c7e-4428-bb76-df6a2f900469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:05.209501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142dca7-5c7e-4428-bb76-df6a2f900469 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:05.209943 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142dca7-5c7e-4428-bb76-df6a2f900469 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:05.210353 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142dca7-5c7e-4428-bb76-df6a2f900469 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:05.211358 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142dca7-5c7e-4428-bb76-df6a2f900469 None admin] RBAC: Adding query filter params (role.id=5debd8ad07a74bedbf2efd53b11cd7cd, scope.project.id=660afb35216c4b94a77b71d73962d86f, user.id=7a9fbdd0a78349c9b11108cb751273ee) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:05.211808 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142dca7-5c7e-4428-bb76-df6a2f900469 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:05.212324 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 88/179] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:41:05 2022] GET /identity/v3/role_assignments?user.id=5c4ff16e69b74f1f9018258137fba1f3&scope.project.id=4985bb9f8e3546c5a46f84a872734222&role.id=f8d42be71f034e1a88784699c04e7a89 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:05.213571 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142dca7-5c7e-4428-bb76-df6a2f900469 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:05.225773 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 92/180] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:41:05 2022] GET /identity/v3/role_assignments?user.id=7a9fbdd0a78349c9b11108cb751273ee&scope.project.id=660afb35216c4b94a77b71d73962d86f&role.id=5debd8ad07a74bedbf2efd53b11cd7cd => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:05.680807 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fc3ea-8cc3-40ab-9b1f-400ab5896e78 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:05.681353 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fc3ea-8cc3-40ab-9b1f-400ab5896e78 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:05.681353 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fc3ea-8cc3-40ab-9b1f-400ab5896e78 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:05.682951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 89/181] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:05.688604 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc11d6-4141-4f67-b5c7-4a95777915b2 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:05.689025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc11d6-4141-4f67-b5c7-4a95777915b2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:05.689160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc11d6-4141-4f67-b5c7-4a95777915b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:05.711295 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-97bc11d6-4141-4f67-b5c7-4a95777915b2 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:05.712550 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-97bc11d6-4141-4f67-b5c7-4a95777915b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:05.798656 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 93/182] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:05.824898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fc3ea-8cc3-40ab-9b1f-400ab5896e78 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:05.933168 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fc3ea-8cc3-40ab-9b1f-400ab5896e78 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:05.951726 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766fd96-8048-4843-a943-b8b11c0c57aa None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:05.952043 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766fd96-8048-4843-a943-b8b11c0c57aa None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:05.952281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766fd96-8048-4843-a943-b8b11c0c57aa None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:05.953678 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 94/183] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:05.958873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3628654-e45f-460f-ba8c-e7f3f1f8c397 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:05.959218 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3628654-e45f-460f-ba8c-e7f3f1f8c397 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:05.959497 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3628654-e45f-460f-ba8c-e7f3f1f8c397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:05.976042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8216c-186f-49c9-9b1e-156c15ac3f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:05.976843 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8216c-186f-49c9-9b1e-156c15ac3f0f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:05.977117 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8216c-186f-49c9-9b1e-156c15ac3f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:05.977434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8216c-186f-49c9-9b1e-156c15ac3f0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:05.988059 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d3628654-e45f-460f-ba8c-e7f3f1f8c397 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:05.989167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8216c-186f-49c9-9b1e-156c15ac3f0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:05.989276 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d3628654-e45f-460f-ba8c-e7f3f1f8c397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:05.997144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-4eb8216c-186f-49c9-9b1e-156c15ac3f0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:41:05.997144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:05.997144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:05.997144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:05.997144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:05.997144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:05.997144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:05.997144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:05.997144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:05.997144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:05.997144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:05.997144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:05.997144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:05.997144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:05.997144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:05.997144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:05.998070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:05.998070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:05.998070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:05.998070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:05.998070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:05.998070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:05.998070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:05.998070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:05.998070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:05.998070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:05.998070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:05.998070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:05.998070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:05.998070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:05.998070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:05.998070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:05.998880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:05.998880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:05.998880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:05.998880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:05.998880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:05.998880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:05.998880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:05.998880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:05.998880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:05.998880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:05.998880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:41:05.998880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:05.998880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 90/184] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:41:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:06.001205 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ac0d5-ffb1-4978-8333-8c9e061128e8 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:06.001205 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ac0d5-ffb1-4978-8333-8c9e061128e8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:06.001205 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ac0d5-ffb1-4978-8333-8c9e061128e8 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:06.006756 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 91/185] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:06.011282 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ac0d5-ffb1-4978-8333-8c9e061128e8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:06.060343 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 95/186] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:06.061977 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd9b3d-0838-4ea3-9f31-bd3b5cf5a388 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:06.062498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd9b3d-0838-4ea3-9f31-bd3b5cf5a388 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:06.062993 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd9b3d-0838-4ea3-9f31-bd3b5cf5a388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:06.085960 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-11cd9b3d-0838-4ea3-9f31-bd3b5cf5a388 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:06.087565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-11cd9b3d-0838-4ea3-9f31-bd3b5cf5a388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:06.119310 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ac0d5-ffb1-4978-8333-8c9e061128e8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:06.150017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 96/187] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:06.151319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd9b3d-0838-4ea3-9f31-bd3b5cf5a388 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:06.151694 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65a3db-80de-4b5f-82da-cfcb68174101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:06.152493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65a3db-80de-4b5f-82da-cfcb68174101 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:06.152836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65a3db-80de-4b5f-82da-cfcb68174101 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:06.153159 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65a3db-80de-4b5f-82da-cfcb68174101 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:06.153912 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65a3db-80de-4b5f-82da-cfcb68174101 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:06.154214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65a3db-80de-4b5f-82da-cfcb68174101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:06.156680 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65a3db-80de-4b5f-82da-cfcb68174101 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:06.168203 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 92/188] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:06.172022 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65a3db-80de-4b5f-82da-cfcb68174101 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:06.254919 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd9b3d-0838-4ea3-9f31-bd3b5cf5a388 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:06.266662 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65a3db-80de-4b5f-82da-cfcb68174101 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:06.286319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9746eac-b68a-421d-a61d-082df8237560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:06.287159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9746eac-b68a-421d-a61d-082df8237560 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:06.287511 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9746eac-b68a-421d-a61d-082df8237560 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:06.287836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9746eac-b68a-421d-a61d-082df8237560 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:06.289003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9746eac-b68a-421d-a61d-082df8237560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:06.292096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9746eac-b68a-421d-a61d-082df8237560 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:06.292096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 97/189] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:06.296889 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9746eac-b68a-421d-a61d-082df8237560 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:06.312873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e72ac-cc75-4a5f-be3b-a4ff97e2b009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:06.313765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e72ac-cc75-4a5f-be3b-a4ff97e2b009 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:06.314043 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e72ac-cc75-4a5f-be3b-a4ff97e2b009 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:06.314317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e72ac-cc75-4a5f-be3b-a4ff97e2b009 None admin] PATH_INFO: `/v3/users/1455fae3c532473f93e1b31ea55aa189` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:06.329629 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e72ac-cc75-4a5f-be3b-a4ff97e2b009 None admin] RBAC: Authorizing `identity:get_user(user_id=1455fae3c532473f93e1b31ea55aa189)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:06.331176 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e72ac-cc75-4a5f-be3b-a4ff97e2b009 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:06.337584 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 93/190] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:06 2022] GET /identity/v3/users/1455fae3c532473f93e1b31ea55aa189 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:06.338182 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e72ac-cc75-4a5f-be3b-a4ff97e2b009 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:06.389815 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9746eac-b68a-421d-a61d-082df8237560 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:06.423617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448b189-0390-4573-b693-e7f5091cee21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:06.424428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448b189-0390-4573-b693-e7f5091cee21 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:06.424709 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448b189-0390-4573-b693-e7f5091cee21 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:06.424977 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448b189-0390-4573-b693-e7f5091cee21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:06.429533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e72ac-cc75-4a5f-be3b-a4ff97e2b009 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:06.434941 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448b189-0390-4573-b693-e7f5091cee21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:06.442973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-7448b189-0390-4573-b693-e7f5091cee21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:41:06.442973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:06.442973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:06.442973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:06.442973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:06.442973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:06.442973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:06.442973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:06.442973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:06.442973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:06.442973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:06.442973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:06.442973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:06.442973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:06.442973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:06.442973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:06.443915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:06.443915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:06.443915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:06.443915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:06.443915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:06.443915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:06.443915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:06.443915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:06.443915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:06.443915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:06.443915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:06.443915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:06.443915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:06.443915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:06.443915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:06.443915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:06.444715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:06.444715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:06.444715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:06.444715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:06.444715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:06.444715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:06.444715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:06.444715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:06.444715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:06.444715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:06.444715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:41:06.444715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:06.444715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 98/191] 10.222.0.77 () {56 vars in 1114 bytes} [Wed May 11 06:41:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:06.445366 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448b189-0390-4573-b693-e7f5091cee21 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:06.478014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66d860-1091-4750-9878-a25ac869ea06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:06.478716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66d860-1091-4750-9878-a25ac869ea06 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:06.479062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66d860-1091-4750-9878-a25ac869ea06 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:06.479376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66d860-1091-4750-9878-a25ac869ea06 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:06.480162 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66d860-1091-4750-9878-a25ac869ea06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:06.482075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66d860-1091-4750-9878-a25ac869ea06 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:06.502728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 94/192] 10.222.0.77 () {60 vars in 1132 bytes} [Wed May 11 06:41:06 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:41:06.502728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66d860-1091-4750-9878-a25ac869ea06 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:06.566437 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448b189-0390-4573-b693-e7f5091cee21 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:06.605254 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d031a-c22f-4ec7-9e3f-8655c43bb00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:06.605969 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d031a-c22f-4ec7-9e3f-8655c43bb00a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:06.606251 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d031a-c22f-4ec7-9e3f-8655c43bb00a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:06.606525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d031a-c22f-4ec7-9e3f-8655c43bb00a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:06.643009 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66d860-1091-4750-9878-a25ac869ea06 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:06.680829 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d539563-81e9-4fab-8208-9751c3ef20b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:06.680829 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d539563-81e9-4fab-8208-9751c3ef20b7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:06.680829 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d539563-81e9-4fab-8208-9751c3ef20b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:06.680829 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d539563-81e9-4fab-8208-9751c3ef20b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:06.681744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d539563-81e9-4fab-8208-9751c3ef20b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:06.681744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d539563-81e9-4fab-8208-9751c3ef20b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:06.683114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d539563-81e9-4fab-8208-9751c3ef20b7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:06.690027 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d031a-c22f-4ec7-9e3f-8655c43bb00a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:06.691557 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d031a-c22f-4ec7-9e3f-8655c43bb00a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:06.692425 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 95/193] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:41:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:06.698245 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d539563-81e9-4fab-8208-9751c3ef20b7 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:06.801272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 99/194] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:41:06.807433 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d031a-c22f-4ec7-9e3f-8655c43bb00a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:06.815013 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d539563-81e9-4fab-8208-9751c3ef20b7 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:06.855240 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d28e5e-55c8-473d-80aa-321e5566eac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:06.856448 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d28e5e-55c8-473d-80aa-321e5566eac2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:06.856951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d28e5e-55c8-473d-80aa-321e5566eac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:06.857400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d28e5e-55c8-473d-80aa-321e5566eac2 None admin] PATH_INFO: `/v3/users/1455fae3c532473f93e1b31ea55aa189` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:06.859062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d28e5e-55c8-473d-80aa-321e5566eac2 None admin] RBAC: Authorizing `identity:get_user(user_id=1455fae3c532473f93e1b31ea55aa189)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:06.860818 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d28e5e-55c8-473d-80aa-321e5566eac2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:06.862874 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 96/195] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:06 2022] GET /identity/v3/users/1455fae3c532473f93e1b31ea55aa189 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:06.869041 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d28e5e-55c8-473d-80aa-321e5566eac2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:06.915757 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d031a-c22f-4ec7-9e3f-8655c43bb00a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:06.950498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c319d-b416-496c-8231-fac10cec5915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:06.951783 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c319d-b416-496c-8231-fac10cec5915 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:06.952264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c319d-b416-496c-8231-fac10cec5915 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:06.952750 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c319d-b416-496c-8231-fac10cec5915 None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:06.954167 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c319d-b416-496c-8231-fac10cec5915 None admin] RBAC: Authorizing `identity:get_project(project_id=138bad15d42d49259cf68f4833e7841e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:06.955869 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c319d-b416-496c-8231-fac10cec5915 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:06.958125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 100/196] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:06 2022] GET /identity/v3/projects/138bad15d42d49259cf68f4833e7841e => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:06.964154 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c319d-b416-496c-8231-fac10cec5915 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:06.980556 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d28e5e-55c8-473d-80aa-321e5566eac2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:07.017118 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4facc-8fbc-480b-8239-63c62d045f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:07.017774 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4facc-8fbc-480b-8239-63c62d045f08 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:07.018050 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4facc-8fbc-480b-8239-63c62d045f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:07.018320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4facc-8fbc-480b-8239-63c62d045f08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:07.068986 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c319d-b416-496c-8231-fac10cec5915 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:07.085341 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4facc-8fbc-480b-8239-63c62d045f08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:07.086813 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4facc-8fbc-480b-8239-63c62d045f08 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:07.105231 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d43b5-fcb4-4ebb-a4f6-616429001ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:07.106339 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d43b5-fcb4-4ebb-a4f6-616429001ccc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:07.106833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d43b5-fcb4-4ebb-a4f6-616429001ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:07.107321 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d43b5-fcb4-4ebb-a4f6-616429001ccc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:07.108349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d43b5-fcb4-4ebb-a4f6-616429001ccc None admin] RBAC: Adding query filter params (role.id=5debd8ad07a74bedbf2efd53b11cd7cd, scope.project.id=138bad15d42d49259cf68f4833e7841e, user.id=1455fae3c532473f93e1b31ea55aa189) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:07.108869 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d43b5-fcb4-4ebb-a4f6-616429001ccc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:07.110506 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d43b5-fcb4-4ebb-a4f6-616429001ccc None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:07.116473 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 101/197] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:41:06 2022] GET /identity/v3/role_assignments?user.id=1455fae3c532473f93e1b31ea55aa189&scope.project.id=138bad15d42d49259cf68f4833e7841e&role.id=5debd8ad07a74bedbf2efd53b11cd7cd => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:07.118060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f0de0-b71d-4293-9f3a-9753e8859ae9 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:07.118549 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f0de0-b71d-4293-9f3a-9753e8859ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:07.119060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f0de0-b71d-4293-9f3a-9753e8859ae9 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:07.120595 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 102/198] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:07.128481 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c2f0e-7670-4c96-9012-ffecd21696bd None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:07.129117 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c2f0e-7670-4c96-9012-ffecd21696bd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:07.129591 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c2f0e-7670-4c96-9012-ffecd21696bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:07.162553 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-432c2f0e-7670-4c96-9012-ffecd21696bd None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:07.164185 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-432c2f0e-7670-4c96-9012-ffecd21696bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:07.195040 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 97/199] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 06:41:07.198038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4facc-8fbc-480b-8239-63c62d045f08 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:07.316699 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 103/200] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:07.340211 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4facc-8fbc-480b-8239-63c62d045f08 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:07.340429 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c2f0e-7670-4c96-9012-ffecd21696bd None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:07.386928 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307893d-5cb5-4727-a063-fa3067e115da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:07.388406 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307893d-5cb5-4727-a063-fa3067e115da None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:07.388680 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307893d-5cb5-4727-a063-fa3067e115da None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:07.388952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307893d-5cb5-4727-a063-fa3067e115da None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:07.391457 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307893d-5cb5-4727-a063-fa3067e115da None admin] RBAC: Authorizing `identity:get_project(project_id=138bad15d42d49259cf68f4833e7841e)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:07.394344 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307893d-5cb5-4727-a063-fa3067e115da None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:07.400428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 98/201] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:07 2022] GET /identity/v3/projects/138bad15d42d49259cf68f4833e7841e => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:07.404851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307893d-5cb5-4727-a063-fa3067e115da None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:07.533359 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c2f0e-7670-4c96-9012-ffecd21696bd None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:07.585305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307893d-5cb5-4727-a063-fa3067e115da None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:07.587866 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc56372-d352-4601-9d88-ad798cbffaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:07.588814 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc56372-d352-4601-9d88-ad798cbffaa8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:07.589104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc56372-d352-4601-9d88-ad798cbffaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:07.589379 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc56372-d352-4601-9d88-ad798cbffaa8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:07.609835 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc56372-d352-4601-9d88-ad798cbffaa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:07.624816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-9fc56372-d352-4601-9d88-ad798cbffaa8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:41:07.624816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:07.624816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:07.624816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:07.624816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:07.624816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:07.624816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:07.624816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:07.624816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:07.624816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:07.624816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:07.624816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:07.624816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:07.624816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:07.624816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:07.624816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:07.625720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:07.625720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:07.625720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:07.625720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:07.625720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:07.625720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:07.625720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:07.625720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:07.625720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:07.625720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:07.625720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:07.625720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:07.625720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:07.625720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:07.625720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:07.625720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:07.626515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:07.626515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:07.626515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:07.626515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:07.626515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:07.626515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:07.626515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:07.626515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:07.626515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:07.626515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:07.626515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:41:07.626515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:07.626515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 104/202] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:41:07.632322 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310c37c-271b-45cb-96ed-19f2f94b72b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:07.633005 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310c37c-271b-45cb-96ed-19f2f94b72b3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:07.633285 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310c37c-271b-45cb-96ed-19f2f94b72b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:07.633560 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310c37c-271b-45cb-96ed-19f2f94b72b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:07.634402 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310c37c-271b-45cb-96ed-19f2f94b72b3 None admin] RBAC: Adding query filter params (role.id=ae6b211774c34f47a3ac4853538f62ad, scope.project.id=138bad15d42d49259cf68f4833e7841e, user.id=1455fae3c532473f93e1b31ea55aa189) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:07.634712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310c37c-271b-45cb-96ed-19f2f94b72b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:07.636240 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310c37c-271b-45cb-96ed-19f2f94b72b3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:07.642452 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 99/203] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:41:07 2022] GET /identity/v3/role_assignments?user.id=1455fae3c532473f93e1b31ea55aa189&scope.project.id=138bad15d42d49259cf68f4833e7841e&role.id=ae6b211774c34f47a3ac4853538f62ad => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:07.644556 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc56372-d352-4601-9d88-ad798cbffaa8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:07.750678 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc56372-d352-4601-9d88-ad798cbffaa8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:07.786073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb180d6-e3cd-4e02-9eb1-7cabbc3c292d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:07.786810 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb180d6-e3cd-4e02-9eb1-7cabbc3c292d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:07.787126 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb180d6-e3cd-4e02-9eb1-7cabbc3c292d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:07.787439 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb180d6-e3cd-4e02-9eb1-7cabbc3c292d None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:07.788201 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb180d6-e3cd-4e02-9eb1-7cabbc3c292d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:07.788505 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb180d6-e3cd-4e02-9eb1-7cabbc3c292d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:07.789914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb180d6-e3cd-4e02-9eb1-7cabbc3c292d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:07.798994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 105/204] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:41:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:07.804768 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310c37c-271b-45cb-96ed-19f2f94b72b3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:07.910166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310c37c-271b-45cb-96ed-19f2f94b72b3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:07.945499 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193fd7f-3239-41b1-952d-150b9f274713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:07.946445 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193fd7f-3239-41b1-952d-150b9f274713 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:07.947081 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193fd7f-3239-41b1-952d-150b9f274713 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:07.947363 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193fd7f-3239-41b1-952d-150b9f274713 None admin] PATH_INFO: `/v3/users/af9e993a8c764478b2c21fdf0af49569` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:07.948583 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193fd7f-3239-41b1-952d-150b9f274713 None admin] RBAC: Authorizing `identity:get_user(user_id=af9e993a8c764478b2c21fdf0af49569)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:07.950036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193fd7f-3239-41b1-952d-150b9f274713 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:07.952012 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 100/205] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:07 2022] GET /identity/v3/users/af9e993a8c764478b2c21fdf0af49569 => generated 289 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:07.957868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb180d6-e3cd-4e02-9eb1-7cabbc3c292d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:08.060461 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb180d6-e3cd-4e02-9eb1-7cabbc3c292d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:08.094848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb643d69-1454-4191-ad13-fd50e28d8e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:08.095622 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb643d69-1454-4191-ad13-fd50e28d8e49 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:08.095905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb643d69-1454-4191-ad13-fd50e28d8e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:08.096180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb643d69-1454-4191-ad13-fd50e28d8e49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:08.166671 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb643d69-1454-4191-ad13-fd50e28d8e49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:08.168112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb643d69-1454-4191-ad13-fd50e28d8e49 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:08.264536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 106/206] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:41:08.270230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193fd7f-3239-41b1-952d-150b9f274713 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:08.368894 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193fd7f-3239-41b1-952d-150b9f274713 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:08.405513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad396faf-0785-46e4-a513-4e7c7d569bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:08.406447 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad396faf-0785-46e4-a513-4e7c7d569bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:08.406728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad396faf-0785-46e4-a513-4e7c7d569bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:08.407030 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad396faf-0785-46e4-a513-4e7c7d569bd7 None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:08.409470 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad396faf-0785-46e4-a513-4e7c7d569bd7 None admin] RBAC: Authorizing `identity:get_project(project_id=660afb35216c4b94a77b71d73962d86f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:08.410996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad396faf-0785-46e4-a513-4e7c7d569bd7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:08.412935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 101/207] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:08 2022] GET /identity/v3/projects/660afb35216c4b94a77b71d73962d86f => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:08.418784 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb643d69-1454-4191-ad13-fd50e28d8e49 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:08.529915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb643d69-1454-4191-ad13-fd50e28d8e49 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:08.563196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9918f0-0f71-45d6-a84f-4bdf3823ec35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:08.564099 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9918f0-0f71-45d6-a84f-4bdf3823ec35 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:08.564549 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9918f0-0f71-45d6-a84f-4bdf3823ec35 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:08.564961 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9918f0-0f71-45d6-a84f-4bdf3823ec35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:08.565932 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9918f0-0f71-45d6-a84f-4bdf3823ec35 None admin] RBAC: Adding query filter params (role.id=62544860c24f461a83620d4401a9ca0a, scope.project.id=660afb35216c4b94a77b71d73962d86f, user.id=af9e993a8c764478b2c21fdf0af49569) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:08.566382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9918f0-0f71-45d6-a84f-4bdf3823ec35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:08.567984 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9918f0-0f71-45d6-a84f-4bdf3823ec35 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:08.577941 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 107/208] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:41:08 2022] GET /identity/v3/role_assignments?user.id=af9e993a8c764478b2c21fdf0af49569&scope.project.id=660afb35216c4b94a77b71d73962d86f&role.id=62544860c24f461a83620d4401a9ca0a => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:09.239536 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2e043-c388-4e7b-bbbb-c47bed0e40bf None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:09.240041 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2e043-c388-4e7b-bbbb-c47bed0e40bf None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:09.240116 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2e043-c388-4e7b-bbbb-c47bed0e40bf None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:09.242056 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 102/209] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:09.252670 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccae4f-1664-4803-bdd5-d885fb3333a9 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:09.253140 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccae4f-1664-4803-bdd5-d885fb3333a9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:09.253214 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccae4f-1664-4803-bdd5-d885fb3333a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:09.275621 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c2ccae4f-1664-4803-bdd5-d885fb3333a9 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:09.276894 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c2ccae4f-1664-4803-bdd5-d885fb3333a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:09.350848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 108/210] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:09.377700 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2e043-c388-4e7b-bbbb-c47bed0e40bf None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:09.480802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2e043-c388-4e7b-bbbb-c47bed0e40bf None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:09.515076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ccddb-f30c-427e-8ae8-f2422ff6185c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:09.515824 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ccddb-f30c-427e-8ae8-f2422ff6185c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:09.516108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ccddb-f30c-427e-8ae8-f2422ff6185c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:09.516386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ccddb-f30c-427e-8ae8-f2422ff6185c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:09.526498 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ccddb-f30c-427e-8ae8-f2422ff6185c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:09.530410 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd68ce-833a-4694-8760-4d0fb7cbc11d None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:09.530985 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd68ce-833a-4694-8760-4d0fb7cbc11d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:09.531457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd68ce-833a-4694-8760-4d0fb7cbc11d None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:09.535812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-a27ccddb-f30c-427e-8ae8-f2422ff6185c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:09.535812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:09.535812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:09.535812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:09.535812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:09.535812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:09.535812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:09.535812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:09.535812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:09.535812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:09.535812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:09.535812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:09.535812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:09.535812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:09.535812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:09.535812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:09.537006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:09.537006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:09.537006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:09.537006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:09.537006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:09.537006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:09.537006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:09.537006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:09.537006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:09.537006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:09.537006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:09.537006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:09.537006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:09.537006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:09.537006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:09.537006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:09.537865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:09.537865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:09.537865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:09.537865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:09.537865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:09.537865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:09.537865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:09.537865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:09.537865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:09.537865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:09.537865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:09.537865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:09.537865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 103/212] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:09.538894 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 109/212] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:09.541269 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd68ce-833a-4694-8760-4d0fb7cbc11d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:09.541718 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a075d-7aa9-400a-bc27-903a40a1c2a5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:09.542014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a075d-7aa9-400a-bc27-903a40a1c2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:09.542394 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a075d-7aa9-400a-bc27-903a40a1c2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:09.559629 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-327a075d-7aa9-400a-bc27-903a40a1c2a5 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:09.560894 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-327a075d-7aa9-400a-bc27-903a40a1c2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:09.630046 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 104/213] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:41:09.654008 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a075d-7aa9-400a-bc27-903a40a1c2a5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:09.660539 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd68ce-833a-4694-8760-4d0fb7cbc11d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:09.694276 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561abe0b-6c6c-4b58-b378-af639e7113eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:09.695368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561abe0b-6c6c-4b58-b378-af639e7113eb None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:09.695872 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561abe0b-6c6c-4b58-b378-af639e7113eb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:09.696332 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561abe0b-6c6c-4b58-b378-af639e7113eb None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:09.697657 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561abe0b-6c6c-4b58-b378-af639e7113eb None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:09.698147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561abe0b-6c6c-4b58-b378-af639e7113eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:09.699807 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561abe0b-6c6c-4b58-b378-af639e7113eb None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:09.708994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 110/214] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:41:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:09.714822 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561abe0b-6c6c-4b58-b378-af639e7113eb None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:09.755475 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a075d-7aa9-400a-bc27-903a40a1c2a5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:09.790116 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ce0b1-130a-44b1-a4b0-8f14de27598b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:09.791285 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ce0b1-130a-44b1-a4b0-8f14de27598b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:09.791756 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ce0b1-130a-44b1-a4b0-8f14de27598b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:09.792178 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ce0b1-130a-44b1-a4b0-8f14de27598b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:09.793529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ce0b1-130a-44b1-a4b0-8f14de27598b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:09.795151 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ce0b1-130a-44b1-a4b0-8f14de27598b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:09.801182 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 105/215] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:09.802608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002e2a2-0a6b-4fa8-b8ec-0af51c488d62 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:09.803130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002e2a2-0a6b-4fa8-b8ec-0af51c488d62 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:09.803541 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002e2a2-0a6b-4fa8-b8ec-0af51c488d62 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:09.805146 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 106/216] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:09.808127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002e2a2-0a6b-4fa8-b8ec-0af51c488d62 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:09.811324 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561abe0b-6c6c-4b58-b378-af639e7113eb None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:09.843048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be38f16-c4ab-494c-bc4f-03ef665daa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:09.843929 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be38f16-c4ab-494c-bc4f-03ef665daa64 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:09.844206 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be38f16-c4ab-494c-bc4f-03ef665daa64 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:09.844479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be38f16-c4ab-494c-bc4f-03ef665daa64 None admin] PATH_INFO: `/v3/users/ea1ad53af6ff4fa1a2287cefa844734d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:09.857307 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be38f16-c4ab-494c-bc4f-03ef665daa64 None admin] RBAC: Authorizing `identity:get_user(user_id=ea1ad53af6ff4fa1a2287cefa844734d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:09.858794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be38f16-c4ab-494c-bc4f-03ef665daa64 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:09.860532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 111/217] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:09 2022] GET /identity/v3/users/ea1ad53af6ff4fa1a2287cefa844734d => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:09.861703 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aee186-9f4f-4a4e-8461-44717dc7c1da None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:09.861983 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aee186-9f4f-4a4e-8461-44717dc7c1da None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:09.862251 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aee186-9f4f-4a4e-8461-44717dc7c1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:09.878412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-31aee186-9f4f-4a4e-8461-44717dc7c1da None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:09.879645 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-31aee186-9f4f-4a4e-8461-44717dc7c1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:09.910438 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002e2a2-0a6b-4fa8-b8ec-0af51c488d62 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:09.942092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 112/218] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:09.942944 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aee186-9f4f-4a4e-8461-44717dc7c1da None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:09.948939 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d800f97-8c15-4d34-ad03-042c4b546172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:09.949857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d800f97-8c15-4d34-ad03-042c4b546172 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:09.950353 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d800f97-8c15-4d34-ad03-042c4b546172 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:09.951242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d800f97-8c15-4d34-ad03-042c4b546172 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:09.952156 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d800f97-8c15-4d34-ad03-042c4b546172 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:09.954461 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d800f97-8c15-4d34-ad03-042c4b546172 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:09.977684 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 107/219] 10.222.0.77 () {60 vars in 1132 bytes} [Wed May 11 06:41:09 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:41:09.978860 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d800f97-8c15-4d34-ad03-042c4b546172 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:10.076643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aee186-9f4f-4a4e-8461-44717dc7c1da None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:10.084857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d800f97-8c15-4d34-ad03-042c4b546172 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:10.120708 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e880c6-b586-4844-9a5a-a84774f9af15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:10.121749 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e880c6-b586-4844-9a5a-a84774f9af15 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:10.122090 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e880c6-b586-4844-9a5a-a84774f9af15 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:10.122430 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e880c6-b586-4844-9a5a-a84774f9af15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:10.122737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431fbcf-5499-4814-9bb4-c2e33ae38039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:10.123665 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431fbcf-5499-4814-9bb4-c2e33ae38039 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:10.124141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431fbcf-5499-4814-9bb4-c2e33ae38039 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:10.124618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431fbcf-5499-4814-9bb4-c2e33ae38039 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:10.135543 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e880c6-b586-4844-9a5a-a84774f9af15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:10.144476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-13e880c6-b586-4844-9a5a-a84774f9af15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:41:10.144476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:10.144476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:10.144476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:10.144476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:10.144476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:10.144476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:10.144476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:10.144476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:10.144476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:10.144476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:10.144476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:10.144476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:10.144476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:10.144476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:10.144476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:10.145493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:10.145493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:10.145493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:10.145493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:10.145493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:10.145493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:10.145493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:10.145493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:10.145493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:10.145493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:10.145493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:10.145493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:10.145493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:10.145493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:10.145493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:10.145493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:10.146288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:10.146288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:10.146288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:10.146288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:10.146288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:10.146288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:10.146288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:10.146288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:10.146288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:10.146288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:10.146288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:41:10.146288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:10.146288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 108/220] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:41:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:10.152173 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e880c6-b586-4844-9a5a-a84774f9af15 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:10.219798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431fbcf-5499-4814-9bb4-c2e33ae38039 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:10.221849 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431fbcf-5499-4814-9bb4-c2e33ae38039 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:10.285770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e880c6-b586-4844-9a5a-a84774f9af15 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:10.327082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2b84a-1c6e-41b9-a9c5-0ac3a81b586a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:10.327718 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2b84a-1c6e-41b9-a9c5-0ac3a81b586a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:10.327997 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2b84a-1c6e-41b9-a9c5-0ac3a81b586a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:10.328270 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2b84a-1c6e-41b9-a9c5-0ac3a81b586a None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:10.329390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2b84a-1c6e-41b9-a9c5-0ac3a81b586a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:10.329390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2b84a-1c6e-41b9-a9c5-0ac3a81b586a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:10.331055 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2b84a-1c6e-41b9-a9c5-0ac3a81b586a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:10.341788 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 113/221] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:41:10.342455 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 109/222] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:10.342908 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8dff52-6445-4548-ba0e-3f576db06725 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:10.343259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8dff52-6445-4548-ba0e-3f576db06725 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:10.343495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8dff52-6445-4548-ba0e-3f576db06725 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:10.346302 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 114/223] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:10.348201 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2b84a-1c6e-41b9-a9c5-0ac3a81b586a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:10.349478 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8dff52-6445-4548-ba0e-3f576db06725 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:10.454992 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2b84a-1c6e-41b9-a9c5-0ac3a81b586a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:10.477071 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8dff52-6445-4548-ba0e-3f576db06725 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:10.497546 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a6b77-c071-4a85-830c-e79c95b809c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:10.498435 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a6b77-c071-4a85-830c-e79c95b809c1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:10.498710 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a6b77-c071-4a85-830c-e79c95b809c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:10.499060 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a6b77-c071-4a85-830c-e79c95b809c1 None admin] PATH_INFO: `/v3/users/1455fae3c532473f93e1b31ea55aa189` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:10.500274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a6b77-c071-4a85-830c-e79c95b809c1 None admin] RBAC: Authorizing `identity:get_user(user_id=1455fae3c532473f93e1b31ea55aa189)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:10.501901 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a6b77-c071-4a85-830c-e79c95b809c1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:10.503799 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 110/224] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:10 2022] GET /identity/v3/users/1455fae3c532473f93e1b31ea55aa189 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:10.505264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646e715-332e-4306-8b78-61a421d7c74a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:10.505264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646e715-332e-4306-8b78-61a421d7c74a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:10.505531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646e715-332e-4306-8b78-61a421d7c74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:10.521933 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4dcd96-490b-4c77-978d-88501aa6b31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:10.523376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4dcd96-490b-4c77-978d-88501aa6b31e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:10.523834 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4dcd96-490b-4c77-978d-88501aa6b31e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:10.524305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4dcd96-490b-4c77-978d-88501aa6b31e None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:10.525885 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4dcd96-490b-4c77-978d-88501aa6b31e None admin] RBAC: Authorizing `identity:get_project(project_id=138bad15d42d49259cf68f4833e7841e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:10.526491 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9646e715-332e-4306-8b78-61a421d7c74a None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:10.527751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4dcd96-490b-4c77-978d-88501aa6b31e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:10.527857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9646e715-332e-4306-8b78-61a421d7c74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:10.529966 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 115/225] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:10 2022] GET /identity/v3/projects/138bad15d42d49259cf68f4833e7841e => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:10.531789 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4dcd96-490b-4c77-978d-88501aa6b31e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:10.603182 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 111/226] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:10.604195 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646e715-332e-4306-8b78-61a421d7c74a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:10.655965 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4dcd96-490b-4c77-978d-88501aa6b31e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:10.696410 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4ec38-55e4-4855-9d0e-1e27c4f23a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:10.697966 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4ec38-55e4-4855-9d0e-1e27c4f23a97 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:10.698420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4ec38-55e4-4855-9d0e-1e27c4f23a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:10.698863 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4ec38-55e4-4855-9d0e-1e27c4f23a97 None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:10.700270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4ec38-55e4-4855-9d0e-1e27c4f23a97 None admin] RBAC: Authorizing `identity:get_project(project_id=138bad15d42d49259cf68f4833e7841e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:10.701934 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4ec38-55e4-4855-9d0e-1e27c4f23a97 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:10.703874 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 116/227] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:10 2022] GET /identity/v3/projects/138bad15d42d49259cf68f4833e7841e => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:10.704795 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4ec38-55e4-4855-9d0e-1e27c4f23a97 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:10.734391 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646e715-332e-4306-8b78-61a421d7c74a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:10.768240 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bece24-caba-4c05-8455-0c1fc17fceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:10.769290 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bece24-caba-4c05-8455-0c1fc17fceb4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:10.769763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bece24-caba-4c05-8455-0c1fc17fceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:10.770250 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bece24-caba-4c05-8455-0c1fc17fceb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:10.771364 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bece24-caba-4c05-8455-0c1fc17fceb4 None admin] RBAC: Adding query filter params (role.id=f8d42be71f034e1a88784699c04e7a89, scope.project.id=138bad15d42d49259cf68f4833e7841e, user.id=ea1ad53af6ff4fa1a2287cefa844734d) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:10.771974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bece24-caba-4c05-8455-0c1fc17fceb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:10.773659 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bece24-caba-4c05-8455-0c1fc17fceb4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:10.779510 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 112/228] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:41:10 2022] GET /identity/v3/role_assignments?user.id=ea1ad53af6ff4fa1a2287cefa844734d&scope.project.id=138bad15d42d49259cf68f4833e7841e&role.id=f8d42be71f034e1a88784699c04e7a89 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:10.780574 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bece24-caba-4c05-8455-0c1fc17fceb4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:10.828025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4ec38-55e4-4855-9d0e-1e27c4f23a97 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:10.901011 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba70fe3-db9b-43b1-be5a-991d4e2564fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:10.902299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba70fe3-db9b-43b1-be5a-991d4e2564fa None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:10.904477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba70fe3-db9b-43b1-be5a-991d4e2564fa None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:10.904998 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba70fe3-db9b-43b1-be5a-991d4e2564fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:10.931325 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba70fe3-db9b-43b1-be5a-991d4e2564fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:10.938701 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bece24-caba-4c05-8455-0c1fc17fceb4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:10.950902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-8ba70fe3-db9b-43b1-be5a-991d4e2564fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:41:10.950902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:10.950902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:10.950902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:10.950902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:10.950902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:10.950902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:10.950902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:10.950902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:10.950902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:10.950902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:10.950902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:10.950902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:10.950902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:10.950902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:10.950902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:10.951898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:10.951898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:10.951898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:10.951898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:10.951898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:10.951898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:10.951898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:10.951898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:10.951898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:10.951898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:10.951898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:10.951898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:10.951898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:10.951898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:10.951898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:10.951898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:10.952718 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:10.952718 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:10.952718 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:10.952718 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:10.952718 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:10.952718 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:10.952718 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:10.952718 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:10.952718 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:10.952718 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:10.952718 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:41:10.952718 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:10.958789 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 117/229] 10.222.0.77 () {56 vars in 1114 bytes} [Wed May 11 06:41:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:10.964503 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba70fe3-db9b-43b1-be5a-991d4e2564fa None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:11.016616 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84289af9-652f-4ca9-981e-78ab72d73cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:11.019022 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84289af9-652f-4ca9-981e-78ab72d73cb3 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:11.020173 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84289af9-652f-4ca9-981e-78ab72d73cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:11.021277 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84289af9-652f-4ca9-981e-78ab72d73cb3 None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e/users/1455fae3c532473f93e1b31ea55aa189/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:11.024864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84289af9-652f-4ca9-981e-78ab72d73cb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=138bad15d42d49259cf68f4833e7841e, user_id=1455fae3c532473f93e1b31ea55aa189, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:11.027939 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84289af9-652f-4ca9-981e-78ab72d73cb3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:11.074402 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 113/230] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:41:10 2022] PUT /identity/v3/projects/138bad15d42d49259cf68f4833e7841e/users/1455fae3c532473f93e1b31ea55aa189/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:11.133456 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba70fe3-db9b-43b1-be5a-991d4e2564fa None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:11.194566 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de941ec6-267e-4575-a845-0e4b02ffb9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:11.195370 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de941ec6-267e-4575-a845-0e4b02ffb9ca None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:11.195651 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de941ec6-267e-4575-a845-0e4b02ffb9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:11.197282 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de941ec6-267e-4575-a845-0e4b02ffb9ca None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:11.208007 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de941ec6-267e-4575-a845-0e4b02ffb9ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:11.208333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de941ec6-267e-4575-a845-0e4b02ffb9ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:11.209816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de941ec6-267e-4575-a845-0e4b02ffb9ca None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:11.218705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 118/231] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:41:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:11.226524 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84289af9-652f-4ca9-981e-78ab72d73cb3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:11.469359 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84289af9-652f-4ca9-981e-78ab72d73cb3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:11.514367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7509dd-119d-4236-abeb-89bea9c0606d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:11.515335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7509dd-119d-4236-abeb-89bea9c0606d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:11.515612 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7509dd-119d-4236-abeb-89bea9c0606d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:11.515884 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7509dd-119d-4236-abeb-89bea9c0606d None admin] PATH_INFO: `/v3/users/1455fae3c532473f93e1b31ea55aa189` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:11.517149 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7509dd-119d-4236-abeb-89bea9c0606d None admin] RBAC: Authorizing `identity:get_user(user_id=1455fae3c532473f93e1b31ea55aa189)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:11.518596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7509dd-119d-4236-abeb-89bea9c0606d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:11.522932 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 114/232] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:11 2022] GET /identity/v3/users/1455fae3c532473f93e1b31ea55aa189 => generated 283 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:11.528822 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de941ec6-267e-4575-a845-0e4b02ffb9ca None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:11.640644 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de941ec6-267e-4575-a845-0e4b02ffb9ca None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:11.677351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fd6e4-2529-4b29-a8fc-8da977c987d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:11.678473 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fd6e4-2529-4b29-a8fc-8da977c987d2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:11.678751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fd6e4-2529-4b29-a8fc-8da977c987d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:11.679115 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fd6e4-2529-4b29-a8fc-8da977c987d2 None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:11.680493 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23fd6e4-2529-4b29-a8fc-8da977c987d2 None admin] RBAC: Authorizing `identity:get_project(project_id=138bad15d42d49259cf68f4833e7841e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:11.681950 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23fd6e4-2529-4b29-a8fc-8da977c987d2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:11.688461 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 119/233] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:11 2022] GET /identity/v3/projects/138bad15d42d49259cf68f4833e7841e => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:11.689468 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7509dd-119d-4236-abeb-89bea9c0606d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:11.842384 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7509dd-119d-4236-abeb-89bea9c0606d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:11.891674 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94a1c9-a905-42f9-af56-f4e2e229d716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:11.892587 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94a1c9-a905-42f9-af56-f4e2e229d716 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:11.892869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94a1c9-a905-42f9-af56-f4e2e229d716 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:11.893145 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94a1c9-a905-42f9-af56-f4e2e229d716 None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e/users/1455fae3c532473f93e1b31ea55aa189/roles/ae6b211774c34f47a3ac4853538f62ad` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:11.895466 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94a1c9-a905-42f9-af56-f4e2e229d716 None admin] RBAC: Authorizing `identity:create_grant(project_id=138bad15d42d49259cf68f4833e7841e, user_id=1455fae3c532473f93e1b31ea55aa189, role_id=ae6b211774c34f47a3ac4853538f62ad)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:11.896963 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94a1c9-a905-42f9-af56-f4e2e229d716 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:11.921749 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 115/234] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:41:11 2022] PUT /identity/v3/projects/138bad15d42d49259cf68f4833e7841e/users/1455fae3c532473f93e1b31ea55aa189/roles/ae6b211774c34f47a3ac4853538f62ad => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:12.630171 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e805a48-41f5-4b15-acae-a8b671ec9198 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:12.630667 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e805a48-41f5-4b15-acae-a8b671ec9198 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:12.630667 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e805a48-41f5-4b15-acae-a8b671ec9198 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:12.632387 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 120/235] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:12.637856 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bcd90-a482-4d65-8b3e-9813dfd484a4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:12.638365 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bcd90-a482-4d65-8b3e-9813dfd484a4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:12.638441 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bcd90-a482-4d65-8b3e-9813dfd484a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:12.659160 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b15bcd90-a482-4d65-8b3e-9813dfd484a4 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:12.660355 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b15bcd90-a482-4d65-8b3e-9813dfd484a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:12.756392 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 116/236] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:12.800520 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e805a48-41f5-4b15-acae-a8b671ec9198 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:12.905496 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e805a48-41f5-4b15-acae-a8b671ec9198 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:12.938077 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a7c1c-a2ed-488b-842d-00b84e9bd117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:12.938906 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a7c1c-a2ed-488b-842d-00b84e9bd117 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:12.939204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a7c1c-a2ed-488b-842d-00b84e9bd117 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:12.939478 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a7c1c-a2ed-488b-842d-00b84e9bd117 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:12.950200 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a7c1c-a2ed-488b-842d-00b84e9bd117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:12.957831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-2c3a7c1c-a2ed-488b-842d-00b84e9bd117 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:41:12.957831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:12.957831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:12.957831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:12.957831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:12.957831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:12.957831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:12.957831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:12.957831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:12.957831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:12.957831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:12.957831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:12.957831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:12.957831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:12.957831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:12.957831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:12.958716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:12.958716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:12.958716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:12.958716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:12.958716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:12.958716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:12.958716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:12.958716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:12.958716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:12.958716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:12.958716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:12.958716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:12.958716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:12.958716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:12.958716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:12.958716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:12.959625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:12.959625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:12.959625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:12.959625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:12.959625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:12.959625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:12.959625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:12.959625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:12.959625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:12.959625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:12.959625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:41:12.959625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:12.959625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 121/237] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:12.964935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bcd90-a482-4d65-8b3e-9813dfd484a4 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:13.041377 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852506b-4c86-4822-a71f-8f48d0ce81ac None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:13.041705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852506b-4c86-4822-a71f-8f48d0ce81ac None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:13.041930 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852506b-4c86-4822-a71f-8f48d0ce81ac None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:13.043350 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 122/238] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:41:13.050978 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd967c-2d0f-4398-9369-beec8ade2df7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:13.050978 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd967c-2d0f-4398-9369-beec8ade2df7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:13.050978 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd967c-2d0f-4398-9369-beec8ade2df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:13.067644 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9ccd967c-2d0f-4398-9369-beec8ade2df7 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:13.069114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9ccd967c-2d0f-4398-9369-beec8ade2df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:13.115663 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bcd90-a482-4d65-8b3e-9813dfd484a4 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:13.145580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 123/239] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:41:13.169525 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a6684-224e-4c0b-b52f-99ef8264209d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:13.170134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a6684-224e-4c0b-b52f-99ef8264209d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:13.170412 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a6684-224e-4c0b-b52f-99ef8264209d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:13.170682 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a6684-224e-4c0b-b52f-99ef8264209d None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:13.171459 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a6684-224e-4c0b-b52f-99ef8264209d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:13.171764 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a6684-224e-4c0b-b52f-99ef8264209d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:13.173155 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a6684-224e-4c0b-b52f-99ef8264209d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:13.186702 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 117/240] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:41:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:13.192246 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd967c-2d0f-4398-9369-beec8ade2df7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:13.198089 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a6684-224e-4c0b-b52f-99ef8264209d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:13.298814 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd967c-2d0f-4398-9369-beec8ade2df7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:13.326901 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a6684-224e-4c0b-b52f-99ef8264209d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:13.332473 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebb690-4074-429c-b6f1-4da9271e50c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:13.333569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebb690-4074-429c-b6f1-4da9271e50c1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:13.334027 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebb690-4074-429c-b6f1-4da9271e50c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:13.334436 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebb690-4074-429c-b6f1-4da9271e50c1 None admin] PATH_INFO: `/v3/users/25ca8a36f44d4caa8044c37b7c303a8f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:13.348525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebb690-4074-429c-b6f1-4da9271e50c1 None admin] RBAC: Authorizing `identity:get_user(user_id=25ca8a36f44d4caa8044c37b7c303a8f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:13.350470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebb690-4074-429c-b6f1-4da9271e50c1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:13.352480 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 124/241] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:13 2022] GET /identity/v3/users/25ca8a36f44d4caa8044c37b7c303a8f => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:13.359246 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebb690-4074-429c-b6f1-4da9271e50c1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:13.370765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fe8ce-64c6-4f46-bda3-d9fe86e94a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:13.371660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe8ce-64c6-4f46-bda3-d9fe86e94a53 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:13.371944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe8ce-64c6-4f46-bda3-d9fe86e94a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:13.372220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe8ce-64c6-4f46-bda3-d9fe86e94a53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:13.373582 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fe8ce-64c6-4f46-bda3-d9fe86e94a53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:13.375116 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fe8ce-64c6-4f46-bda3-d9fe86e94a53 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:13.376868 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 118/242] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:13.382596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fe8ce-64c6-4f46-bda3-d9fe86e94a53 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:13.541461 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebb690-4074-429c-b6f1-4da9271e50c1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:13.561233 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fe8ce-64c6-4f46-bda3-d9fe86e94a53 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:13.581616 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf038c2-9ee7-41b3-b8a1-b482c20c92f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:13.582910 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf038c2-9ee7-41b3-b8a1-b482c20c92f3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:13.583383 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf038c2-9ee7-41b3-b8a1-b482c20c92f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:13.583792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf038c2-9ee7-41b3-b8a1-b482c20c92f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:13.594608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebea6f-3454-4d5e-95b9-096e3d4a692b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:13.595315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebea6f-3454-4d5e-95b9-096e3d4a692b None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:13.595598 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebea6f-3454-4d5e-95b9-096e3d4a692b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:13.595872 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebea6f-3454-4d5e-95b9-096e3d4a692b None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:13.596603 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebea6f-3454-4d5e-95b9-096e3d4a692b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:13.598341 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebea6f-3454-4d5e-95b9-096e3d4a692b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:13.630068 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 119/243] 10.222.0.77 () {60 vars in 1132 bytes} [Wed May 11 06:41:13 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:41:13.632408 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001285d9-49e2-4177-b703-1a0ceb43a61d None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:13.632861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001285d9-49e2-4177-b703-1a0ceb43a61d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:13.633572 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001285d9-49e2-4177-b703-1a0ceb43a61d None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:13.643254 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 120/244] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:13.645703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f974bb-e1cd-4c0f-a0bb-6976fe6168ce None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:13.645999 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f974bb-e1cd-4c0f-a0bb-6976fe6168ce None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:13.646277 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f974bb-e1cd-4c0f-a0bb-6976fe6168ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:13.676372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-01f974bb-e1cd-4c0f-a0bb-6976fe6168ce None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:13.677610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-01f974bb-e1cd-4c0f-a0bb-6976fe6168ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:13.708226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf038c2-9ee7-41b3-b8a1-b482c20c92f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:13.709974 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf038c2-9ee7-41b3-b8a1-b482c20c92f3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:13.756905 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 121/245] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:13.793878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f974bb-e1cd-4c0f-a0bb-6976fe6168ce None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:13.912249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 125/246] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:41:13.919880 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf038c2-9ee7-41b3-b8a1-b482c20c92f3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:13.955586 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f974bb-e1cd-4c0f-a0bb-6976fe6168ce None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:13.991680 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a87d2-0f92-443d-85b9-f27d575da3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:13.992489 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a87d2-0f92-443d-85b9-f27d575da3ef None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:13.992763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a87d2-0f92-443d-85b9-f27d575da3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:13.993029 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a87d2-0f92-443d-85b9-f27d575da3ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:14.008710 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a87d2-0f92-443d-85b9-f27d575da3ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:14.018296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-1f0a87d2-0f92-443d-85b9-f27d575da3ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:14.018296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:14.018296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:14.018296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:14.018296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:14.018296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:14.018296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:14.018296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:14.018296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:14.018296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:14.018296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:14.018296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:14.018296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:14.018296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:14.018296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:14.018296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:14.019256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:14.019256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:14.019256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:14.019256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:14.019256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:14.019256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:14.019256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:14.019256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:14.019256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:14.019256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:14.019256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:14.019256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:14.019256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:14.019256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:14.019256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:14.019256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:14.020065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:14.020065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:14.020065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:14.020065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:14.020065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:14.020065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:14.020065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:14.020065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:14.020065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:14.020065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:14.020065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:14.020065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:14.020065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 122/247] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:41:14.023003 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484262a7-34b4-42bf-919c-35b3238985fd None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:14.023003 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484262a7-34b4-42bf-919c-35b3238985fd None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:14.023003 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484262a7-34b4-42bf-919c-35b3238985fd None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:14.024272 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 123/248] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:14.025825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf038c2-9ee7-41b3-b8a1-b482c20c92f3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:14.027809 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484262a7-34b4-42bf-919c-35b3238985fd None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:14.062863 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a34baf-0285-4d89-9b7b-6264c0a1b54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:14.063712 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a34baf-0285-4d89-9b7b-6264c0a1b54a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:14.063994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a34baf-0285-4d89-9b7b-6264c0a1b54a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:14.064268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a34baf-0285-4d89-9b7b-6264c0a1b54a None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:14.065516 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a34baf-0285-4d89-9b7b-6264c0a1b54a None admin] RBAC: Authorizing `identity:get_project(project_id=138bad15d42d49259cf68f4833e7841e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:14.067030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a34baf-0285-4d89-9b7b-6264c0a1b54a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:14.069120 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 126/249] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:13 2022] GET /identity/v3/projects/138bad15d42d49259cf68f4833e7841e => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:14.070309 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d440753-b429-483d-adc5-8d81898d2157 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:14.070596 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d440753-b429-483d-adc5-8d81898d2157 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:14.070871 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d440753-b429-483d-adc5-8d81898d2157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:14.087430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8d440753-b429-483d-adc5-8d81898d2157 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:14.088648 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8d440753-b429-483d-adc5-8d81898d2157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:14.154225 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484262a7-34b4-42bf-919c-35b3238985fd None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:14.177560 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 127/250] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:14.178784 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d440753-b429-483d-adc5-8d81898d2157 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:14.205296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31facd5c-41f2-4bfd-ab1a-c63c8555137b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:14.205970 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31facd5c-41f2-4bfd-ab1a-c63c8555137b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:14.206292 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31facd5c-41f2-4bfd-ab1a-c63c8555137b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:14.206564 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31facd5c-41f2-4bfd-ab1a-c63c8555137b None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:14.207343 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31facd5c-41f2-4bfd-ab1a-c63c8555137b None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:14.207647 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31facd5c-41f2-4bfd-ab1a-c63c8555137b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:14.211373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31facd5c-41f2-4bfd-ab1a-c63c8555137b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:14.226369 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 124/251] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:41:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:14.227661 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31facd5c-41f2-4bfd-ab1a-c63c8555137b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:14.308855 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d440753-b429-483d-adc5-8d81898d2157 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:14.346637 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31facd5c-41f2-4bfd-ab1a-c63c8555137b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:14.352096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ebf7a-ad80-4f93-8a94-94477abad562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:14.353043 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ebf7a-ad80-4f93-8a94-94477abad562 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:14.353521 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ebf7a-ad80-4f93-8a94-94477abad562 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:14.353988 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ebf7a-ad80-4f93-8a94-94477abad562 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:14.355548 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ebf7a-ad80-4f93-8a94-94477abad562 None admin] RBAC: Adding query filter params (role.id=62544860c24f461a83620d4401a9ca0a, scope.project.id=138bad15d42d49259cf68f4833e7841e, user.id=25ca8a36f44d4caa8044c37b7c303a8f) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:14.356092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ebf7a-ad80-4f93-8a94-94477abad562 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:14.358456 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ebf7a-ad80-4f93-8a94-94477abad562 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:14.366507 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 128/252] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:41:14 2022] GET /identity/v3/role_assignments?user.id=25ca8a36f44d4caa8044c37b7c303a8f&scope.project.id=138bad15d42d49259cf68f4833e7841e&role.id=62544860c24f461a83620d4401a9ca0a => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:14.367714 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ebf7a-ad80-4f93-8a94-94477abad562 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:14.415713 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834466d8-6659-47b3-9121-a4129445956c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:14.416546 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834466d8-6659-47b3-9121-a4129445956c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:14.416824 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834466d8-6659-47b3-9121-a4129445956c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:14.417092 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834466d8-6659-47b3-9121-a4129445956c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:14.447934 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834466d8-6659-47b3-9121-a4129445956c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:14.463873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-834466d8-6659-47b3-9121-a4129445956c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:41:14.463873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:14.463873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:14.463873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:14.463873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:14.463873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:14.463873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:14.463873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:14.463873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:14.463873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:14.463873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:14.463873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:14.463873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:14.463873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:14.463873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:14.463873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:14.464869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:14.464869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:14.464869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:14.464869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:14.464869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:14.464869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:14.464869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:14.464869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:14.464869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:14.464869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:14.464869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:14.464869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:14.464869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:14.464869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:14.464869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:14.464869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:14.465686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:14.465686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:14.465686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:14.465686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:14.465686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:14.465686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:14.465686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:14.465686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:14.465686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:14.465686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:14.465686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:41:14.465686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:14.465686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 125/253] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:41:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:14.476987 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834466d8-6659-47b3-9121-a4129445956c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:14.488485 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ebf7a-ad80-4f93-8a94-94477abad562 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:14.525795 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cf06d-a875-4210-b645-ca762115739e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:14.527108 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cf06d-a875-4210-b645-ca762115739e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:14.527587 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cf06d-a875-4210-b645-ca762115739e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:14.528345 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cf06d-a875-4210-b645-ca762115739e None admin] PATH_INFO: `/v3/users/ea1ad53af6ff4fa1a2287cefa844734d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:14.529750 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cf06d-a875-4210-b645-ca762115739e None admin] RBAC: Authorizing `identity:get_user(user_id=ea1ad53af6ff4fa1a2287cefa844734d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:14.532132 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cf06d-a875-4210-b645-ca762115739e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:14.534494 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 129/254] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:14 2022] GET /identity/v3/users/ea1ad53af6ff4fa1a2287cefa844734d => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:14.539910 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cf06d-a875-4210-b645-ca762115739e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:14.691383 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cf06d-a875-4210-b645-ca762115739e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:14.704442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834466d8-6659-47b3-9121-a4129445956c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:14.756503 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8986-4686-4eac-816c-637c25028536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:14.757419 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8986-4686-4eac-816c-637c25028536 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:14.757700 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8986-4686-4eac-816c-637c25028536 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:14.757985 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8986-4686-4eac-816c-637c25028536 None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:14.759310 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c201c-7b63-489a-8aaf-77b8ea972a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:14.760185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c201c-7b63-489a-8aaf-77b8ea972a20 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:14.760605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c201c-7b63-489a-8aaf-77b8ea972a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:14.761015 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c201c-7b63-489a-8aaf-77b8ea972a20 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:14.761936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c201c-7b63-489a-8aaf-77b8ea972a20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:14.762384 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c201c-7b63-489a-8aaf-77b8ea972a20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:14.763867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c8986-4686-4eac-816c-637c25028536 None admin] RBAC: Authorizing `identity:get_project(project_id=138bad15d42d49259cf68f4833e7841e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:14.764150 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c201c-7b63-489a-8aaf-77b8ea972a20 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:14.765364 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c8986-4686-4eac-816c-637c25028536 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:14.767557 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 130/255] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:14 2022] GET /identity/v3/projects/138bad15d42d49259cf68f4833e7841e => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:14.773240 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8986-4686-4eac-816c-637c25028536 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:14.774171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 126/256] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:14.780045 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c201c-7b63-489a-8aaf-77b8ea972a20 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:14.919946 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c201c-7b63-489a-8aaf-77b8ea972a20 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:14.964929 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8986-4686-4eac-816c-637c25028536 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:14.978750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913480a-a726-4946-9490-4a55d077b63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:14.979914 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913480a-a726-4946-9490-4a55d077b63c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:14.980332 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913480a-a726-4946-9490-4a55d077b63c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:14.980737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913480a-a726-4946-9490-4a55d077b63c None admin] PATH_INFO: `/v3/users/1455fae3c532473f93e1b31ea55aa189` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:14.983833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913480a-a726-4946-9490-4a55d077b63c None admin] RBAC: Authorizing `identity:get_user(user_id=1455fae3c532473f93e1b31ea55aa189)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:14.985430 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913480a-a726-4946-9490-4a55d077b63c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:14.987285 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 127/257] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:14 2022] GET /identity/v3/users/1455fae3c532473f93e1b31ea55aa189 => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:14.988824 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0845d89-5ecf-48d5-acb0-94d4c81bbe34 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:14.989300 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0845d89-5ecf-48d5-acb0-94d4c81bbe34 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:14.989778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0845d89-5ecf-48d5-acb0-94d4c81bbe34 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:14.991492 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 128/258] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:14.992878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0845d89-5ecf-48d5-acb0-94d4c81bbe34 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:15.020701 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d67f5f-aa4e-4079-be8c-c697a9412061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:15.021689 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d67f5f-aa4e-4079-be8c-c697a9412061 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:15.021974 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d67f5f-aa4e-4079-be8c-c697a9412061 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:15.022249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d67f5f-aa4e-4079-be8c-c697a9412061 None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e/users/ea1ad53af6ff4fa1a2287cefa844734d/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:15.031013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d67f5f-aa4e-4079-be8c-c697a9412061 None admin] RBAC: Authorizing `identity:create_grant(project_id=138bad15d42d49259cf68f4833e7841e, user_id=ea1ad53af6ff4fa1a2287cefa844734d, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:15.031013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d67f5f-aa4e-4079-be8c-c697a9412061 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:15.051575 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 131/259] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:41:14 2022] PUT /identity/v3/projects/138bad15d42d49259cf68f4833e7841e/users/ea1ad53af6ff4fa1a2287cefa844734d/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:41:15.053181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad2676-e8b8-4a9a-925f-acbb908439a6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:15.053658 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad2676-e8b8-4a9a-925f-acbb908439a6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:15.054099 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad2676-e8b8-4a9a-925f-acbb908439a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:15.086243 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c3ad2676-e8b8-4a9a-925f-acbb908439a6 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:15.088551 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c3ad2676-e8b8-4a9a-925f-acbb908439a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:15.181609 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0845d89-5ecf-48d5-acb0-94d4c81bbe34 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:15.225713 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 132/260] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:15.250505 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e953543-8f38-44d4-8084-8f4bb9f5113e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:15.251601 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e953543-8f38-44d4-8084-8f4bb9f5113e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:15.252059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e953543-8f38-44d4-8084-8f4bb9f5113e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:15.252550 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e953543-8f38-44d4-8084-8f4bb9f5113e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:15.264303 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad2676-e8b8-4a9a-925f-acbb908439a6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:15.373690 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e953543-8f38-44d4-8084-8f4bb9f5113e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:15.375212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e953543-8f38-44d4-8084-8f4bb9f5113e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:15.450380 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad2676-e8b8-4a9a-925f-acbb908439a6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:15.510557 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0e108-1384-404a-b1e1-a1adbbda099e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:15.511328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0e108-1384-404a-b1e1-a1adbbda099e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:15.511612 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0e108-1384-404a-b1e1-a1adbbda099e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:15.511888 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0e108-1384-404a-b1e1-a1adbbda099e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:15.527381 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0e108-1384-404a-b1e1-a1adbbda099e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:15.538997 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 129/261] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 06:41:15.543967 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-68e0e108-1384-404a-b1e1-a1adbbda099e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:41:15.543967 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:15.543967 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:15.543967 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:15.543967 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:15.543967 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:15.543967 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:15.543967 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:15.543967 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:15.543967 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:15.543967 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:15.543967 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:15.543967 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:15.543967 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:15.543967 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:15.543967 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:15.544870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:15.544870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:15.544870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:15.544870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:15.544870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:15.544870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:15.544870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:15.544870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:15.544870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:15.544870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:15.544870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:15.544870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:15.544870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:15.544870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:15.544870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:15.544870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:15.545682 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:15.545682 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:15.545682 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:15.545682 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:15.545682 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:15.545682 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:15.545682 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:15.545682 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:15.545682 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:15.545682 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:15.545682 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:41:15.545682 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:15.546277 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e953543-8f38-44d4-8084-8f4bb9f5113e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:15.547915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 133/262] 10.222.0.77 () {56 vars in 1114 bytes} [Wed May 11 06:41:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:41:15.552945 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0e108-1384-404a-b1e1-a1adbbda099e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:15.672586 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e953543-8f38-44d4-8084-8f4bb9f5113e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:15.731643 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759419b-3dae-4f37-81cd-0567529d2cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:15.733315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759419b-3dae-4f37-81cd-0567529d2cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:15.733808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759419b-3dae-4f37-81cd-0567529d2cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:15.734287 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759419b-3dae-4f37-81cd-0567529d2cc5 None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:15.735737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759419b-3dae-4f37-81cd-0567529d2cc5 None admin] RBAC: Authorizing `identity:get_project(project_id=138bad15d42d49259cf68f4833e7841e)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:15.737419 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759419b-3dae-4f37-81cd-0567529d2cc5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:15.739743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 130/263] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:15 2022] GET /identity/v3/projects/138bad15d42d49259cf68f4833e7841e => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:15.745082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759419b-3dae-4f37-81cd-0567529d2cc5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:15.801763 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0e108-1384-404a-b1e1-a1adbbda099e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:15.885855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759419b-3dae-4f37-81cd-0567529d2cc5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:15.900582 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44a100-e888-4e34-bdbf-ea21ec17e005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:15.901271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44a100-e888-4e34-bdbf-ea21ec17e005 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:15.901549 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44a100-e888-4e34-bdbf-ea21ec17e005 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:15.901821 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44a100-e888-4e34-bdbf-ea21ec17e005 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:15.902575 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44a100-e888-4e34-bdbf-ea21ec17e005 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:15.902878 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44a100-e888-4e34-bdbf-ea21ec17e005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:15.904294 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44a100-e888-4e34-bdbf-ea21ec17e005 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:15.921308 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5ffe2-1efd-48b9-96fc-fcbebc5d5f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:15.922193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 134/264] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:41:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:15.926933 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5ffe2-1efd-48b9-96fc-fcbebc5d5f0d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:15.927342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5ffe2-1efd-48b9-96fc-fcbebc5d5f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:15.927787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5ffe2-1efd-48b9-96fc-fcbebc5d5f0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:15.928771 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5ffe2-1efd-48b9-96fc-fcbebc5d5f0d None admin] RBAC: Adding query filter params (role.id=5debd8ad07a74bedbf2efd53b11cd7cd, scope.project.id=138bad15d42d49259cf68f4833e7841e, user.id=1455fae3c532473f93e1b31ea55aa189) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:15.929179 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5ffe2-1efd-48b9-96fc-fcbebc5d5f0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:15.930727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5ffe2-1efd-48b9-96fc-fcbebc5d5f0d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:15.937780 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 131/265] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:41:15 2022] GET /identity/v3/role_assignments?user.id=1455fae3c532473f93e1b31ea55aa189&scope.project.id=138bad15d42d49259cf68f4833e7841e&role.id=5debd8ad07a74bedbf2efd53b11cd7cd => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:15.939080 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44a100-e888-4e34-bdbf-ea21ec17e005 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:16.056221 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44a100-e888-4e34-bdbf-ea21ec17e005 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:16.090764 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56418f45-10a6-4ff9-a78d-eae1eccce1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:16.091692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56418f45-10a6-4ff9-a78d-eae1eccce1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:16.091971 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56418f45-10a6-4ff9-a78d-eae1eccce1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:16.092243 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56418f45-10a6-4ff9-a78d-eae1eccce1a1 None admin] PATH_INFO: `/v3/users/1455fae3c532473f93e1b31ea55aa189` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:16.093469 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56418f45-10a6-4ff9-a78d-eae1eccce1a1 None admin] RBAC: Authorizing `identity:get_user(user_id=1455fae3c532473f93e1b31ea55aa189)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:16.095056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56418f45-10a6-4ff9-a78d-eae1eccce1a1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:16.096718 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 135/266] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:15 2022] GET /identity/v3/users/1455fae3c532473f93e1b31ea55aa189 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:16.102565 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5ffe2-1efd-48b9-96fc-fcbebc5d5f0d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:16.205192 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5ffe2-1efd-48b9-96fc-fcbebc5d5f0d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:16.238382 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebface-5ca3-48e2-8563-cddea9136235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:16.239066 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebface-5ca3-48e2-8563-cddea9136235 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:16.239345 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebface-5ca3-48e2-8563-cddea9136235 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:16.239614 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebface-5ca3-48e2-8563-cddea9136235 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:16.319846 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ebface-5ca3-48e2-8563-cddea9136235 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:16.321232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ebface-5ca3-48e2-8563-cddea9136235 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:16.422918 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 132/267] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:41:16.424315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56418f45-10a6-4ff9-a78d-eae1eccce1a1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:16.523156 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56418f45-10a6-4ff9-a78d-eae1eccce1a1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:16.555896 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79f36f-7bfa-4cb2-92f6-6886e2d5886d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:16.556769 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79f36f-7bfa-4cb2-92f6-6886e2d5886d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:16.557043 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79f36f-7bfa-4cb2-92f6-6886e2d5886d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:16.557311 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79f36f-7bfa-4cb2-92f6-6886e2d5886d None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:16.558516 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79f36f-7bfa-4cb2-92f6-6886e2d5886d None admin] RBAC: Authorizing `identity:get_project(project_id=138bad15d42d49259cf68f4833e7841e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:16.560022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79f36f-7bfa-4cb2-92f6-6886e2d5886d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:16.562096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 136/268] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:16 2022] GET /identity/v3/projects/138bad15d42d49259cf68f4833e7841e => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:16.568691 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebface-5ca3-48e2-8563-cddea9136235 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:16.683519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebface-5ca3-48e2-8563-cddea9136235 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:16.716987 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bcaf5-6e8a-48a4-81b6-dc98a5310907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:16.717653 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bcaf5-6e8a-48a4-81b6-dc98a5310907 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:16.717931 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bcaf5-6e8a-48a4-81b6-dc98a5310907 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:16.718202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bcaf5-6e8a-48a4-81b6-dc98a5310907 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:16.719067 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5bcaf5-6e8a-48a4-81b6-dc98a5310907 None admin] RBAC: Adding query filter params (role.id=ae6b211774c34f47a3ac4853538f62ad, scope.project.id=138bad15d42d49259cf68f4833e7841e, user.id=1455fae3c532473f93e1b31ea55aa189) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:16.719377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5bcaf5-6e8a-48a4-81b6-dc98a5310907 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:16.720827 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5bcaf5-6e8a-48a4-81b6-dc98a5310907 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:16.726863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 133/269] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:41:16 2022] GET /identity/v3/role_assignments?user.id=1455fae3c532473f93e1b31ea55aa189&scope.project.id=138bad15d42d49259cf68f4833e7841e&role.id=ae6b211774c34f47a3ac4853538f62ad => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:16.837069 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270694f7-c757-4bc1-8ba0-8fb508705079 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:16.837580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270694f7-c757-4bc1-8ba0-8fb508705079 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:16.837806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270694f7-c757-4bc1-8ba0-8fb508705079 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:16.839844 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 137/270] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:16.845031 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e408d0b-f5ac-4f2b-9d45-6b2e46b4a8a0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:16.845601 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e408d0b-f5ac-4f2b-9d45-6b2e46b4a8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:16.845601 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e408d0b-f5ac-4f2b-9d45-6b2e46b4a8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:16.868292 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3e408d0b-f5ac-4f2b-9d45-6b2e46b4a8a0 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:16.869520 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3e408d0b-f5ac-4f2b-9d45-6b2e46b4a8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:16.945277 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 134/271] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:16.969411 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270694f7-c757-4bc1-8ba0-8fb508705079 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:17.073446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270694f7-c757-4bc1-8ba0-8fb508705079 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:17.108978 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687445f-d81c-49e1-b952-eb671ae988d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:17.109869 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687445f-d81c-49e1-b952-eb671ae988d2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:17.110151 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687445f-d81c-49e1-b952-eb671ae988d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:17.110420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687445f-d81c-49e1-b952-eb671ae988d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.123251 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687445f-d81c-49e1-b952-eb671ae988d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:17.131428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b687445f-d81c-49e1-b952-eb671ae988d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:17.131428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:17.131428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:17.131428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:17.131428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:17.131428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:17.131428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:17.131428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:17.131428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:17.131428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:17.131428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:17.131428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:17.131428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:17.131428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:17.131428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:17.131428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:17.132403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:17.132403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:17.132403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:17.132403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:17.132403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:17.132403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:17.132403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:17.132403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:17.132403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:17.132403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:17.132403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:17.132403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:17.132403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:17.132403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:17.132403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:17.132403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:17.133684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:17.133684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:17.133684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:17.133684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:17.133684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:17.133684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:17.133684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:17.133684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:17.133684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:17.133684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:17.133684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:17.133684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:17.133684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 138/272] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:17.138945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e408d0b-f5ac-4f2b-9d45-6b2e46b4a8a0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:17.252451 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e408d0b-f5ac-4f2b-9d45-6b2e46b4a8a0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:17.296076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c33c67-1197-4748-a4d6-ac0fa64f8428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:17.296076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c33c67-1197-4748-a4d6-ac0fa64f8428 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:17.296365 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c33c67-1197-4748-a4d6-ac0fa64f8428 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:17.298978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c33c67-1197-4748-a4d6-ac0fa64f8428 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.298978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c33c67-1197-4748-a4d6-ac0fa64f8428 None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:17.298978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c33c67-1197-4748-a4d6-ac0fa64f8428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:17.299203 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c33c67-1197-4748-a4d6-ac0fa64f8428 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:17.313207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 135/273] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:41:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:17.318764 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687445f-d81c-49e1-b952-eb671ae988d2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:17.326971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40325a8d-092d-402b-b0e4-4ccaf330ac01 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:17.327295 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40325a8d-092d-402b-b0e4-4ccaf330ac01 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:17.327613 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40325a8d-092d-402b-b0e4-4ccaf330ac01 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.328976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 136/274] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:41:17.334143 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e4226-e852-4aa2-a821-6c3c231ac610 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:17.334435 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e4226-e852-4aa2-a821-6c3c231ac610 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:17.334712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e4226-e852-4aa2-a821-6c3c231ac610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.351179 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d87e4226-e852-4aa2-a821-6c3c231ac610 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:17.352383 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d87e4226-e852-4aa2-a821-6c3c231ac610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:17.418075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 137/275] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:41:17.442767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e4226-e852-4aa2-a821-6c3c231ac610 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:17.460007 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687445f-d81c-49e1-b952-eb671ae988d2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:17.502012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe1c01-cc57-4a96-a7b0-467b288ced9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:17.503748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe1c01-cc57-4a96-a7b0-467b288ced9c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:17.504209 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe1c01-cc57-4a96-a7b0-467b288ced9c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:17.504671 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe1c01-cc57-4a96-a7b0-467b288ced9c None admin] PATH_INFO: `/v3/users/cafc4c50938c4a33adf0e2c0dd26137c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.521244 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe1c01-cc57-4a96-a7b0-467b288ced9c None admin] RBAC: Authorizing `identity:get_user(user_id=cafc4c50938c4a33adf0e2c0dd26137c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:17.523821 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe1c01-cc57-4a96-a7b0-467b288ced9c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:17.527145 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 139/276] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:17 2022] GET /identity/v3/users/cafc4c50938c4a33adf0e2c0dd26137c => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:17.540302 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe1c01-cc57-4a96-a7b0-467b288ced9c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:17.556252 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e4226-e852-4aa2-a821-6c3c231ac610 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:17.598652 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c9fd2-c0eb-4dac-88a6-8968795d2cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:17.599564 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c9fd2-c0eb-4dac-88a6-8968795d2cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:17.600002 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c9fd2-c0eb-4dac-88a6-8968795d2cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:17.600292 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c9fd2-c0eb-4dac-88a6-8968795d2cc8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.602167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c9fd2-c0eb-4dac-88a6-8968795d2cc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:17.604190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c9fd2-c0eb-4dac-88a6-8968795d2cc8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:17.606194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 138/277] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:17.611557 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c9fd2-c0eb-4dac-88a6-8968795d2cc8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:17.656405 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe1c01-cc57-4a96-a7b0-467b288ced9c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:17.689998 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a044c0-ac25-408a-a300-8b85557e89b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:17.690666 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a044c0-ac25-408a-a300-8b85557e89b2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:17.690946 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a044c0-ac25-408a-a300-8b85557e89b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:17.691255 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a044c0-ac25-408a-a300-8b85557e89b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.692093 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a044c0-ac25-408a-a300-8b85557e89b2 None admin] RBAC: Adding query filter params (role.id=f8d42be71f034e1a88784699c04e7a89, user.id=cafc4c50938c4a33adf0e2c0dd26137c, scope.system=all) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:17.692407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a044c0-ac25-408a-a300-8b85557e89b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:17.694046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a044c0-ac25-408a-a300-8b85557e89b2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:17.706446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 140/278] 10.222.0.77 () {56 vars in 1308 bytes} [Wed May 11 06:41:17 2022] GET /identity/v3/role_assignments?user.id=cafc4c50938c4a33adf0e2c0dd26137c&scope.system=all&role.id=f8d42be71f034e1a88784699c04e7a89 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:17.706446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23acf5-9abe-4418-907a-7130e469f275 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:17.706446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23acf5-9abe-4418-907a-7130e469f275 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:17.706446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23acf5-9abe-4418-907a-7130e469f275 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.706446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 141/279] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:17.709010 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96e498-aa99-4459-87a5-e0a1d2205904 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:17.709304 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96e498-aa99-4459-87a5-e0a1d2205904 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:17.709585 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96e498-aa99-4459-87a5-e0a1d2205904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.720751 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c9fd2-c0eb-4dac-88a6-8968795d2cc8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:17.728972 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4c96e498-aa99-4459-87a5-e0a1d2205904 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:17.730882 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4c96e498-aa99-4459-87a5-e0a1d2205904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:17.757367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69983a79-4245-49fa-9bc2-6c0555873644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:17.757990 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69983a79-4245-49fa-9bc2-6c0555873644 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:17.758269 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69983a79-4245-49fa-9bc2-6c0555873644 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:17.758545 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69983a79-4245-49fa-9bc2-6c0555873644 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.759316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69983a79-4245-49fa-9bc2-6c0555873644 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:17.760893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69983a79-4245-49fa-9bc2-6c0555873644 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:17.784089 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 139/280] 10.222.0.77 () {60 vars in 1132 bytes} [Wed May 11 06:41:17 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:41:17.819940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 142/281] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:41:17.843129 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69983a79-4245-49fa-9bc2-6c0555873644 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:17.968697 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69983a79-4245-49fa-9bc2-6c0555873644 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:18.006366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff1e4a-55cd-48e7-9d75-e4e2c216416d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:18.007212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff1e4a-55cd-48e7-9d75-e4e2c216416d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:18.007558 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff1e4a-55cd-48e7-9d75-e4e2c216416d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:18.007770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff1e4a-55cd-48e7-9d75-e4e2c216416d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:18.018409 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff1e4a-55cd-48e7-9d75-e4e2c216416d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:18.026373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-ceff1e4a-55cd-48e7-9d75-e4e2c216416d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:41:18.026373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:18.026373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:18.026373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:18.026373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:18.026373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:18.026373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:18.026373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:18.026373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:18.026373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:18.026373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:18.026373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:18.026373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:18.026373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:18.026373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:18.026373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:18.027293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:18.027293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:18.027293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:18.027293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:18.027293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:18.027293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:18.027293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:18.027293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:18.027293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:18.027293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:18.027293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:18.027293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:18.027293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:18.027293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:18.027293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:18.027293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:18.028141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:18.028141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:18.028141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:18.028141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:18.028141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:18.028141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:18.028141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:18.028141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:18.028141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:18.028141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:18.028141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:41:18.028141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:18.028141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 140/282] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:18.034906 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96e498-aa99-4459-87a5-e0a1d2205904 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:18.138331 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96e498-aa99-4459-87a5-e0a1d2205904 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:18.144981 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9c8c6-10a7-4719-a4ca-2faf92249d5c None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:18.145575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9c8c6-10a7-4719-a4ca-2faf92249d5c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:18.146334 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9c8c6-10a7-4719-a4ca-2faf92249d5c None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:18.148916 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 141/283] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:41:18.154650 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96abf97-c466-4a78-ac69-3ebcdf0f9f9f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:18.154650 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96abf97-c466-4a78-ac69-3ebcdf0f9f9f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:18.154998 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96abf97-c466-4a78-ac69-3ebcdf0f9f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:18.174903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f96abf97-c466-4a78-ac69-3ebcdf0f9f9f None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:18.176135 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f96abf97-c466-4a78-ac69-3ebcdf0f9f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:18.180127 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d9489-b8d7-48b2-81db-3843c389ca22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:18.181039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d9489-b8d7-48b2-81db-3843c389ca22 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:18.181474 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d9489-b8d7-48b2-81db-3843c389ca22 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:18.181895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d9489-b8d7-48b2-81db-3843c389ca22 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:18.182787 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d9489-b8d7-48b2-81db-3843c389ca22 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:18.183422 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d9489-b8d7-48b2-81db-3843c389ca22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:18.184968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d9489-b8d7-48b2-81db-3843c389ca22 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:18.196220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 143/284] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:41:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:18.202312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d9489-b8d7-48b2-81db-3843c389ca22 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:18.259234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 142/285] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:18.308089 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96abf97-c466-4a78-ac69-3ebcdf0f9f9f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:18.333094 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d9489-b8d7-48b2-81db-3843c389ca22 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:18.367735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294ba6f-68a8-4083-9d4a-92d699d3102a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:18.368686 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294ba6f-68a8-4083-9d4a-92d699d3102a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:18.368964 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294ba6f-68a8-4083-9d4a-92d699d3102a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:18.369237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294ba6f-68a8-4083-9d4a-92d699d3102a None admin] PATH_INFO: `/v3/users/25ca8a36f44d4caa8044c37b7c303a8f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:18.370552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294ba6f-68a8-4083-9d4a-92d699d3102a None admin] RBAC: Authorizing `identity:get_user(user_id=25ca8a36f44d4caa8044c37b7c303a8f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:18.372099 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294ba6f-68a8-4083-9d4a-92d699d3102a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:18.373768 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 144/286] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:18 2022] GET /identity/v3/users/25ca8a36f44d4caa8044c37b7c303a8f => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:18.379203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294ba6f-68a8-4083-9d4a-92d699d3102a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:18.478535 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294ba6f-68a8-4083-9d4a-92d699d3102a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:18.519163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cd9ee-dd89-4002-bfc0-9bd97354555e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:18.520006 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cd9ee-dd89-4002-bfc0-9bd97354555e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:18.520287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cd9ee-dd89-4002-bfc0-9bd97354555e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:18.520557 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cd9ee-dd89-4002-bfc0-9bd97354555e None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:18.522703 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cd9ee-dd89-4002-bfc0-9bd97354555e None admin] RBAC: Authorizing `identity:get_project(project_id=138bad15d42d49259cf68f4833e7841e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:18.524203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cd9ee-dd89-4002-bfc0-9bd97354555e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:18.526151 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 145/287] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:18 2022] GET /identity/v3/projects/138bad15d42d49259cf68f4833e7841e => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:18.531655 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cd9ee-dd89-4002-bfc0-9bd97354555e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:18.546126 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96abf97-c466-4a78-ac69-3ebcdf0f9f9f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:18.590819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdede0e-49b1-4af7-a9ac-60bc074e21f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:18.591663 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdede0e-49b1-4af7-a9ac-60bc074e21f9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:18.591938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdede0e-49b1-4af7-a9ac-60bc074e21f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:18.592210 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdede0e-49b1-4af7-a9ac-60bc074e21f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:18.612322 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdede0e-49b1-4af7-a9ac-60bc074e21f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:18.628184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-2cdede0e-49b1-4af7-a9ac-60bc074e21f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:18.628184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:18.628184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:18.628184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:18.628184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:18.628184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:18.628184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:18.628184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:18.628184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:18.628184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:18.628184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:18.628184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:18.628184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:18.628184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:18.628184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:18.628184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:18.629108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:18.629108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:18.629108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:18.629108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:18.629108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:18.629108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:18.629108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:18.629108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:18.629108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:18.629108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:18.629108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:18.629108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:18.629108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:18.629108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:18.629108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:18.629108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:18.630683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:18.630683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:18.630683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:18.630683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:18.630683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:18.630683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:18.630683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:18.630683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:18.630683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:18.630683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:18.630683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:18.630683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:18.630683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 143/288] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:18.632465 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cd9ee-dd89-4002-bfc0-9bd97354555e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:18.646234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdede0e-49b1-4af7-a9ac-60bc074e21f9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:18.670768 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801cbd3-a16f-4c4d-986d-b8c093a6fb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:18.671767 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801cbd3-a16f-4c4d-986d-b8c093a6fb4f None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:18.672048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801cbd3-a16f-4c4d-986d-b8c093a6fb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:18.672326 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801cbd3-a16f-4c4d-986d-b8c093a6fb4f None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e/users/25ca8a36f44d4caa8044c37b7c303a8f/roles/62544860c24f461a83620d4401a9ca0a` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:18.674513 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801cbd3-a16f-4c4d-986d-b8c093a6fb4f None admin] RBAC: Authorizing `identity:create_grant(project_id=138bad15d42d49259cf68f4833e7841e, user_id=25ca8a36f44d4caa8044c37b7c303a8f, role_id=62544860c24f461a83620d4401a9ca0a)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:18.676162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801cbd3-a16f-4c4d-986d-b8c093a6fb4f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:18.691930 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 146/289] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:41:18 2022] PUT /identity/v3/projects/138bad15d42d49259cf68f4833e7841e/users/25ca8a36f44d4caa8044c37b7c303a8f/roles/62544860c24f461a83620d4401a9ca0a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:41:18.836982 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdede0e-49b1-4af7-a9ac-60bc074e21f9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:18.887736 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb2492-4728-4c64-af61-8704da07abed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:18.888434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb2492-4728-4c64-af61-8704da07abed None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:18.888714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb2492-4728-4c64-af61-8704da07abed None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:18.888994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb2492-4728-4c64-af61-8704da07abed None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:18.889755 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb2492-4728-4c64-af61-8704da07abed None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:18.890060 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb2492-4728-4c64-af61-8704da07abed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:18.891504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb2492-4728-4c64-af61-8704da07abed None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:18.900860 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 144/290] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:41:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:18.906648 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801cbd3-a16f-4c4d-986d-b8c093a6fb4f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:19.017314 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801cbd3-a16f-4c4d-986d-b8c093a6fb4f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:19.051012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe12b4-2c48-4ad3-95aa-7253d0847094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:19.051957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe12b4-2c48-4ad3-95aa-7253d0847094 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:19.052288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe12b4-2c48-4ad3-95aa-7253d0847094 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:19.052567 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe12b4-2c48-4ad3-95aa-7253d0847094 None admin] PATH_INFO: `/v3/users/ea1ad53af6ff4fa1a2287cefa844734d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:19.053857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe12b4-2c48-4ad3-95aa-7253d0847094 None admin] RBAC: Authorizing `identity:get_user(user_id=ea1ad53af6ff4fa1a2287cefa844734d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:19.055635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe12b4-2c48-4ad3-95aa-7253d0847094 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:19.057577 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 147/291] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:18 2022] GET /identity/v3/users/ea1ad53af6ff4fa1a2287cefa844734d => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:19.063142 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb2492-4728-4c64-af61-8704da07abed None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:19.174125 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb2492-4728-4c64-af61-8704da07abed None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:19.226797 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24811b-31a4-4c98-88a8-6ec36eb29360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:19.227481 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24811b-31a4-4c98-88a8-6ec36eb29360 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:19.227761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24811b-31a4-4c98-88a8-6ec36eb29360 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:19.228037 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24811b-31a4-4c98-88a8-6ec36eb29360 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:19.330333 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24811b-31a4-4c98-88a8-6ec36eb29360 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:19.331826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24811b-31a4-4c98-88a8-6ec36eb29360 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:19.464791 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 145/292] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:41:19.470367 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe12b4-2c48-4ad3-95aa-7253d0847094 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:19.602330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe12b4-2c48-4ad3-95aa-7253d0847094 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:19.643423 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da549b53-a321-46aa-9e2b-58a9b8b3cacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:19.644300 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da549b53-a321-46aa-9e2b-58a9b8b3cacc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:19.644575 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da549b53-a321-46aa-9e2b-58a9b8b3cacc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:19.644844 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da549b53-a321-46aa-9e2b-58a9b8b3cacc None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:19.651842 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da549b53-a321-46aa-9e2b-58a9b8b3cacc None admin] RBAC: Authorizing `identity:get_project(project_id=138bad15d42d49259cf68f4833e7841e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:19.653365 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da549b53-a321-46aa-9e2b-58a9b8b3cacc None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:19.655644 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 148/293] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:19 2022] GET /identity/v3/projects/138bad15d42d49259cf68f4833e7841e => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:19.661503 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24811b-31a4-4c98-88a8-6ec36eb29360 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:19.818180 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24811b-31a4-4c98-88a8-6ec36eb29360 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:19.861902 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc05b4a-0ab2-40ae-9114-224f55091457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:19.862561 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc05b4a-0ab2-40ae-9114-224f55091457 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:19.862838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc05b4a-0ab2-40ae-9114-224f55091457 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:19.863128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc05b4a-0ab2-40ae-9114-224f55091457 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:19.863964 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc05b4a-0ab2-40ae-9114-224f55091457 None admin] RBAC: Adding query filter params (role.id=f8d42be71f034e1a88784699c04e7a89, scope.project.id=138bad15d42d49259cf68f4833e7841e, user.id=ea1ad53af6ff4fa1a2287cefa844734d) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:19.864270 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc05b4a-0ab2-40ae-9114-224f55091457 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:19.865736 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc05b4a-0ab2-40ae-9114-224f55091457 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:19.875522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 146/294] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:41:19 2022] GET /identity/v3/role_assignments?user.id=ea1ad53af6ff4fa1a2287cefa844734d&scope.project.id=138bad15d42d49259cf68f4833e7841e&role.id=f8d42be71f034e1a88784699c04e7a89 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:20.257848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998399ae-cd3a-43c3-a33d-0f505f69e2a4 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:20.258362 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998399ae-cd3a-43c3-a33d-0f505f69e2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:20.258437 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998399ae-cd3a-43c3-a33d-0f505f69e2a4 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:20.259799 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 149/295] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:20.265676 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5436c-de3b-4ca0-9494-404378878ce8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:20.266500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5436c-de3b-4ca0-9494-404378878ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:20.266996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5436c-de3b-4ca0-9494-404378878ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:20.287450 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-cda5436c-de3b-4ca0-9494-404378878ce8 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:20.288990 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cda5436c-de3b-4ca0-9494-404378878ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:20.364916 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 147/296] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:20.387139 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998399ae-cd3a-43c3-a33d-0f505f69e2a4 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:20.492686 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998399ae-cd3a-43c3-a33d-0f505f69e2a4 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:20.529495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8276f79-9c5e-4bf6-a55a-af8b7b8d1316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:20.530692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8276f79-9c5e-4bf6-a55a-af8b7b8d1316 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:20.531202 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8276f79-9c5e-4bf6-a55a-af8b7b8d1316 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:20.531667 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8276f79-9c5e-4bf6-a55a-af8b7b8d1316 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:20.544130 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8276f79-9c5e-4bf6-a55a-af8b7b8d1316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:20.552413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-d8276f79-9c5e-4bf6-a55a-af8b7b8d1316 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:20.552413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:20.552413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:20.552413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:20.552413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:20.552413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:20.552413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:20.552413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:20.552413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:20.552413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:20.552413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:20.552413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:20.552413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:20.552413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:20.552413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:20.552413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:20.553457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:20.553457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:20.553457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:20.553457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:20.553457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:20.553457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:20.553457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:20.553457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:20.553457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:20.553457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:20.553457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:20.553457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:20.553457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:20.553457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:20.553457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:20.553457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:20.554259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:20.554259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:20.554259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:20.554259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:20.554259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:20.554259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:20.554259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:20.554259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:20.554259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:20.554259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:20.554259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:20.554259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:20.561530 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 150/297] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:20.563161 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5436c-de3b-4ca0-9494-404378878ce8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:20.663471 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5436c-de3b-4ca0-9494-404378878ce8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:20.701163 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c2d1e-db9e-4c5a-acc5-7ee6c4647942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:20.701843 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c2d1e-db9e-4c5a-acc5-7ee6c4647942 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:20.702120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c2d1e-db9e-4c5a-acc5-7ee6c4647942 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:20.702388 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c2d1e-db9e-4c5a-acc5-7ee6c4647942 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:20.703165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c2d1e-db9e-4c5a-acc5-7ee6c4647942 None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:20.703467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c2d1e-db9e-4c5a-acc5-7ee6c4647942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:20.704849 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c2d1e-db9e-4c5a-acc5-7ee6c4647942 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:20.713278 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 148/298] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:41:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:20.719278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8276f79-9c5e-4bf6-a55a-af8b7b8d1316 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:20.739124 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339153f-83f6-4f0f-bdbc-9afe1b750a90 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:20.739419 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339153f-83f6-4f0f-bdbc-9afe1b750a90 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:20.739620 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339153f-83f6-4f0f-bdbc-9afe1b750a90 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:20.741248 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 149/299] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:20.746364 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c90dc6-8565-4728-9553-11c073c44162 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:20.746909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c90dc6-8565-4728-9553-11c073c44162 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:20.746909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c90dc6-8565-4728-9553-11c073c44162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:20.763662 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-18c90dc6-8565-4728-9553-11c073c44162 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:20.765073 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-18c90dc6-8565-4728-9553-11c073c44162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:20.822609 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8276f79-9c5e-4bf6-a55a-af8b7b8d1316 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:20.837540 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 150/300] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:20.837540 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21138f5e-ce8e-4ac5-b0eb-9a143dbac90a None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:20.837540 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21138f5e-ce8e-4ac5-b0eb-9a143dbac90a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:20.837540 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21138f5e-ce8e-4ac5-b0eb-9a143dbac90a None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:20.837540 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 151/301] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:20.842684 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe970852-065d-4cb4-8642-40b537a4d0e3 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:20.842982 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe970852-065d-4cb4-8642-40b537a4d0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:20.843267 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe970852-065d-4cb4-8642-40b537a4d0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:20.859261 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aae865-ba5c-4570-a0a6-21d08c01ed3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:20.859848 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fe970852-065d-4cb4-8642-40b537a4d0e3 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:20.860151 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aae865-ba5c-4570-a0a6-21d08c01ed3d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:20.860432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aae865-ba5c-4570-a0a6-21d08c01ed3d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:20.860708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aae865-ba5c-4570-a0a6-21d08c01ed3d None admin] PATH_INFO: `/v3/users/cafc4c50938c4a33adf0e2c0dd26137c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:20.861021 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fe970852-065d-4cb4-8642-40b537a4d0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:20.861900 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aae865-ba5c-4570-a0a6-21d08c01ed3d None admin] RBAC: Authorizing `identity:get_user(user_id=cafc4c50938c4a33adf0e2c0dd26137c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:20.864331 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aae865-ba5c-4570-a0a6-21d08c01ed3d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:20.867120 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 151/302] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:20 2022] GET /identity/v3/users/cafc4c50938c4a33adf0e2c0dd26137c => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:20.867120 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aae865-ba5c-4570-a0a6-21d08c01ed3d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:20.925772 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 152/303] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:41:20.927040 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe970852-065d-4cb4-8642-40b537a4d0e3 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:20.975364 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aae865-ba5c-4570-a0a6-21d08c01ed3d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:21.007862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cb581-287b-4312-a4a5-a018dcc53ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:21.008667 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cb581-287b-4312-a4a5-a018dcc53ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:21.008939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cb581-287b-4312-a4a5-a018dcc53ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:21.009216 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cb581-287b-4312-a4a5-a018dcc53ee8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:21.019432 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe970852-065d-4cb4-8642-40b537a4d0e3 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:21.020564 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cb581-287b-4312-a4a5-a018dcc53ee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:21.030407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b98cb581-287b-4312-a4a5-a018dcc53ee8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:41:21.030407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:21.030407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:21.030407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:21.030407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:21.030407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:21.030407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:21.030407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:21.030407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:21.030407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:21.030407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:21.030407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:21.030407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:21.030407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:21.030407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:21.030407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:21.031347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:21.031347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:21.031347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:21.031347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:21.031347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:21.031347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:21.031347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:21.031347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:21.031347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:21.031347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:21.031347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:21.031347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:21.031347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:21.031347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:21.031347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:21.031347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:21.032176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:21.032176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:21.032176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:21.032176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:21.032176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:21.032176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:21.032176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:21.032176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:21.032176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:21.032176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:21.032176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:41:21.032176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:21.032176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 152/304] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:21.033592 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cb581-287b-4312-a4a5-a018dcc53ee8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:21.055303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd05258-1e2e-4134-99e8-3bb014ddefc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:21.056203 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd05258-1e2e-4134-99e8-3bb014ddefc3 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:21.056477 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd05258-1e2e-4134-99e8-3bb014ddefc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:21.056752 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd05258-1e2e-4134-99e8-3bb014ddefc3 None admin] PATH_INFO: `/v3/system/users/cafc4c50938c4a33adf0e2c0dd26137c/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:21.058338 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd05258-1e2e-4134-99e8-3bb014ddefc3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cafc4c50938c4a33adf0e2c0dd26137c, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:21.059796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd05258-1e2e-4134-99e8-3bb014ddefc3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:21.071153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 153/305] 10.222.0.77 () {58 vars in 1334 bytes} [Wed May 11 06:41:20 2022] PUT /identity/v3/system/users/cafc4c50938c4a33adf0e2c0dd26137c/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:21.072281 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd05258-1e2e-4134-99e8-3bb014ddefc3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:21.179122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cb581-287b-4312-a4a5-a018dcc53ee8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:21.201906 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd05258-1e2e-4134-99e8-3bb014ddefc3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:21.219674 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50070b-1f24-4ed4-a001-864be60fc8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:21.220541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50070b-1f24-4ed4-a001-864be60fc8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:21.220824 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50070b-1f24-4ed4-a001-864be60fc8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:21.221100 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50070b-1f24-4ed4-a001-864be60fc8a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:21.222362 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50070b-1f24-4ed4-a001-864be60fc8a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:21.223954 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50070b-1f24-4ed4-a001-864be60fc8a5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:21.225703 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 153/306] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:21.231786 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50070b-1f24-4ed4-a001-864be60fc8a5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:21.244190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c90314-bd25-4829-bdd3-7c79deaa8b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:21.244938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c90314-bd25-4829-bdd3-7c79deaa8b53 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:21.245222 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c90314-bd25-4829-bdd3-7c79deaa8b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:21.245495 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c90314-bd25-4829-bdd3-7c79deaa8b53 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:21.246256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c90314-bd25-4829-bdd3-7c79deaa8b53 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:21.246562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c90314-bd25-4829-bdd3-7c79deaa8b53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:21.248036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c90314-bd25-4829-bdd3-7c79deaa8b53 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:21.257548 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 154/307] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:41:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:21.258925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3288a93-f8c9-433e-92ac-eb541f97ed95 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:21.259253 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3288a93-f8c9-433e-92ac-eb541f97ed95 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:21.259527 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3288a93-f8c9-433e-92ac-eb541f97ed95 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:21.260931 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 155/308] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:21.265862 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3288a93-f8c9-433e-92ac-eb541f97ed95 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:21.352686 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50070b-1f24-4ed4-a001-864be60fc8a5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:21.371172 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3288a93-f8c9-433e-92ac-eb541f97ed95 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:21.384460 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fffdb8-5317-4418-9d38-d79151af0895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:21.385144 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fffdb8-5317-4418-9d38-d79151af0895 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:21.385423 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fffdb8-5317-4418-9d38-d79151af0895 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:21.385692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fffdb8-5317-4418-9d38-d79151af0895 None admin] PATH_INFO: `/v3/groups` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:21.386380 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fffdb8-5317-4418-9d38-d79151af0895 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:21.387842 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fffdb8-5317-4418-9d38-d79151af0895 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:21.411350 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 154/309] 10.222.0.77 () {60 vars in 1134 bytes} [Wed May 11 06:41:21 2022] POST /identity/v3/groups => generated 229 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:41:21.411350 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3be53c-e59e-4020-9f50-7097fc83862f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:21.411350 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3be53c-e59e-4020-9f50-7097fc83862f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:21.411350 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3be53c-e59e-4020-9f50-7097fc83862f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:21.413680 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac3931-9acf-4600-9360-176988180907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:21.414765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac3931-9acf-4600-9360-176988180907 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:21.415183 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac3931-9acf-4600-9360-176988180907 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:21.415522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac3931-9acf-4600-9360-176988180907 None admin] PATH_INFO: `/v3/users/8738c3e7b1f54cdfb1ab9d3d7c422b17` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:21.428907 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8f3be53c-e59e-4020-9f50-7097fc83862f None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:21.430485 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8f3be53c-e59e-4020-9f50-7097fc83862f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:21.445964 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac3931-9acf-4600-9360-176988180907 None admin] RBAC: Authorizing `identity:get_user(user_id=8738c3e7b1f54cdfb1ab9d3d7c422b17)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:21.448522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac3931-9acf-4600-9360-176988180907 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:21.450148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 156/310] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:21 2022] GET /identity/v3/users/8738c3e7b1f54cdfb1ab9d3d7c422b17 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:21.456544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac3931-9acf-4600-9360-176988180907 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:21.506256 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 155/311] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:21.530335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3be53c-e59e-4020-9f50-7097fc83862f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:21.589537 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac3931-9acf-4600-9360-176988180907 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:21.637986 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab00b47-bef2-4d6c-9f89-266180788ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:21.638644 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab00b47-bef2-4d6c-9f89-266180788ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:21.638919 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab00b47-bef2-4d6c-9f89-266180788ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:21.639220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab00b47-bef2-4d6c-9f89-266180788ba5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:21.640053 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab00b47-bef2-4d6c-9f89-266180788ba5 None admin] RBAC: Adding query filter params (role.id=62544860c24f461a83620d4401a9ca0a, user.id=8738c3e7b1f54cdfb1ab9d3d7c422b17, scope.system=all) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:21.640358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab00b47-bef2-4d6c-9f89-266180788ba5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:21.641796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab00b47-bef2-4d6c-9f89-266180788ba5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:21.647387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 157/312] 10.222.0.77 () {56 vars in 1308 bytes} [Wed May 11 06:41:21 2022] GET /identity/v3/role_assignments?user.id=8738c3e7b1f54cdfb1ab9d3d7c422b17&scope.system=all&role.id=62544860c24f461a83620d4401a9ca0a => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:21.656961 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3be53c-e59e-4020-9f50-7097fc83862f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:21.697673 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285333f-0545-4b2a-96be-20ca22e491a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:21.698877 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285333f-0545-4b2a-96be-20ca22e491a3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:21.699396 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285333f-0545-4b2a-96be-20ca22e491a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:21.699862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285333f-0545-4b2a-96be-20ca22e491a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:21.711753 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285333f-0545-4b2a-96be-20ca22e491a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:21.720348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-1285333f-0545-4b2a-96be-20ca22e491a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:41:21.720348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:21.720348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:21.720348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:21.720348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:21.720348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:21.720348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:21.720348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:21.720348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:21.720348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:21.720348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:21.720348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:21.720348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:21.720348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:21.720348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:21.720348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:21.721318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:21.721318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:21.721318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:21.721318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:21.721318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:21.721318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:21.721318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:21.721318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:21.721318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:21.721318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:21.721318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:21.721318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:21.721318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:21.721318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:21.721318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:21.721318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:21.722170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:21.722170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:21.722170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:21.722170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:21.722170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:21.722170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:21.722170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:21.722170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:21.722170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:21.722170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:21.722170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:41:21.722170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:21.724907 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 156/313] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:21.732151 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab00b47-bef2-4d6c-9f89-266180788ba5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:21.837362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab00b47-bef2-4d6c-9f89-266180788ba5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:21.871422 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c9352-93e0-4a1c-b7a6-6130a9d95c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:21.872101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c9352-93e0-4a1c-b7a6-6130a9d95c82 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:21.872374 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c9352-93e0-4a1c-b7a6-6130a9d95c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:21.872642 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c9352-93e0-4a1c-b7a6-6130a9d95c82 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:21.873390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c9352-93e0-4a1c-b7a6-6130a9d95c82 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:21.873690 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c9352-93e0-4a1c-b7a6-6130a9d95c82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:21.875083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c9352-93e0-4a1c-b7a6-6130a9d95c82 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:21.883667 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 158/314] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:41:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:21.888829 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285333f-0545-4b2a-96be-20ca22e491a3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:21.992607 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285333f-0545-4b2a-96be-20ca22e491a3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:22.025174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8029a-975a-422f-b014-2454ab0ba80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:22.026051 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8029a-975a-422f-b014-2454ab0ba80d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:22.026327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8029a-975a-422f-b014-2454ab0ba80d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:22.026596 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8029a-975a-422f-b014-2454ab0ba80d None admin] PATH_INFO: `/v3/users/25ca8a36f44d4caa8044c37b7c303a8f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:22.027831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8029a-975a-422f-b014-2454ab0ba80d None admin] RBAC: Authorizing `identity:get_user(user_id=25ca8a36f44d4caa8044c37b7c303a8f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:22.029296 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8029a-975a-422f-b014-2454ab0ba80d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:22.031005 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 157/315] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:21 2022] GET /identity/v3/users/25ca8a36f44d4caa8044c37b7c303a8f => generated 297 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:22.036862 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c9352-93e0-4a1c-b7a6-6130a9d95c82 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:22.138609 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c9352-93e0-4a1c-b7a6-6130a9d95c82 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:22.175957 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b133b-7118-428a-80c1-86bf3e982efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:22.176617 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b133b-7118-428a-80c1-86bf3e982efe None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:22.176895 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b133b-7118-428a-80c1-86bf3e982efe None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:22.177168 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b133b-7118-428a-80c1-86bf3e982efe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:22.244435 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b133b-7118-428a-80c1-86bf3e982efe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:22.245815 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b133b-7118-428a-80c1-86bf3e982efe None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:22.345027 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 159/316] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:41:22.351034 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8029a-975a-422f-b014-2454ab0ba80d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:22.448068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8029a-975a-422f-b014-2454ab0ba80d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:22.481411 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f5b58-0a63-49c3-a238-5eabcf32b293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:22.482666 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f5b58-0a63-49c3-a238-5eabcf32b293 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:22.483285 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f5b58-0a63-49c3-a238-5eabcf32b293 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:22.483781 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f5b58-0a63-49c3-a238-5eabcf32b293 None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:22.485366 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f5b58-0a63-49c3-a238-5eabcf32b293 None admin] RBAC: Authorizing `identity:get_project(project_id=138bad15d42d49259cf68f4833e7841e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:22.487061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f5b58-0a63-49c3-a238-5eabcf32b293 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:22.489286 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 158/317] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:22 2022] GET /identity/v3/projects/138bad15d42d49259cf68f4833e7841e => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:22.495421 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b133b-7118-428a-80c1-86bf3e982efe None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:22.593576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b133b-7118-428a-80c1-86bf3e982efe None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:22.626125 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4066a8-2b52-4587-a986-2e990a08cb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:22.626778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4066a8-2b52-4587-a986-2e990a08cb3b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:22.627083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4066a8-2b52-4587-a986-2e990a08cb3b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:22.627363 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4066a8-2b52-4587-a986-2e990a08cb3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:22.628187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4066a8-2b52-4587-a986-2e990a08cb3b None admin] RBAC: Adding query filter params (role.id=62544860c24f461a83620d4401a9ca0a, scope.project.id=138bad15d42d49259cf68f4833e7841e, user.id=25ca8a36f44d4caa8044c37b7c303a8f) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:22.628494 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4066a8-2b52-4587-a986-2e990a08cb3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:22.629933 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4066a8-2b52-4587-a986-2e990a08cb3b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:22.636042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 160/318] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:41:22 2022] GET /identity/v3/role_assignments?user.id=25ca8a36f44d4caa8044c37b7c303a8f&scope.project.id=138bad15d42d49259cf68f4833e7841e&role.id=62544860c24f461a83620d4401a9ca0a => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:23.363116 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15442626-c8bd-4c8f-818b-8d869e2d4a07 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:23.363366 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15442626-c8bd-4c8f-818b-8d869e2d4a07 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:23.363871 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15442626-c8bd-4c8f-818b-8d869e2d4a07 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:23.365337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 159/319] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:23.370900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa7e04-24d8-494b-b5bf-71f741ff94d1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:23.371384 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa7e04-24d8-494b-b5bf-71f741ff94d1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:23.371457 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa7e04-24d8-494b-b5bf-71f741ff94d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:23.389994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ccfa7e04-24d8-494b-b5bf-71f741ff94d1 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:23.391226 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ccfa7e04-24d8-494b-b5bf-71f741ff94d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:23.459020 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 161/320] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:23.482200 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15442626-c8bd-4c8f-818b-8d869e2d4a07 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:23.585709 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15442626-c8bd-4c8f-818b-8d869e2d4a07 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:23.622766 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba24fe-97ec-4694-9024-c96d3f678f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:23.623608 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba24fe-97ec-4694-9024-c96d3f678f3a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:23.623889 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba24fe-97ec-4694-9024-c96d3f678f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:23.624161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba24fe-97ec-4694-9024-c96d3f678f3a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:23.634251 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba24fe-97ec-4694-9024-c96d3f678f3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:23.641893 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-0dba24fe-97ec-4694-9024-c96d3f678f3a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:23.641893 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:23.641893 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:23.641893 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:23.641893 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:23.641893 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:23.641893 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:23.641893 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:23.641893 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:23.641893 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:23.641893 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:23.641893 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:23.641893 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:23.641893 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:23.641893 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:23.641893 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:23.642751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:23.642751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:23.642751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:23.642751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:23.642751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:23.642751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:23.642751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:23.642751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:23.642751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:23.642751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:23.642751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:23.642751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:23.642751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:23.642751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:23.642751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:23.642751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:23.643588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:23.643588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:23.643588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:23.643588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:23.643588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:23.643588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:23.643588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:23.643588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:23.643588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:23.643588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:23.643588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:23.643588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:23.643588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 160/321] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:23.650376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa7e04-24d8-494b-b5bf-71f741ff94d1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:23.749082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa7e04-24d8-494b-b5bf-71f741ff94d1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:23.770594 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3d1ed-78f9-4fe2-bea6-f2711173a5d6 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:23.770860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3d1ed-78f9-4fe2-bea6-f2711173a5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:23.771212 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3d1ed-78f9-4fe2-bea6-f2711173a5d6 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:23.772788 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 161/322] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:41:23.777602 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8528ef3-a656-4786-b099-ebd242e722aa None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:23.777899 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8528ef3-a656-4786-b099-ebd242e722aa None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:23.778136 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8528ef3-a656-4786-b099-ebd242e722aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:23.783876 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276ae88-4ef9-4f1f-9f84-b4fc45bbc742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:23.784543 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276ae88-4ef9-4f1f-9f84-b4fc45bbc742 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:23.784823 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276ae88-4ef9-4f1f-9f84-b4fc45bbc742 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:23.785090 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276ae88-4ef9-4f1f-9f84-b4fc45bbc742 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:23.785829 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276ae88-4ef9-4f1f-9f84-b4fc45bbc742 None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:23.786128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276ae88-4ef9-4f1f-9f84-b4fc45bbc742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:23.787637 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276ae88-4ef9-4f1f-9f84-b4fc45bbc742 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:23.795215 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f8528ef3-a656-4786-b099-ebd242e722aa None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:23.795805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 162/323] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:41:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:23.796377 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f8528ef3-a656-4786-b099-ebd242e722aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:23.801185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276ae88-4ef9-4f1f-9f84-b4fc45bbc742 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:23.865292 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 162/324] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:41:23.886929 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8528ef3-a656-4786-b099-ebd242e722aa None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:23.895733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276ae88-4ef9-4f1f-9f84-b4fc45bbc742 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:23.926752 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416602b9-3c58-47c6-9383-f9ec6f275dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:23.927674 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416602b9-3c58-47c6-9383-f9ec6f275dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:23.927946 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416602b9-3c58-47c6-9383-f9ec6f275dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:23.928216 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416602b9-3c58-47c6-9383-f9ec6f275dd2 None admin] PATH_INFO: `/v3/users/cafc4c50938c4a33adf0e2c0dd26137c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:23.929383 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416602b9-3c58-47c6-9383-f9ec6f275dd2 None admin] RBAC: Authorizing `identity:get_user(user_id=cafc4c50938c4a33adf0e2c0dd26137c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:23.930817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416602b9-3c58-47c6-9383-f9ec6f275dd2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:23.937415 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 163/325] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:23 2022] GET /identity/v3/users/cafc4c50938c4a33adf0e2c0dd26137c => generated 293 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:23.937415 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c0592-adc3-46f5-a2a8-aa7406e42de0 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:23.937415 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c0592-adc3-46f5-a2a8-aa7406e42de0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:23.937415 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c0592-adc3-46f5-a2a8-aa7406e42de0 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:23.937415 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 164/326] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:23.938676 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c0592-adc3-46f5-a2a8-aa7406e42de0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:23.978634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8528ef3-a656-4786-b099-ebd242e722aa None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:24.013583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542a1d9-6bff-4a2d-8ede-9fcbfaeb12ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:24.014383 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542a1d9-6bff-4a2d-8ede-9fcbfaeb12ca None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:24.014660 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542a1d9-6bff-4a2d-8ede-9fcbfaeb12ca None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:24.014932 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542a1d9-6bff-4a2d-8ede-9fcbfaeb12ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:24.016217 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542a1d9-6bff-4a2d-8ede-9fcbfaeb12ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:24.017690 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542a1d9-6bff-4a2d-8ede-9fcbfaeb12ca None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:24.019385 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 163/327] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:24.024309 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6113e-12e8-43ca-8c31-35c5d24ace55 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:24.024622 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6113e-12e8-43ca-8c31-35c5d24ace55 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:24.024898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6113e-12e8-43ca-8c31-35c5d24ace55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:24.035580 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c0592-adc3-46f5-a2a8-aa7406e42de0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:24.041297 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b9e6113e-12e8-43ca-8c31-35c5d24ace55 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:24.042465 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b9e6113e-12e8-43ca-8c31-35c5d24ace55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:24.067869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fcfcc-b78b-48f0-83db-9e4ab6e550fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:24.068523 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fcfcc-b78b-48f0-83db-9e4ab6e550fc None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:24.068805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fcfcc-b78b-48f0-83db-9e4ab6e550fc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:24.069230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fcfcc-b78b-48f0-83db-9e4ab6e550fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:24.070069 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fcfcc-b78b-48f0-83db-9e4ab6e550fc None admin] RBAC: Adding query filter params (role.id=f8d42be71f034e1a88784699c04e7a89, user.id=cafc4c50938c4a33adf0e2c0dd26137c, scope.system=all) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:24.070380 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fcfcc-b78b-48f0-83db-9e4ab6e550fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:24.072197 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fcfcc-b78b-48f0-83db-9e4ab6e550fc None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:24.083295 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 165/328] 10.222.0.77 () {56 vars in 1308 bytes} [Wed May 11 06:41:23 2022] GET /identity/v3/role_assignments?user.id=cafc4c50938c4a33adf0e2c0dd26137c&scope.system=all&role.id=f8d42be71f034e1a88784699c04e7a89 => generated 510 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:24.084150 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fcfcc-b78b-48f0-83db-9e4ab6e550fc None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:24.111283 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 164/329] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:24.131463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6113e-12e8-43ca-8c31-35c5d24ace55 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:24.196145 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fcfcc-b78b-48f0-83db-9e4ab6e550fc None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:24.231049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946f3c1-d5f2-46a0-b3fc-63b62e5d48ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:24.231736 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946f3c1-d5f2-46a0-b3fc-63b62e5d48ca None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:24.232019 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946f3c1-d5f2-46a0-b3fc-63b62e5d48ca None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:24.232293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946f3c1-d5f2-46a0-b3fc-63b62e5d48ca None admin] PATH_INFO: `/v3/groups` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:24.233003 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946f3c1-d5f2-46a0-b3fc-63b62e5d48ca None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:24.234475 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946f3c1-d5f2-46a0-b3fc-63b62e5d48ca None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:24.243256 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6113e-12e8-43ca-8c31-35c5d24ace55 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:24.262995 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 166/330] 10.222.0.77 () {60 vars in 1134 bytes} [Wed May 11 06:41:24 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:41:24.302672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812db78-d15a-4443-82c2-c2f834aef182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:24.303547 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812db78-d15a-4443-82c2-c2f834aef182 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:24.303829 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812db78-d15a-4443-82c2-c2f834aef182 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:24.304101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812db78-d15a-4443-82c2-c2f834aef182 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:24.319010 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812db78-d15a-4443-82c2-c2f834aef182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:24.326813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-0812db78-d15a-4443-82c2-c2f834aef182 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:41:24.326813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:24.326813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:24.326813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:24.326813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:24.326813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:24.326813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:24.326813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:24.326813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:24.326813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:24.326813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:24.326813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:24.326813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:24.326813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:24.326813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:24.326813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:24.328046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:24.328046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:24.328046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:24.328046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:24.328046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:24.328046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:24.328046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:24.328046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:24.328046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:24.328046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:24.328046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:24.328046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:24.328046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:24.328046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:24.328046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:24.328046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:24.328857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:24.328857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:24.328857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:24.328857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:24.328857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:24.328857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:24.328857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:24.328857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:24.328857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:24.328857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:24.328857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:41:24.328857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:24.328857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 165/331] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:24.334997 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946f3c1-d5f2-46a0-b3fc-63b62e5d48ca None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:24.436709 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946f3c1-d5f2-46a0-b3fc-63b62e5d48ca None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:24.471381 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084b505-9f89-41c1-9c39-a2bb88baa1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:24.472070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084b505-9f89-41c1-9c39-a2bb88baa1ec None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:24.472343 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084b505-9f89-41c1-9c39-a2bb88baa1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:24.472608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084b505-9f89-41c1-9c39-a2bb88baa1ec None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:24.473447 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084b505-9f89-41c1-9c39-a2bb88baa1ec None admin] RBAC: Adding query filter params (name=reader) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:24.473744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084b505-9f89-41c1-9c39-a2bb88baa1ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:24.475198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084b505-9f89-41c1-9c39-a2bb88baa1ec None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:24.483529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 167/332] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:41:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:24.489371 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812db78-d15a-4443-82c2-c2f834aef182 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:24.591375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812db78-d15a-4443-82c2-c2f834aef182 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:24.625229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ee291-ba9a-4707-93cc-dea9c171e57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:24.626117 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ee291-ba9a-4707-93cc-dea9c171e57d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:24.626399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ee291-ba9a-4707-93cc-dea9c171e57d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:24.626674 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ee291-ba9a-4707-93cc-dea9c171e57d None admin] PATH_INFO: `/v3/users/8738c3e7b1f54cdfb1ab9d3d7c422b17` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:24.627976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ee291-ba9a-4707-93cc-dea9c171e57d None admin] RBAC: Authorizing `identity:get_user(user_id=8738c3e7b1f54cdfb1ab9d3d7c422b17)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:24.629399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ee291-ba9a-4707-93cc-dea9c171e57d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:24.631622 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 166/333] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:24 2022] GET /identity/v3/users/8738c3e7b1f54cdfb1ab9d3d7c422b17 => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:24.636815 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084b505-9f89-41c1-9c39-a2bb88baa1ec None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:24.737188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084b505-9f89-41c1-9c39-a2bb88baa1ec None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:24.770911 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1437fd-6bac-4009-b16b-b7449bee511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:24.771943 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1437fd-6bac-4009-b16b-b7449bee511b None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:24.772228 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1437fd-6bac-4009-b16b-b7449bee511b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:24.772506 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1437fd-6bac-4009-b16b-b7449bee511b None admin] PATH_INFO: `/v3/system/users/8738c3e7b1f54cdfb1ab9d3d7c422b17/roles/62544860c24f461a83620d4401a9ca0a` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:24.776284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1437fd-6bac-4009-b16b-b7449bee511b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8738c3e7b1f54cdfb1ab9d3d7c422b17, role_id=62544860c24f461a83620d4401a9ca0a)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:24.777212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1437fd-6bac-4009-b16b-b7449bee511b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:24.787221 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 168/334] 10.222.0.77 () {58 vars in 1334 bytes} [Wed May 11 06:41:24 2022] PUT /identity/v3/system/users/8738c3e7b1f54cdfb1ab9d3d7c422b17/roles/62544860c24f461a83620d4401a9ca0a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:26.845350 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1784186-27b6-4de8-9e5e-29871b651d11 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:26.845972 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1784186-27b6-4de8-9e5e-29871b651d11 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:26.845972 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1784186-27b6-4de8-9e5e-29871b651d11 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:26.847294 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 167/335] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:26.853068 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1601d-44c7-4cd9-a61e-85aff8158986 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:26.853521 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1601d-44c7-4cd9-a61e-85aff8158986 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:26.853603 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1601d-44c7-4cd9-a61e-85aff8158986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:26.876819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-bbc1601d-44c7-4cd9-a61e-85aff8158986 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:26.878052 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bbc1601d-44c7-4cd9-a61e-85aff8158986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:26.960692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 169/336] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:26.962529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e9d64-8793-4c36-adfa-5bc17d9debab None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:26.962825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e9d64-8793-4c36-adfa-5bc17d9debab None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:26.963129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e9d64-8793-4c36-adfa-5bc17d9debab None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:26.964512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 168/337] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:26.969923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cffcbb-2d06-4bbb-80fd-1e2752f8504a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:26.970217 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cffcbb-2d06-4bbb-80fd-1e2752f8504a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:26.970494 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cffcbb-2d06-4bbb-80fd-1e2752f8504a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:26.988386 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e9d64-8793-4c36-adfa-5bc17d9debab None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:26.992013 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-45cffcbb-2d06-4bbb-80fd-1e2752f8504a None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:26.993245 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-45cffcbb-2d06-4bbb-80fd-1e2752f8504a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:27.072994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 170/338] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:27.108243 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cffcbb-2d06-4bbb-80fd-1e2752f8504a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:27.120956 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e9d64-8793-4c36-adfa-5bc17d9debab None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:27.186685 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bf432-9fef-4370-a418-7815f1253e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:27.187934 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bf432-9fef-4370-a418-7815f1253e5a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:27.188434 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bf432-9fef-4370-a418-7815f1253e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:27.189080 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bf432-9fef-4370-a418-7815f1253e5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:27.210818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bf432-9fef-4370-a418-7815f1253e5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:27.223372 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-572bf432-9fef-4370-a418-7815f1253e5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:41:27.223372 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:27.223372 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:27.223372 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:27.223372 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:27.223372 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:27.223372 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:27.223372 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:27.223372 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:27.223372 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:27.223372 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:27.223372 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:27.223372 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:27.223372 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:27.223372 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:27.223372 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:27.224382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:27.224382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:27.224382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:27.224382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:27.224382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:27.224382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:27.224382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:27.224382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:27.224382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:27.224382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:27.224382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:27.224382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:27.224382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:27.224382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:27.224382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:27.224382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:27.225224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:27.225224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:27.225224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:27.225224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:27.225224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:27.225224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:27.225224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:27.225224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:27.225224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:27.225224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:27.225224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:41:27.225224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:27.225224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 169/339] 10.222.0.77 () {56 vars in 1114 bytes} [Wed May 11 06:41:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:27.231529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bf432-9fef-4370-a418-7815f1253e5a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:27.317924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cffcbb-2d06-4bbb-80fd-1e2752f8504a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:27.391500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28b7c1-0487-4233-843f-c5ff1d8d521f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:27.392329 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28b7c1-0487-4233-843f-c5ff1d8d521f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:27.392603 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28b7c1-0487-4233-843f-c5ff1d8d521f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:27.392871 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28b7c1-0487-4233-843f-c5ff1d8d521f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:27.416407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28b7c1-0487-4233-843f-c5ff1d8d521f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:27.432442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-0a28b7c1-0487-4233-843f-c5ff1d8d521f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:27.432442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:27.432442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:27.432442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:27.432442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:27.432442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:27.432442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:27.432442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:27.432442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:27.432442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:27.432442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:27.432442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:27.432442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:27.432442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:27.432442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:27.432442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:27.433389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:27.433389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:27.433389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:27.433389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:27.433389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:27.433389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:27.433389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:27.433389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:27.433389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:27.433389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:27.433389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:27.433389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:27.433389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:27.433389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:27.433389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:27.433389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:27.434223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:27.434223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:27.434223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:27.434223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:27.434223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:27.434223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:27.434223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:27.434223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:27.434223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:27.434223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:27.434223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:27.434223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:27.434223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 171/340] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:41:27.442903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28b7c1-0487-4233-843f-c5ff1d8d521f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:27.445210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bf432-9fef-4370-a418-7815f1253e5a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:27.521229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0758059-62d0-4132-a1af-9a56e1498c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:27.521938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0758059-62d0-4132-a1af-9a56e1498c85 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:27.522218 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0758059-62d0-4132-a1af-9a56e1498c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:27.522529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0758059-62d0-4132-a1af-9a56e1498c85 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:27.523334 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0758059-62d0-4132-a1af-9a56e1498c85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:27.526733 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0758059-62d0-4132-a1af-9a56e1498c85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:27.526733 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0758059-62d0-4132-a1af-9a56e1498c85 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:27.542668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 170/341] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:41:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:27.548317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0758059-62d0-4132-a1af-9a56e1498c85 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:27.667375 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28b7c1-0487-4233-843f-c5ff1d8d521f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:27.669349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0758059-62d0-4132-a1af-9a56e1498c85 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:27.711721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f5820-b2a6-46b0-bde4-744f08992263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:27.712445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f5820-b2a6-46b0-bde4-744f08992263 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:27.712722 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f5820-b2a6-46b0-bde4-744f08992263 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:27.712994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f5820-b2a6-46b0-bde4-744f08992263 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:27.727809 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13d50e-781b-48b6-9500-c0d666330cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:27.728494 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13d50e-781b-48b6-9500-c0d666330cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:27.728769 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13d50e-781b-48b6-9500-c0d666330cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:27.729039 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13d50e-781b-48b6-9500-c0d666330cd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:27.729790 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13d50e-781b-48b6-9500-c0d666330cd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:27.730090 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13d50e-781b-48b6-9500-c0d666330cd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:27.731558 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13d50e-781b-48b6-9500-c0d666330cd7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:27.741809 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 172/342] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:41:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:27.743340 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10d10b-4774-4597-8712-dab837ac7ae5 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:27.743684 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10d10b-4774-4597-8712-dab837ac7ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:27.744275 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10d10b-4774-4597-8712-dab837ac7ae5 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:27.745502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 173/343] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:27.751310 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4178a-1351-4d41-b4eb-e3aca82950f5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:27.751597 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4178a-1351-4d41-b4eb-e3aca82950f5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:27.751918 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4178a-1351-4d41-b4eb-e3aca82950f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:27.771303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-90e4178a-1351-4d41-b4eb-e3aca82950f5 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:27.772820 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-90e4178a-1351-4d41-b4eb-e3aca82950f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:27.842898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f5820-b2a6-46b0-bde4-744f08992263 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:27.844418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f5820-b2a6-46b0-bde4-744f08992263 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:27.887076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 174/344] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:41:27.888037 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4178a-1351-4d41-b4eb-e3aca82950f5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:27.998316 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 171/345] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 06:41:27.999330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f5820-b2a6-46b0-bde4-744f08992263 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:28.076807 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4178a-1351-4d41-b4eb-e3aca82950f5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:28.105296 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f5820-b2a6-46b0-bde4-744f08992263 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:28.119039 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac536a9c-ac52-49a6-9ba5-ff774bdf2b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:28.119719 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac536a9c-ac52-49a6-9ba5-ff774bdf2b0b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:28.120006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac536a9c-ac52-49a6-9ba5-ff774bdf2b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:28.120279 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac536a9c-ac52-49a6-9ba5-ff774bdf2b0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:28.151001 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bfcf9-f71b-4fdd-a788-a6baaf04653a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:28.151906 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bfcf9-f71b-4fdd-a788-a6baaf04653a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:28.152186 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bfcf9-f71b-4fdd-a788-a6baaf04653a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:28.152459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bfcf9-f71b-4fdd-a788-a6baaf04653a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:28.164503 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bfcf9-f71b-4fdd-a788-a6baaf04653a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:28.174220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ee6bfcf9-f71b-4fdd-a788-a6baaf04653a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:28.174220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:28.174220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:28.174220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:28.174220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:28.174220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:28.174220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:28.174220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:28.174220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:28.174220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:28.174220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:28.174220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:28.174220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:28.174220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:28.174220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:28.174220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:28.175258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:28.175258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:28.175258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:28.175258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:28.175258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:28.175258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:28.175258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:28.175258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:28.175258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:28.175258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:28.175258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:28.175258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:28.175258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:28.175258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:28.175258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:28.175258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:28.176333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:28.176333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:28.176333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:28.176333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:28.176333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:28.176333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:28.176333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:28.176333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:28.176333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:28.176333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:28.176333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:28.176333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:28.176333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 172/346] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:28.176333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bfcf9-f71b-4fdd-a788-a6baaf04653a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:28.230541 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac536a9c-ac52-49a6-9ba5-ff774bdf2b0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:28.232072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac536a9c-ac52-49a6-9ba5-ff774bdf2b0b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:28.282293 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bfcf9-f71b-4fdd-a788-a6baaf04653a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:28.326339 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff8995-a0db-4603-abc1-9f8341db171f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:28.327281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8995-a0db-4603-abc1-9f8341db171f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:28.327561 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8995-a0db-4603-abc1-9f8341db171f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:28.327833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8995-a0db-4603-abc1-9f8341db171f None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:28.329058 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff8995-a0db-4603-abc1-9f8341db171f None admin] RBAC: Authorizing `identity:get_project(project_id=660afb35216c4b94a77b71d73962d86f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:28.330522 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff8995-a0db-4603-abc1-9f8341db171f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:28.333360 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 173/347] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:28 2022] GET /identity/v3/projects/660afb35216c4b94a77b71d73962d86f => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:28.334260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff8995-a0db-4603-abc1-9f8341db171f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:28.365326 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 175/348] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:41:28.366933 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a55e2-4f84-4578-aaed-e02bdb980255 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:28.367249 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a55e2-4f84-4578-aaed-e02bdb980255 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:28.367521 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a55e2-4f84-4578-aaed-e02bdb980255 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:28.368782 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 176/349] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:28.369528 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a55e2-4f84-4578-aaed-e02bdb980255 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:28.462162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff8995-a0db-4603-abc1-9f8341db171f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:28.478070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a55e2-4f84-4578-aaed-e02bdb980255 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:28.495373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcde4d0-5cb6-4c88-a093-1f2e992c2fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:28.496047 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcde4d0-5cb6-4c88-a093-1f2e992c2fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:28.496324 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcde4d0-5cb6-4c88-a093-1f2e992c2fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:28.496594 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcde4d0-5cb6-4c88-a093-1f2e992c2fd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:28.497341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcde4d0-5cb6-4c88-a093-1f2e992c2fd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:28.497646 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcde4d0-5cb6-4c88-a093-1f2e992c2fd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:28.499042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcde4d0-5cb6-4c88-a093-1f2e992c2fd8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:28.508199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 174/350] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:41:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:28.509025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcde4d0-5cb6-4c88-a093-1f2e992c2fd8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:28.528356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258fc7b-4803-4cb6-b9b3-3cdd38912a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:28.529266 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258fc7b-4803-4cb6-b9b3-3cdd38912a90 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:28.529546 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258fc7b-4803-4cb6-b9b3-3cdd38912a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:28.530204 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258fc7b-4803-4cb6-b9b3-3cdd38912a90 None admin] PATH_INFO: `/v3/groups/e1c638522292421fbb997f5ced0ea99c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:28.540450 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258fc7b-4803-4cb6-b9b3-3cdd38912a90 None admin] RBAC: Authorizing `identity:get_group(group_id=e1c638522292421fbb997f5ced0ea99c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:28.541853 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258fc7b-4803-4cb6-b9b3-3cdd38912a90 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:28.544058 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 177/351] 10.222.0.77 () {56 vars in 1180 bytes} [Wed May 11 06:41:28 2022] GET /identity/v3/groups/e1c638522292421fbb997f5ced0ea99c => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:28.545324 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec273a-d568-4c16-a955-93968f8582e4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:28.545606 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec273a-d568-4c16-a955-93968f8582e4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:28.545876 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec273a-d568-4c16-a955-93968f8582e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:28.565623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-51ec273a-d568-4c16-a955-93968f8582e4 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:28.566917 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-51ec273a-d568-4c16-a955-93968f8582e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:28.638986 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 178/352] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:28.639846 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec273a-d568-4c16-a955-93968f8582e4 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:28.647597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcde4d0-5cb6-4c88-a093-1f2e992c2fd8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:28.685125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deba10-925c-4732-8076-a2cc5536e08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:28.686182 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deba10-925c-4732-8076-a2cc5536e08f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:28.686465 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deba10-925c-4732-8076-a2cc5536e08f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:28.687121 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deba10-925c-4732-8076-a2cc5536e08f None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:28.688618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2deba10-925c-4732-8076-a2cc5536e08f None admin] RBAC: Authorizing `identity:get_project(project_id=660afb35216c4b94a77b71d73962d86f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:28.690837 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2deba10-925c-4732-8076-a2cc5536e08f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:28.693116 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 175/353] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:28 2022] GET /identity/v3/projects/660afb35216c4b94a77b71d73962d86f => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:28.693906 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deba10-925c-4732-8076-a2cc5536e08f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:28.767543 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec273a-d568-4c16-a955-93968f8582e4 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:28.815280 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f5005-cbd7-4683-8f5a-52bd53650cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:28.816660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f5005-cbd7-4683-8f5a-52bd53650cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:28.816660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f5005-cbd7-4683-8f5a-52bd53650cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:28.816660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f5005-cbd7-4683-8f5a-52bd53650cd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:28.825637 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deba10-925c-4732-8076-a2cc5536e08f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:28.868925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088da46-9524-4156-8c05-64b5a2e819bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:28.869602 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088da46-9524-4156-8c05-64b5a2e819bf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:28.870407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088da46-9524-4156-8c05-64b5a2e819bf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:28.870407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088da46-9524-4156-8c05-64b5a2e819bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:28.871044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088da46-9524-4156-8c05-64b5a2e819bf None admin] RBAC: Adding query filter params (group.id=e1c638522292421fbb997f5ced0ea99c, role.id=ae6b211774c34f47a3ac4853538f62ad, scope.project.id=660afb35216c4b94a77b71d73962d86f) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:28.871365 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088da46-9524-4156-8c05-64b5a2e819bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:28.872824 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088da46-9524-4156-8c05-64b5a2e819bf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:28.878850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 176/354] 10.222.0.77 () {56 vars in 1376 bytes} [Wed May 11 06:41:28 2022] GET /identity/v3/role_assignments?group.id=e1c638522292421fbb997f5ced0ea99c&scope.project.id=660afb35216c4b94a77b71d73962d86f&role.id=ae6b211774c34f47a3ac4853538f62ad => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:28.879550 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088da46-9524-4156-8c05-64b5a2e819bf None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:28.915711 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f5005-cbd7-4683-8f5a-52bd53650cd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:28.918415 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f5005-cbd7-4683-8f5a-52bd53650cd9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:29.009037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088da46-9524-4156-8c05-64b5a2e819bf None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:29.045363 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 179/355] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:41:29.046255 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f5005-cbd7-4683-8f5a-52bd53650cd9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:29.058759 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94e7ed-25c2-4d6b-84b5-8b03b2a060db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:29.059745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94e7ed-25c2-4d6b-84b5-8b03b2a060db None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:29.060029 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94e7ed-25c2-4d6b-84b5-8b03b2a060db None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:29.060308 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94e7ed-25c2-4d6b-84b5-8b03b2a060db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:29.079316 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94e7ed-25c2-4d6b-84b5-8b03b2a060db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:29.087227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5f94e7ed-25c2-4d6b-84b5-8b03b2a060db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:41:29.087227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:29.087227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:29.087227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:29.087227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:29.087227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:29.087227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:29.087227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:29.087227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:29.087227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:29.087227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:29.087227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:29.087227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:29.087227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:29.087227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:29.087227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:29.088199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:29.088199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:29.088199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:29.088199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:29.088199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:29.088199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:29.088199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:29.088199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:29.088199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:29.088199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:29.088199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:29.088199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:29.088199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:29.088199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:29.088199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:29.088199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:29.088994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:29.088994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:29.088994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:29.088994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:29.088994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:29.088994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:29.088994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:29.088994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:29.088994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:29.088994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:29.088994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:41:29.088994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:29.088994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 177/356] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:29.090281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b82787-8279-4821-aa4b-61c33ba53558 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:29.090461 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b82787-8279-4821-aa4b-61c33ba53558 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:29.090703 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b82787-8279-4821-aa4b-61c33ba53558 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:29.092049 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 178/357] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:29.093111 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905ae80-1da8-487a-beb2-cae85f522521 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:29.093396 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905ae80-1da8-487a-beb2-cae85f522521 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:29.093672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905ae80-1da8-487a-beb2-cae85f522521 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:29.095424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 179/358] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:29.095771 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905ae80-1da8-487a-beb2-cae85f522521 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:29.174464 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f5005-cbd7-4683-8f5a-52bd53650cd9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:29.218333 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e874fb-17ee-448b-bf79-3192630bf5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:29.219257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e874fb-17ee-448b-bf79-3192630bf5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:29.219763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e874fb-17ee-448b-bf79-3192630bf5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:29.219863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e874fb-17ee-448b-bf79-3192630bf5d4 None admin] PATH_INFO: `/v3/groups/e1c638522292421fbb997f5ced0ea99c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:29.221164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e874fb-17ee-448b-bf79-3192630bf5d4 None admin] RBAC: Authorizing `identity:get_group(group_id=e1c638522292421fbb997f5ced0ea99c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:29.222599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e874fb-17ee-448b-bf79-3192630bf5d4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:29.225316 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905ae80-1da8-487a-beb2-cae85f522521 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:29.225452 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 180/359] 10.222.0.77 () {56 vars in 1180 bytes} [Wed May 11 06:41:29 2022] GET /identity/v3/groups/e1c638522292421fbb997f5ced0ea99c => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:29.225452 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e874fb-17ee-448b-bf79-3192630bf5d4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:29.267259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8b3dc-c2f8-4979-b730-e8b3b477e096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:29.268194 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8b3dc-c2f8-4979-b730-e8b3b477e096 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:29.268479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8b3dc-c2f8-4979-b730-e8b3b477e096 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:29.268784 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8b3dc-c2f8-4979-b730-e8b3b477e096 None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:29.271617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8b3dc-c2f8-4979-b730-e8b3b477e096 None admin] RBAC: Authorizing `identity:get_project(project_id=138bad15d42d49259cf68f4833e7841e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:29.273079 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8b3dc-c2f8-4979-b730-e8b3b477e096 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:29.274826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 180/360] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:29 2022] GET /identity/v3/projects/138bad15d42d49259cf68f4833e7841e => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:29.279055 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654abaa-11e9-48e9-a394-3a7e2cd838b2 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:29.279055 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654abaa-11e9-48e9-a394-3a7e2cd838b2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:29.279055 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654abaa-11e9-48e9-a394-3a7e2cd838b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:29.298349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8654abaa-11e9-48e9-a394-3a7e2cd838b2 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:29.300634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8654abaa-11e9-48e9-a394-3a7e2cd838b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:29.357207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e874fb-17ee-448b-bf79-3192630bf5d4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:29.385262 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 181/361] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:29.387683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c228d5-3cc7-43cc-a010-b5beca42b02e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:29.387683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c228d5-3cc7-43cc-a010-b5beca42b02e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:29.387683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c228d5-3cc7-43cc-a010-b5beca42b02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:29.403575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12d79d-2a16-4caf-b79b-f0c4ee9e9bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:29.404728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12d79d-2a16-4caf-b79b-f0c4ee9e9bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:29.405009 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12d79d-2a16-4caf-b79b-f0c4ee9e9bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:29.405282 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12d79d-2a16-4caf-b79b-f0c4ee9e9bb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:29.405378 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-75c228d5-3cc7-43cc-a010-b5beca42b02e None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:29.406088 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12d79d-2a16-4caf-b79b-f0c4ee9e9bb3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:29.406390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12d79d-2a16-4caf-b79b-f0c4ee9e9bb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:29.406555 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-75c228d5-3cc7-43cc-a010-b5beca42b02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:29.407875 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12d79d-2a16-4caf-b79b-f0c4ee9e9bb3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:29.420801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 181/362] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:41:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:29.421448 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12d79d-2a16-4caf-b79b-f0c4ee9e9bb3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:29.494760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 182/363] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:29.499574 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c228d5-3cc7-43cc-a010-b5beca42b02e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:29.546441 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12d79d-2a16-4caf-b79b-f0c4ee9e9bb3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:29.591586 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd6a17-f430-4127-b08c-07906d0985bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:29.592266 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd6a17-f430-4127-b08c-07906d0985bd None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:29.592550 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd6a17-f430-4127-b08c-07906d0985bd None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:29.593185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd6a17-f430-4127-b08c-07906d0985bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:29.593660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd6a17-f430-4127-b08c-07906d0985bd None admin] RBAC: Adding query filter params (group.id=e1c638522292421fbb997f5ced0ea99c, role.id=f8d42be71f034e1a88784699c04e7a89, scope.project.id=660afb35216c4b94a77b71d73962d86f) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:29.594072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd6a17-f430-4127-b08c-07906d0985bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:29.596154 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd6a17-f430-4127-b08c-07906d0985bd None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:29.604907 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 182/364] 10.222.0.77 () {56 vars in 1376 bytes} [Wed May 11 06:41:29 2022] GET /identity/v3/role_assignments?group.id=e1c638522292421fbb997f5ced0ea99c&scope.project.id=660afb35216c4b94a77b71d73962d86f&role.id=f8d42be71f034e1a88784699c04e7a89 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:29.605766 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd6a17-f430-4127-b08c-07906d0985bd None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:29.632138 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c228d5-3cc7-43cc-a010-b5beca42b02e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:29.676704 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722e365-ab19-4acb-aca9-b7f4fca3aad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:29.677635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722e365-ab19-4acb-aca9-b7f4fca3aad1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:29.677915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722e365-ab19-4acb-aca9-b7f4fca3aad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:29.678192 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722e365-ab19-4acb-aca9-b7f4fca3aad1 None admin] PATH_INFO: `/v3/groups/e1c638522292421fbb997f5ced0ea99c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:29.679603 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722e365-ab19-4acb-aca9-b7f4fca3aad1 None admin] RBAC: Authorizing `identity:get_group(group_id=e1c638522292421fbb997f5ced0ea99c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:29.681016 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722e365-ab19-4acb-aca9-b7f4fca3aad1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:29.683140 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 183/365] 10.222.0.77 () {56 vars in 1180 bytes} [Wed May 11 06:41:29 2022] GET /identity/v3/groups/e1c638522292421fbb997f5ced0ea99c => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:29.684041 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722e365-ab19-4acb-aca9-b7f4fca3aad1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:29.749884 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd6a17-f430-4127-b08c-07906d0985bd None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:29.787252 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40669fa8-f8fd-4474-9865-b395b6acdba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:29.788481 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40669fa8-f8fd-4474-9865-b395b6acdba0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:29.789052 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40669fa8-f8fd-4474-9865-b395b6acdba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:29.789539 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40669fa8-f8fd-4474-9865-b395b6acdba0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:29.801115 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40669fa8-f8fd-4474-9865-b395b6acdba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:29.801558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722e365-ab19-4acb-aca9-b7f4fca3aad1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:29.810071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-40669fa8-f8fd-4474-9865-b395b6acdba0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:41:29.810071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:29.810071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:29.810071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:29.810071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:29.810071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:29.810071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:29.810071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:29.810071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:29.810071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:29.810071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:29.810071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:29.810071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:29.810071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:29.810071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:29.810071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:29.811082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:29.811082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:29.811082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:29.811082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:29.811082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:29.811082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:29.811082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:29.811082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:29.811082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:29.811082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:29.811082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:29.811082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:29.811082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:29.811082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:29.811082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:29.811082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:29.811900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:29.811900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:29.811900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:29.811900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:29.811900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:29.811900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:29.811900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:29.811900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:29.811900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:29.811900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:29.811900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:41:29.811900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:29.814846 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 183/366] 10.222.0.77 () {56 vars in 1114 bytes} [Wed May 11 06:41:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:29.815973 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40669fa8-f8fd-4474-9865-b395b6acdba0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:29.838788 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db7c8a-5073-417f-b08c-6fa59ccad8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:29.839772 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db7c8a-5073-417f-b08c-6fa59ccad8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:29.840054 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db7c8a-5073-417f-b08c-6fa59ccad8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:29.840331 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db7c8a-5073-417f-b08c-6fa59ccad8e8 None admin] PATH_INFO: `/v3/users/8738c3e7b1f54cdfb1ab9d3d7c422b17` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:29.842126 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db7c8a-5073-417f-b08c-6fa59ccad8e8 None admin] RBAC: Authorizing `identity:get_user(user_id=8738c3e7b1f54cdfb1ab9d3d7c422b17)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:29.843640 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db7c8a-5073-417f-b08c-6fa59ccad8e8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:29.845703 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 184/367] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:41:29 2022] GET /identity/v3/users/8738c3e7b1f54cdfb1ab9d3d7c422b17 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:29.846471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db7c8a-5073-417f-b08c-6fa59ccad8e8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:29.919114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40669fa8-f8fd-4474-9865-b395b6acdba0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:29.946005 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db7c8a-5073-417f-b08c-6fa59ccad8e8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:29.953607 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e718bb-9891-431e-8d33-c299d8ae2d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:29.954703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e718bb-9891-431e-8d33-c299d8ae2d75 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:29.955199 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e718bb-9891-431e-8d33-c299d8ae2d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:29.955687 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e718bb-9891-431e-8d33-c299d8ae2d75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:29.966122 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e718bb-9891-431e-8d33-c299d8ae2d75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:29.974449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-57e718bb-9891-431e-8d33-c299d8ae2d75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:41:29.974449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:29.974449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:29.974449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:29.974449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:29.974449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:29.974449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:29.974449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:29.974449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:29.974449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:29.974449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:29.974449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:29.974449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:29.974449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:29.974449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:29.974449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:29.975389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:29.975389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:29.975389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:29.975389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:29.975389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:29.975389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:29.975389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:29.975389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:29.975389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:29.975389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:29.975389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:29.975389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:29.975389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:29.975389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:29.975389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:29.975389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:29.976188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:29.976188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:29.976188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:29.976188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:29.976188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:29.976188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:29.976188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:29.976188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:29.976188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:29.976188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:29.976188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:41:29.976188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:29.978937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 184/368] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:41:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:29.980264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e718bb-9891-431e-8d33-c299d8ae2d75 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:29.980696 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a5ead-16ac-4784-9975-3365ab6dbbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:29.981378 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a5ead-16ac-4784-9975-3365ab6dbbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:29.981645 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a5ead-16ac-4784-9975-3365ab6dbbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:29.981926 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a5ead-16ac-4784-9975-3365ab6dbbe2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:29.982832 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a5ead-16ac-4784-9975-3365ab6dbbe2 None admin] RBAC: Adding query filter params (group.id=e1c638522292421fbb997f5ced0ea99c, role.id=f8d42be71f034e1a88784699c04e7a89, scope.project.id=138bad15d42d49259cf68f4833e7841e) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:29.983181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a5ead-16ac-4784-9975-3365ab6dbbe2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:29.984768 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a5ead-16ac-4784-9975-3365ab6dbbe2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:29.991240 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 185/369] 10.222.0.77 () {56 vars in 1376 bytes} [Wed May 11 06:41:29 2022] GET /identity/v3/role_assignments?group.id=e1c638522292421fbb997f5ced0ea99c&scope.project.id=138bad15d42d49259cf68f4833e7841e&role.id=f8d42be71f034e1a88784699c04e7a89 => generated 260 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:29.992507 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a5ead-16ac-4784-9975-3365ab6dbbe2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:30.085674 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e718bb-9891-431e-8d33-c299d8ae2d75 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:30.098174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a5ead-16ac-4784-9975-3365ab6dbbe2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:30.121684 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674b449-73a3-4dce-8d96-22e6091453bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:30.122696 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674b449-73a3-4dce-8d96-22e6091453bb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:30.123194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674b449-73a3-4dce-8d96-22e6091453bb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:30.123694 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674b449-73a3-4dce-8d96-22e6091453bb None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:30.124665 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674b449-73a3-4dce-8d96-22e6091453bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:30.125199 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674b449-73a3-4dce-8d96-22e6091453bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:30.126843 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674b449-73a3-4dce-8d96-22e6091453bb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:30.135957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb254a0-7eb5-4ed1-85aa-64dd52c69555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:30.136803 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb254a0-7eb5-4ed1-85aa-64dd52c69555 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:30.137161 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 185/370] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:41:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:30.137269 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb254a0-7eb5-4ed1-85aa-64dd52c69555 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:30.137626 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb254a0-7eb5-4ed1-85aa-64dd52c69555 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:30.138379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674b449-73a3-4dce-8d96-22e6091453bb None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:30.138666 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb254a0-7eb5-4ed1-85aa-64dd52c69555 None admin] RBAC: Adding query filter params (role.id=62544860c24f461a83620d4401a9ca0a, user.id=8738c3e7b1f54cdfb1ab9d3d7c422b17, scope.system=all) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:30.139120 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb254a0-7eb5-4ed1-85aa-64dd52c69555 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:30.140668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb254a0-7eb5-4ed1-85aa-64dd52c69555 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:30.154662 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 186/371] 10.222.0.77 () {56 vars in 1308 bytes} [Wed May 11 06:41:29 2022] GET /identity/v3/role_assignments?user.id=8738c3e7b1f54cdfb1ab9d3d7c422b17&scope.system=all&role.id=62544860c24f461a83620d4401a9ca0a => generated 510 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:30.155887 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb254a0-7eb5-4ed1-85aa-64dd52c69555 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:30.245030 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674b449-73a3-4dce-8d96-22e6091453bb None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:30.262701 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb254a0-7eb5-4ed1-85aa-64dd52c69555 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:30.280909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66499c46-6c92-4597-9c49-1bb66ad43d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:30.281977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66499c46-6c92-4597-9c49-1bb66ad43d40 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:30.282428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66499c46-6c92-4597-9c49-1bb66ad43d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:30.282925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66499c46-6c92-4597-9c49-1bb66ad43d40 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:30.283921 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66499c46-6c92-4597-9c49-1bb66ad43d40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:30.284424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66499c46-6c92-4597-9c49-1bb66ad43d40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:30.286040 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66499c46-6c92-4597-9c49-1bb66ad43d40 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:30.298106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 186/372] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:30.303493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66499c46-6c92-4597-9c49-1bb66ad43d40 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:30.303893 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48041a47-2608-4f35-b724-541fe96877f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:30.304586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48041a47-2608-4f35-b724-541fe96877f7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:30.304949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48041a47-2608-4f35-b724-541fe96877f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:30.305202 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48041a47-2608-4f35-b724-541fe96877f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:30.378813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48041a47-2608-4f35-b724-541fe96877f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:30.380395 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48041a47-2608-4f35-b724-541fe96877f7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:30.443680 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66499c46-6c92-4597-9c49-1bb66ad43d40 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:30.485799 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 187/373] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:41:30.489196 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6138eef-20b7-4f69-ad78-3832064a9b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:30.490251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6138eef-20b7-4f69-ad78-3832064a9b4b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:30.490630 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6138eef-20b7-4f69-ad78-3832064a9b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:30.491015 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6138eef-20b7-4f69-ad78-3832064a9b4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:30.491747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48041a47-2608-4f35-b724-541fe96877f7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:30.587770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6138eef-20b7-4f69-ad78-3832064a9b4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:30.589331 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6138eef-20b7-4f69-ad78-3832064a9b4b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:30.597471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48041a47-2608-4f35-b724-541fe96877f7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:30.633930 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6b760-d1d5-40ba-8890-2bded0271a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:30.635128 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6b760-d1d5-40ba-8890-2bded0271a94 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:30.635578 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6b760-d1d5-40ba-8890-2bded0271a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:30.636052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6b760-d1d5-40ba-8890-2bded0271a94 None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:30.637535 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6b760-d1d5-40ba-8890-2bded0271a94 None admin] RBAC: Authorizing `identity:get_project(project_id=138bad15d42d49259cf68f4833e7841e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:30.639275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6b760-d1d5-40ba-8890-2bded0271a94 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:30.641563 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 188/374] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:30 2022] GET /identity/v3/projects/138bad15d42d49259cf68f4833e7841e => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:30.647488 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6b760-d1d5-40ba-8890-2bded0271a94 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:30.699662 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 187/375] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 06:41:30.706431 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6138eef-20b7-4f69-ad78-3832064a9b4b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:30.757181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6b760-d1d5-40ba-8890-2bded0271a94 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:30.797585 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e348c02-e798-46fc-80bd-92940234f06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:30.798800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e348c02-e798-46fc-80bd-92940234f06d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:30.799319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e348c02-e798-46fc-80bd-92940234f06d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:30.799813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e348c02-e798-46fc-80bd-92940234f06d None admin] PATH_INFO: `/v3/groups/e1c638522292421fbb997f5ced0ea99c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:30.801212 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e348c02-e798-46fc-80bd-92940234f06d None admin] RBAC: Authorizing `identity:get_group(group_id=e1c638522292421fbb997f5ced0ea99c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:30.810360 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e348c02-e798-46fc-80bd-92940234f06d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:30.812750 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 189/376] 10.222.0.77 () {56 vars in 1180 bytes} [Wed May 11 06:41:30 2022] GET /identity/v3/groups/e1c638522292421fbb997f5ced0ea99c => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:30.818755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e348c02-e798-46fc-80bd-92940234f06d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:30.820053 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6138eef-20b7-4f69-ad78-3832064a9b4b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:30.857682 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61853b-b685-4a69-9e5d-dffe43d66d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:30.858951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61853b-b685-4a69-9e5d-dffe43d66d98 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:30.859451 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61853b-b685-4a69-9e5d-dffe43d66d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:30.859940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61853b-b685-4a69-9e5d-dffe43d66d98 None admin] PATH_INFO: `/v3/projects/486e01030b5e4bfaac8284834098ad35` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:30.861418 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61853b-b685-4a69-9e5d-dffe43d66d98 None admin] RBAC: Authorizing `identity:get_project(project_id=486e01030b5e4bfaac8284834098ad35)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:30.863160 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61853b-b685-4a69-9e5d-dffe43d66d98 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:30.865493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 188/377] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:30 2022] GET /identity/v3/projects/486e01030b5e4bfaac8284834098ad35 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:30.872129 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61853b-b685-4a69-9e5d-dffe43d66d98 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:30.938359 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e348c02-e798-46fc-80bd-92940234f06d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:30.973606 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb30bb4-c64c-47bb-8a2a-a6f00ffffbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:30.974677 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb30bb4-c64c-47bb-8a2a-a6f00ffffbb5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:30.974814 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61853b-b685-4a69-9e5d-dffe43d66d98 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:30.975241 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb30bb4-c64c-47bb-8a2a-a6f00ffffbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:30.975241 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb30bb4-c64c-47bb-8a2a-a6f00ffffbb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:30.976400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb30bb4-c64c-47bb-8a2a-a6f00ffffbb5 None admin] RBAC: Adding query filter params (group.id=e1c638522292421fbb997f5ced0ea99c, role.id=ae6b211774c34f47a3ac4853538f62ad, scope.project.id=138bad15d42d49259cf68f4833e7841e) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:30.977087 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb30bb4-c64c-47bb-8a2a-a6f00ffffbb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:30.978997 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb30bb4-c64c-47bb-8a2a-a6f00ffffbb5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:30.987477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 190/378] 10.222.0.77 () {56 vars in 1376 bytes} [Wed May 11 06:41:30 2022] GET /identity/v3/role_assignments?group.id=e1c638522292421fbb997f5ced0ea99c&scope.project.id=138bad15d42d49259cf68f4833e7841e&role.id=ae6b211774c34f47a3ac4853538f62ad => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:31.011003 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e69b89-589c-41f0-a3f7-3cffaab2ef4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:31.011954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e69b89-589c-41f0-a3f7-3cffaab2ef4d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:31.012276 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e69b89-589c-41f0-a3f7-3cffaab2ef4d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:31.012556 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e69b89-589c-41f0-a3f7-3cffaab2ef4d None admin] PATH_INFO: `/v3/groups/c2eabd42e02845d6bb55133d640baf03` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:31.018223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e69b89-589c-41f0-a3f7-3cffaab2ef4d None admin] RBAC: Authorizing `identity:get_group(group_id=c2eabd42e02845d6bb55133d640baf03)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:31.019736 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e69b89-589c-41f0-a3f7-3cffaab2ef4d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:31.022037 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 189/379] 10.222.0.77 () {56 vars in 1180 bytes} [Wed May 11 06:41:30 2022] GET /identity/v3/groups/c2eabd42e02845d6bb55133d640baf03 => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:31.027922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb30bb4-c64c-47bb-8a2a-a6f00ffffbb5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:31.137070 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb30bb4-c64c-47bb-8a2a-a6f00ffffbb5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:31.179947 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11592c-47a7-4bb9-b2b5-b99cb3baf37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:31.180621 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11592c-47a7-4bb9-b2b5-b99cb3baf37b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:31.180905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11592c-47a7-4bb9-b2b5-b99cb3baf37b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:31.181182 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11592c-47a7-4bb9-b2b5-b99cb3baf37b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:31.182028 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11592c-47a7-4bb9-b2b5-b99cb3baf37b None admin] RBAC: Adding query filter params (group.id=c2eabd42e02845d6bb55133d640baf03, role.id=5debd8ad07a74bedbf2efd53b11cd7cd, scope.project.id=486e01030b5e4bfaac8284834098ad35) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:31.182339 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11592c-47a7-4bb9-b2b5-b99cb3baf37b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:31.183814 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11592c-47a7-4bb9-b2b5-b99cb3baf37b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:31.190868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 191/380] 10.222.0.77 () {56 vars in 1376 bytes} [Wed May 11 06:41:31 2022] GET /identity/v3/role_assignments?group.id=c2eabd42e02845d6bb55133d640baf03&scope.project.id=486e01030b5e4bfaac8284834098ad35&role.id=5debd8ad07a74bedbf2efd53b11cd7cd => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:31.685029 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6575f5-e8b8-47b0-a258-64cf61807990 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:31.685432 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6575f5-e8b8-47b0-a258-64cf61807990 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:31.685621 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6575f5-e8b8-47b0-a258-64cf61807990 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:31.687233 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 190/381] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:31.694119 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48028c-e9ff-4f18-a194-56c859ae91a0 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:31.694410 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48028c-e9ff-4f18-a194-56c859ae91a0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:31.694687 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48028c-e9ff-4f18-a194-56c859ae91a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:31.712249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4a48028c-e9ff-4f18-a194-56c859ae91a0 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:31.713468 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4a48028c-e9ff-4f18-a194-56c859ae91a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:31.779915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 192/382] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:41:31.804306 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6575f5-e8b8-47b0-a258-64cf61807990 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:31.916118 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6575f5-e8b8-47b0-a258-64cf61807990 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:31.950084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd83df-927b-498e-ad58-c1dfbece066a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:31.950821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd83df-927b-498e-ad58-c1dfbece066a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:31.951137 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd83df-927b-498e-ad58-c1dfbece066a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:31.951413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd83df-927b-498e-ad58-c1dfbece066a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:31.961965 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd83df-927b-498e-ad58-c1dfbece066a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:31.970042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-a4fd83df-927b-498e-ad58-c1dfbece066a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:41:31.970042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:31.970042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:31.970042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:31.970042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:31.970042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:31.970042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:31.970042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:31.970042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:31.970042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:31.970042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:31.970042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:31.970042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:31.970042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:31.970042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:31.970042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:31.970924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:31.970924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:31.970924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:31.970924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:31.970924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:31.970924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:31.970924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:31.970924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:31.970924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:31.970924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:31.970924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:31.970924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:31.970924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:31.970924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:31.970924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:31.970924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:31.971763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:31.971763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:31.971763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:31.971763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:31.971763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:31.971763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:31.971763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:31.971763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:31.971763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:31.971763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:31.971763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:41:31.971763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:31.971763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 191/383] 10.222.0.77 () {56 vars in 1114 bytes} [Wed May 11 06:41:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:31.978487 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48028c-e9ff-4f18-a194-56c859ae91a0 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:32.109261 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48028c-e9ff-4f18-a194-56c859ae91a0 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:32.151748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c9b5a-c1e9-49b0-9ef7-80ca8eba4a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:32.152501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c9b5a-c1e9-49b0-9ef7-80ca8eba4a42 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:32.152724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c9b5a-c1e9-49b0-9ef7-80ca8eba4a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:32.153007 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c9b5a-c1e9-49b0-9ef7-80ca8eba4a42 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:32.153769 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c9b5a-c1e9-49b0-9ef7-80ca8eba4a42 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:32.154080 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c9b5a-c1e9-49b0-9ef7-80ca8eba4a42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:32.155507 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c9b5a-c1e9-49b0-9ef7-80ca8eba4a42 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:32.164458 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 193/384] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:41:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:32.170719 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd83df-927b-498e-ad58-c1dfbece066a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:32.317567 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd83df-927b-498e-ad58-c1dfbece066a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:32.361934 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e04e3-ea1f-4cf4-8d06-48d4d27ba119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:32.362798 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e04e3-ea1f-4cf4-8d06-48d4d27ba119 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:32.363100 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e04e3-ea1f-4cf4-8d06-48d4d27ba119 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:32.363372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e04e3-ea1f-4cf4-8d06-48d4d27ba119 None admin] PATH_INFO: `/v3/groups/e1c638522292421fbb997f5ced0ea99c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:32.364530 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e04e3-ea1f-4cf4-8d06-48d4d27ba119 None admin] RBAC: Authorizing `identity:get_group(group_id=e1c638522292421fbb997f5ced0ea99c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:32.366054 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e04e3-ea1f-4cf4-8d06-48d4d27ba119 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:32.368005 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 192/385] 10.222.0.77 () {56 vars in 1180 bytes} [Wed May 11 06:41:32 2022] GET /identity/v3/groups/e1c638522292421fbb997f5ced0ea99c => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:32.373360 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c9b5a-c1e9-49b0-9ef7-80ca8eba4a42 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:32.524078 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c9b5a-c1e9-49b0-9ef7-80ca8eba4a42 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:32.563214 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae3ae2-8aad-4699-b652-e17c64931f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:32.564017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae3ae2-8aad-4699-b652-e17c64931f66 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:32.564299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae3ae2-8aad-4699-b652-e17c64931f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:32.564575 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae3ae2-8aad-4699-b652-e17c64931f66 None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:32.565791 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae3ae2-8aad-4699-b652-e17c64931f66 None admin] RBAC: Authorizing `identity:get_project(project_id=660afb35216c4b94a77b71d73962d86f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:32.567285 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae3ae2-8aad-4699-b652-e17c64931f66 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:32.569398 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 194/386] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:32 2022] GET /identity/v3/projects/660afb35216c4b94a77b71d73962d86f => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:32.575561 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e04e3-ea1f-4cf4-8d06-48d4d27ba119 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:32.717732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e04e3-ea1f-4cf4-8d06-48d4d27ba119 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:32.761654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dce4ed-6ff9-40e2-979f-b2af2a7ce2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:32.762554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dce4ed-6ff9-40e2-979f-b2af2a7ce2ba None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:32.762828 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dce4ed-6ff9-40e2-979f-b2af2a7ce2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:32.763123 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dce4ed-6ff9-40e2-979f-b2af2a7ce2ba None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f/groups/e1c638522292421fbb997f5ced0ea99c/roles/ae6b211774c34f47a3ac4853538f62ad` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:32.765311 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dce4ed-6ff9-40e2-979f-b2af2a7ce2ba None admin] RBAC: Authorizing `identity:create_grant(project_id=660afb35216c4b94a77b71d73962d86f, group_id=e1c638522292421fbb997f5ced0ea99c, role_id=ae6b211774c34f47a3ac4853538f62ad)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:32.766757 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dce4ed-6ff9-40e2-979f-b2af2a7ce2ba None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:32.796408 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 193/387] 10.222.0.77 () {58 vars in 1442 bytes} [Wed May 11 06:41:32 2022] PUT /identity/v3/projects/660afb35216c4b94a77b71d73962d86f/groups/e1c638522292421fbb997f5ced0ea99c/roles/ae6b211774c34f47a3ac4853538f62ad => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:33.118697 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc1a07-9b47-4894-bd6c-998ae471d786 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:33.119121 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc1a07-9b47-4894-bd6c-998ae471d786 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:33.119309 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc1a07-9b47-4894-bd6c-998ae471d786 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:33.120973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 195/388] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:33.128515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22427fab-9c6e-4bcb-9241-8938f8105662 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:33.128919 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22427fab-9c6e-4bcb-9241-8938f8105662 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:33.129209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22427fab-9c6e-4bcb-9241-8938f8105662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:33.147244 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-22427fab-9c6e-4bcb-9241-8938f8105662 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:33.148470 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-22427fab-9c6e-4bcb-9241-8938f8105662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:33.179636 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0835d1d-3bd5-4d1a-9758-31eb9b878c95 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:33.180144 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0835d1d-3bd5-4d1a-9758-31eb9b878c95 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:33.180218 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0835d1d-3bd5-4d1a-9758-31eb9b878c95 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:33.181586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 196/389] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:33.187555 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f7067-9ec3-4417-9ec8-71b682b7cab7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:33.187951 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f7067-9ec3-4417-9ec8-71b682b7cab7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:33.188330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f7067-9ec3-4417-9ec8-71b682b7cab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:33.206640 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-fc4f7067-9ec3-4417-9ec8-71b682b7cab7 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:33.208060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fc4f7067-9ec3-4417-9ec8-71b682b7cab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:33.239077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 194/390] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:33.259499 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22427fab-9c6e-4bcb-9241-8938f8105662 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:33.314218 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 197/391] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:41:33.338590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f7067-9ec3-4417-9ec8-71b682b7cab7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:33.422728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22427fab-9c6e-4bcb-9241-8938f8105662 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:33.437185 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f7067-9ec3-4417-9ec8-71b682b7cab7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:33.475483 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ad0d0-3417-40e4-8350-19019bf6f3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:33.476337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ad0d0-3417-40e4-8350-19019bf6f3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:33.476618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ad0d0-3417-40e4-8350-19019bf6f3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:33.476893 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ad0d0-3417-40e4-8350-19019bf6f3f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:33.489505 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ad0d0-3417-40e4-8350-19019bf6f3f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:33.493270 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3c6d3-6f71-41ee-ba27-8b93241bc5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:33.494141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3c6d3-6f71-41ee-ba27-8b93241bc5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:33.494428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3c6d3-6f71-41ee-ba27-8b93241bc5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:33.494702 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3c6d3-6f71-41ee-ba27-8b93241bc5a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:33.497394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-980ad0d0-3417-40e4-8350-19019bf6f3f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:33.497394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:33.497394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:33.497394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:33.497394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:33.497394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:33.497394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:33.497394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:33.497394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:33.497394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:33.497394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:33.497394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:33.497394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:33.497394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:33.497394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:33.497394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:33.498281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:33.498281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:33.498281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:33.498281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:33.498281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:33.498281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:33.498281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:33.498281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:33.498281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:33.498281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:33.498281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:33.498281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:33.498281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:33.498281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:33.498281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:33.498281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:33.499113 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:33.499113 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:33.499113 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:33.499113 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:33.499113 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:33.499113 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:33.499113 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:33.499113 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:33.499113 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:33.499113 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:33.499113 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:33.499113 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:33.503069 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 198/392] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:41:33.504748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ad0d0-3417-40e4-8350-19019bf6f3f0 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:33.510553 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3c6d3-6f71-41ee-ba27-8b93241bc5a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:33.522808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-49b3c6d3-6f71-41ee-ba27-8b93241bc5a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:33.522808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:33.522808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:33.522808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:33.522808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:33.522808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:33.522808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:33.522808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:33.522808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:33.522808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:33.522808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:33.522808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:33.522808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:33.522808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:33.522808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:33.522808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:33.523786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:33.523786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:33.523786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:33.523786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:33.523786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:33.523786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:33.523786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:33.523786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:33.523786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:33.523786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:33.523786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:33.523786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:33.523786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:33.523786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:33.523786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:33.523786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:33.524575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:33.524575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:33.524575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:33.524575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:33.524575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:33.524575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:33.524575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:33.524575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:33.524575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:33.524575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:33.524575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:33.524575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:33.524575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 195/393] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:41:33.532717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3c6d3-6f71-41ee-ba27-8b93241bc5a8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:33.606119 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ad0d0-3417-40e4-8350-19019bf6f3f0 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:33.639431 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc704ad1-c106-46c1-9ebd-2e174f8c8551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:33.640117 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc704ad1-c106-46c1-9ebd-2e174f8c8551 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:33.640399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc704ad1-c106-46c1-9ebd-2e174f8c8551 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:33.640673 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc704ad1-c106-46c1-9ebd-2e174f8c8551 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:33.641440 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc704ad1-c106-46c1-9ebd-2e174f8c8551 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:33.641748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc704ad1-c106-46c1-9ebd-2e174f8c8551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:33.643163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc704ad1-c106-46c1-9ebd-2e174f8c8551 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:33.656354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 199/394] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:41:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:33.657656 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc704ad1-c106-46c1-9ebd-2e174f8c8551 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:33.675462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3c6d3-6f71-41ee-ba27-8b93241bc5a8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:33.727183 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9fa28-b757-4d27-be77-7c5907ca4bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:33.727920 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9fa28-b757-4d27-be77-7c5907ca4bdb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:33.728206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9fa28-b757-4d27-be77-7c5907ca4bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:33.728488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9fa28-b757-4d27-be77-7c5907ca4bdb None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:33.729237 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9fa28-b757-4d27-be77-7c5907ca4bdb None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:33.729545 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9fa28-b757-4d27-be77-7c5907ca4bdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:33.730948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9fa28-b757-4d27-be77-7c5907ca4bdb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:33.749571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 196/395] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:41:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:33.757513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9fa28-b757-4d27-be77-7c5907ca4bdb None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:33.766371 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc704ad1-c106-46c1-9ebd-2e174f8c8551 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:33.810273 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deba932-0f15-4c99-953e-b1f7ebd09d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:33.811574 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deba932-0f15-4c99-953e-b1f7ebd09d20 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:33.811861 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deba932-0f15-4c99-953e-b1f7ebd09d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:33.812141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deba932-0f15-4c99-953e-b1f7ebd09d20 None admin] PATH_INFO: `/v3/groups/e1c638522292421fbb997f5ced0ea99c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:33.815677 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deba932-0f15-4c99-953e-b1f7ebd09d20 None admin] RBAC: Authorizing `identity:get_group(group_id=e1c638522292421fbb997f5ced0ea99c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:33.817145 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deba932-0f15-4c99-953e-b1f7ebd09d20 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:33.822982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 200/396] 10.222.0.77 () {56 vars in 1180 bytes} [Wed May 11 06:41:33 2022] GET /identity/v3/groups/e1c638522292421fbb997f5ced0ea99c => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:33.828262 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deba932-0f15-4c99-953e-b1f7ebd09d20 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:33.957250 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9fa28-b757-4d27-be77-7c5907ca4bdb None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:33.960938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deba932-0f15-4c99-953e-b1f7ebd09d20 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:33.995168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e18b6-88c1-4487-8c4a-3fb803bd76f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:33.996429 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e18b6-88c1-4487-8c4a-3fb803bd76f8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:33.996940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e18b6-88c1-4487-8c4a-3fb803bd76f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:33.997411 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e18b6-88c1-4487-8c4a-3fb803bd76f8 None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:33.999030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e18b6-88c1-4487-8c4a-3fb803bd76f8 None admin] RBAC: Authorizing `identity:get_project(project_id=138bad15d42d49259cf68f4833e7841e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:34.000890 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e18b6-88c1-4487-8c4a-3fb803bd76f8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:34.001460 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38eb773-dc6d-4d1a-93ea-4ca331231a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:34.002328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38eb773-dc6d-4d1a-93ea-4ca331231a87 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:34.002603 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38eb773-dc6d-4d1a-93ea-4ca331231a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:34.002869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38eb773-dc6d-4d1a-93ea-4ca331231a87 None admin] PATH_INFO: `/v3/groups/e1c638522292421fbb997f5ced0ea99c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:34.008436 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38eb773-dc6d-4d1a-93ea-4ca331231a87 None admin] RBAC: Authorizing `identity:get_group(group_id=e1c638522292421fbb997f5ced0ea99c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:34.008436 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38eb773-dc6d-4d1a-93ea-4ca331231a87 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:34.008436 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 197/398] 10.222.0.77 () {56 vars in 1180 bytes} [Wed May 11 06:41:33 2022] GET /identity/v3/groups/e1c638522292421fbb997f5ced0ea99c => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:34.008816 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14ca0b-25ae-4b50-96d6-00ddcf78d0bd None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:34.009265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14ca0b-25ae-4b50-96d6-00ddcf78d0bd None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:34.009377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14ca0b-25ae-4b50-96d6-00ddcf78d0bd None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:34.009564 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 201/398] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:33 2022] GET /identity/v3/projects/138bad15d42d49259cf68f4833e7841e => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:34.010723 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 198/399] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:34.011381 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e18b6-88c1-4487-8c4a-3fb803bd76f8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:34.015433 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14ca0b-25ae-4b50-96d6-00ddcf78d0bd None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:34.116918 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14ca0b-25ae-4b50-96d6-00ddcf78d0bd None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:34.126521 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e18b6-88c1-4487-8c4a-3fb803bd76f8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:34.157978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ca552-38db-442d-b6b3-6913bf1ca73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:34.158974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ca552-38db-442d-b6b3-6913bf1ca73c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:34.159252 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ca552-38db-442d-b6b3-6913bf1ca73c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:34.159525 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ca552-38db-442d-b6b3-6913bf1ca73c None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:34.160707 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ca552-38db-442d-b6b3-6913bf1ca73c None admin] RBAC: Authorizing `identity:get_project(project_id=660afb35216c4b94a77b71d73962d86f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:34.162442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ca552-38db-442d-b6b3-6913bf1ca73c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:34.163013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792afd12-eb02-4983-af32-aa2798ec6861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:34.164363 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 199/400] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:34 2022] GET /identity/v3/projects/660afb35216c4b94a77b71d73962d86f => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:34.164715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792afd12-eb02-4983-af32-aa2798ec6861 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:34.165293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94f884-3388-4110-a8c9-fab7b05f712a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:34.165554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792afd12-eb02-4983-af32-aa2798ec6861 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:34.165652 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94f884-3388-4110-a8c9-fab7b05f712a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:34.165822 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94f884-3388-4110-a8c9-fab7b05f712a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:34.166295 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792afd12-eb02-4983-af32-aa2798ec6861 None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e/groups/e1c638522292421fbb997f5ced0ea99c/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:34.169103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792afd12-eb02-4983-af32-aa2798ec6861 None admin] RBAC: Authorizing `identity:create_grant(project_id=138bad15d42d49259cf68f4833e7841e, group_id=e1c638522292421fbb997f5ced0ea99c, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:34.170887 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792afd12-eb02-4983-af32-aa2798ec6861 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:34.183799 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5f94f884-3388-4110-a8c9-fab7b05f712a None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:34.185095 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5f94f884-3388-4110-a8c9-fab7b05f712a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:34.195580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 202/401] 10.222.0.77 () {58 vars in 1442 bytes} [Wed May 11 06:41:34 2022] PUT /identity/v3/projects/138bad15d42d49259cf68f4833e7841e/groups/e1c638522292421fbb997f5ced0ea99c/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:34.196117 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792afd12-eb02-4983-af32-aa2798ec6861 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:34.307316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 200/402] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:34.347538 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94f884-3388-4110-a8c9-fab7b05f712a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:34.412084 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792afd12-eb02-4983-af32-aa2798ec6861 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:34.467717 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8731b84-2dc7-4f14-b303-872137233ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:34.469085 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8731b84-2dc7-4f14-b303-872137233ec3 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:34.469371 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8731b84-2dc7-4f14-b303-872137233ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:34.469650 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8731b84-2dc7-4f14-b303-872137233ec3 None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f/groups/e1c638522292421fbb997f5ced0ea99c/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:34.471734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8731b84-2dc7-4f14-b303-872137233ec3 None admin] RBAC: Authorizing `identity:create_grant(project_id=660afb35216c4b94a77b71d73962d86f, group_id=e1c638522292421fbb997f5ced0ea99c, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:34.473759 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8731b84-2dc7-4f14-b303-872137233ec3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:34.497605 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 203/403] 10.222.0.77 () {58 vars in 1442 bytes} [Wed May 11 06:41:34 2022] PUT /identity/v3/projects/660afb35216c4b94a77b71d73962d86f/groups/e1c638522292421fbb997f5ced0ea99c/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:34.499106 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e64748-874a-41f5-949e-0bba927e24dd None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:34.499403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e64748-874a-41f5-949e-0bba927e24dd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:34.499680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e64748-874a-41f5-949e-0bba927e24dd None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:34.501275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 204/404] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:34.507483 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94f884-3388-4110-a8c9-fab7b05f712a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:34.508977 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80769187-7dec-4bea-8a01-242e752715a8 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:34.509494 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80769187-7dec-4bea-8a01-242e752715a8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:34.509987 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80769187-7dec-4bea-8a01-242e752715a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:34.528118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-80769187-7dec-4bea-8a01-242e752715a8 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:34.529758 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-80769187-7dec-4bea-8a01-242e752715a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:34.546362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8f5a3-0ea6-460d-aaa4-7919849ba5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:34.547004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8f5a3-0ea6-460d-aaa4-7919849ba5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:34.547293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8f5a3-0ea6-460d-aaa4-7919849ba5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:34.547570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8f5a3-0ea6-460d-aaa4-7919849ba5f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:34.559178 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8f5a3-0ea6-460d-aaa4-7919849ba5f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:34.567297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-e6d8f5a3-0ea6-460d-aaa4-7919849ba5f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:41:34.567297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:34.567297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:34.567297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:34.567297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:34.567297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:34.567297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:34.567297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:34.567297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:34.567297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:34.567297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:34.567297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:34.567297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:34.567297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:34.567297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:34.567297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:34.568342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:34.568342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:34.568342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:34.568342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:34.568342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:34.568342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:34.568342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:34.568342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:34.568342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:34.568342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:34.568342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:34.568342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:34.568342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:34.568342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:34.568342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:34.568342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:34.569193 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:34.569193 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:34.569193 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:34.569193 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:34.569193 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:34.569193 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:34.569193 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:34.569193 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:34.569193 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:34.569193 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:34.569193 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:41:34.569193 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:34.569193 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 201/405] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:41:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:41:34.576672 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8f5a3-0ea6-460d-aaa4-7919849ba5f5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:34.606304 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 205/406] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:34.629575 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80769187-7dec-4bea-8a01-242e752715a8 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:34.729376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80769187-7dec-4bea-8a01-242e752715a8 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:34.738163 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8f5a3-0ea6-460d-aaa4-7919849ba5f5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:34.764111 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e681f7-5a40-44cd-b03d-23d86d357d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:34.765289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e681f7-5a40-44cd-b03d-23d86d357d43 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:34.766501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e681f7-5a40-44cd-b03d-23d86d357d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:34.766501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e681f7-5a40-44cd-b03d-23d86d357d43 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:34.776899 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e681f7-5a40-44cd-b03d-23d86d357d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:34.785541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f8e681f7-5a40-44cd-b03d-23d86d357d43 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:41:34.785541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:34.785541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:34.785541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:34.785541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:34.785541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:34.785541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:34.785541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:34.785541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:34.785541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:34.785541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:34.785541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:34.785541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:34.785541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:34.785541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:34.785541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:34.786515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:34.786515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:34.786515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:34.786515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:34.786515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:34.786515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:34.786515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:34.786515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:34.786515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:34.786515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:34.786515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:34.786515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:34.786515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:34.786515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:34.786515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:34.786515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:34.787402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:34.787402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:34.787402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:34.787402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:34.787402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:34.787402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:34.787402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:34.787402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:34.787402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:34.787402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:34.787402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:41:34.787402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:34.790222 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 206/407] 10.222.0.77 () {56 vars in 1114 bytes} [Wed May 11 06:41:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:34.796444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e681f7-5a40-44cd-b03d-23d86d357d43 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:34.801246 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd929e92-ee64-4eb4-b034-553ac1291951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:34.801445 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd929e92-ee64-4eb4-b034-553ac1291951 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:34.801572 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd929e92-ee64-4eb4-b034-553ac1291951 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:34.801847 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd929e92-ee64-4eb4-b034-553ac1291951 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:34.802686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd929e92-ee64-4eb4-b034-553ac1291951 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:34.803007 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd929e92-ee64-4eb4-b034-553ac1291951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:34.804420 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd929e92-ee64-4eb4-b034-553ac1291951 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:34.819163 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 202/408] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:34.821715 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd929e92-ee64-4eb4-b034-553ac1291951 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:34.899579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e681f7-5a40-44cd-b03d-23d86d357d43 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:34.925301 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd929e92-ee64-4eb4-b034-553ac1291951 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:34.938347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5f288-e480-4675-b172-d13707b897bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:34.939822 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5f288-e480-4675-b172-d13707b897bb None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:34.940412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5f288-e480-4675-b172-d13707b897bb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:34.940863 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5f288-e480-4675-b172-d13707b897bb None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:34.941947 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5f288-e480-4675-b172-d13707b897bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:34.942710 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5f288-e480-4675-b172-d13707b897bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:34.944369 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5f288-e480-4675-b172-d13707b897bb None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:34.956286 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 207/409] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:41:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:34.962926 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5f288-e480-4675-b172-d13707b897bb None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:34.963852 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4833f4-d587-45ca-acb6-f0863ee22368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:34.964803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4833f4-d587-45ca-acb6-f0863ee22368 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:34.965155 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4833f4-d587-45ca-acb6-f0863ee22368 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:34.965502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4833f4-d587-45ca-acb6-f0863ee22368 None admin] PATH_INFO: `/v3/groups/c2eabd42e02845d6bb55133d640baf03` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:34.966814 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4833f4-d587-45ca-acb6-f0863ee22368 None admin] RBAC: Authorizing `identity:get_group(group_id=c2eabd42e02845d6bb55133d640baf03)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:34.968384 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4833f4-d587-45ca-acb6-f0863ee22368 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:34.975782 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 203/410] 10.222.0.77 () {56 vars in 1180 bytes} [Wed May 11 06:41:34 2022] GET /identity/v3/groups/c2eabd42e02845d6bb55133d640baf03 => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:34.976677 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4833f4-d587-45ca-acb6-f0863ee22368 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:35.107625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4833f4-d587-45ca-acb6-f0863ee22368 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:35.112199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5f288-e480-4675-b172-d13707b897bb None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:35.150880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08bee3-3494-4212-bad7-ece5fb29ee1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:35.152168 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08bee3-3494-4212-bad7-ece5fb29ee1e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:35.152643 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08bee3-3494-4212-bad7-ece5fb29ee1e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:35.153151 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08bee3-3494-4212-bad7-ece5fb29ee1e None admin] PATH_INFO: `/v3/projects/486e01030b5e4bfaac8284834098ad35` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:35.154542 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08bee3-3494-4212-bad7-ece5fb29ee1e None admin] RBAC: Authorizing `identity:get_project(project_id=486e01030b5e4bfaac8284834098ad35)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:35.156226 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08bee3-3494-4212-bad7-ece5fb29ee1e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:35.158454 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 204/411] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:34 2022] GET /identity/v3/projects/486e01030b5e4bfaac8284834098ad35 => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:35.166801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82c4ba-6224-4673-817f-7bddbe249011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:35.167727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82c4ba-6224-4673-817f-7bddbe249011 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:35.168010 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82c4ba-6224-4673-817f-7bddbe249011 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:35.168287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82c4ba-6224-4673-817f-7bddbe249011 None admin] PATH_INFO: `/v3/groups/e1c638522292421fbb997f5ced0ea99c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:35.169604 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82c4ba-6224-4673-817f-7bddbe249011 None admin] RBAC: Authorizing `identity:get_group(group_id=e1c638522292421fbb997f5ced0ea99c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:35.170282 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08bee3-3494-4212-bad7-ece5fb29ee1e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:35.171078 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82c4ba-6224-4673-817f-7bddbe249011 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:35.174108 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 208/412] 10.222.0.77 () {56 vars in 1180 bytes} [Wed May 11 06:41:34 2022] GET /identity/v3/groups/e1c638522292421fbb997f5ced0ea99c => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:35.178716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82c4ba-6224-4673-817f-7bddbe249011 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:35.285727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82c4ba-6224-4673-817f-7bddbe249011 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:35.342709 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43152ad9-0e79-4e31-afd9-defccd9240ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:35.343623 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43152ad9-0e79-4e31-afd9-defccd9240ca None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:35.343899 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43152ad9-0e79-4e31-afd9-defccd9240ca None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:35.344170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43152ad9-0e79-4e31-afd9-defccd9240ca None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:35.345477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43152ad9-0e79-4e31-afd9-defccd9240ca None admin] RBAC: Authorizing `identity:get_project(project_id=138bad15d42d49259cf68f4833e7841e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:35.346933 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43152ad9-0e79-4e31-afd9-defccd9240ca None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:35.348694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 209/413] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:35 2022] GET /identity/v3/projects/138bad15d42d49259cf68f4833e7841e => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:35.355897 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43152ad9-0e79-4e31-afd9-defccd9240ca None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:35.371199 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08bee3-3494-4212-bad7-ece5fb29ee1e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:35.438224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153777d8-7c0a-4e89-bf75-3fb6602b2b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:35.439544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153777d8-7c0a-4e89-bf75-3fb6602b2b30 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:35.440046 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153777d8-7c0a-4e89-bf75-3fb6602b2b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:35.440564 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153777d8-7c0a-4e89-bf75-3fb6602b2b30 None admin] PATH_INFO: `/v3/projects/486e01030b5e4bfaac8284834098ad35/groups/c2eabd42e02845d6bb55133d640baf03/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:35.442939 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153777d8-7c0a-4e89-bf75-3fb6602b2b30 None admin] RBAC: Authorizing `identity:create_grant(project_id=486e01030b5e4bfaac8284834098ad35, group_id=c2eabd42e02845d6bb55133d640baf03, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:35.445689 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153777d8-7c0a-4e89-bf75-3fb6602b2b30 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:35.471424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 205/414] 10.222.0.77 () {58 vars in 1442 bytes} [Wed May 11 06:41:35 2022] PUT /identity/v3/projects/486e01030b5e4bfaac8284834098ad35/groups/c2eabd42e02845d6bb55133d640baf03/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:41:35.541167 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43152ad9-0e79-4e31-afd9-defccd9240ca None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:35.592971 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cd90c-f226-4f82-884e-2300d7f390e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:35.593932 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cd90c-f226-4f82-884e-2300d7f390e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:35.594217 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cd90c-f226-4f82-884e-2300d7f390e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:35.594493 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cd90c-f226-4f82-884e-2300d7f390e2 None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e/groups/e1c638522292421fbb997f5ced0ea99c/roles/ae6b211774c34f47a3ac4853538f62ad` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:35.597068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11cd90c-f226-4f82-884e-2300d7f390e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=138bad15d42d49259cf68f4833e7841e, group_id=e1c638522292421fbb997f5ced0ea99c, role_id=ae6b211774c34f47a3ac4853538f62ad)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:35.598612 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11cd90c-f226-4f82-884e-2300d7f390e2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:35.626634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 210/415] 10.222.0.77 () {58 vars in 1442 bytes} [Wed May 11 06:41:35 2022] PUT /identity/v3/projects/138bad15d42d49259cf68f4833e7841e/groups/e1c638522292421fbb997f5ced0ea99c/roles/ae6b211774c34f47a3ac4853538f62ad => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:35.716336 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63acb79-9354-4bcb-bac7-70c3e954f323 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:35.716653 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63acb79-9354-4bcb-bac7-70c3e954f323 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:35.716893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63acb79-9354-4bcb-bac7-70c3e954f323 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:35.718522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 206/416] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:35.724291 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e16b1-45b9-41e0-afa8-2fe7677ed29a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:35.724633 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e16b1-45b9-41e0-afa8-2fe7677ed29a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:35.724856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e16b1-45b9-41e0-afa8-2fe7677ed29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:35.746353 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3a9e16b1-45b9-41e0-afa8-2fe7677ed29a None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:35.749138 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3a9e16b1-45b9-41e0-afa8-2fe7677ed29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:35.825235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 211/417] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:35.849036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63acb79-9354-4bcb-bac7-70c3e954f323 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:35.961051 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63acb79-9354-4bcb-bac7-70c3e954f323 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:36.002394 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035d29d-9eda-462d-8aeb-9db8459ffe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:36.003246 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035d29d-9eda-462d-8aeb-9db8459ffe1d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:36.003528 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035d29d-9eda-462d-8aeb-9db8459ffe1d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:36.003803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035d29d-9eda-462d-8aeb-9db8459ffe1d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:36.014087 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035d29d-9eda-462d-8aeb-9db8459ffe1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:36.022400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-7035d29d-9eda-462d-8aeb-9db8459ffe1d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:41:36.022400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:36.022400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:36.022400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:36.022400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:36.022400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:36.022400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:36.022400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:36.022400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:36.022400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:36.022400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:36.022400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:36.022400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:36.022400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:36.022400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:36.022400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:36.023358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:36.023358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:36.023358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:36.023358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:36.023358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:36.023358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:36.023358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:36.023358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:36.023358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:36.023358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:36.023358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:36.023358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:36.023358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:36.023358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:36.023358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:36.023358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:36.024171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:36.024171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:36.024171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:36.024171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:36.024171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:36.024171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:36.024171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:36.024171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:36.024171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:36.024171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:36.024171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:41:36.024171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:36.025792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 207/418] 10.222.0.77 () {56 vars in 1114 bytes} [Wed May 11 06:41:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:36.031414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e16b1-45b9-41e0-afa8-2fe7677ed29a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:36.150620 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e16b1-45b9-41e0-afa8-2fe7677ed29a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:36.184459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5b9a9-169f-4b2d-a9d0-efdc9b7de1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:36.185147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5b9a9-169f-4b2d-a9d0-efdc9b7de1bc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:36.185428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5b9a9-169f-4b2d-a9d0-efdc9b7de1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:36.185701 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5b9a9-169f-4b2d-a9d0-efdc9b7de1bc None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:36.186453 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5b9a9-169f-4b2d-a9d0-efdc9b7de1bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:36.186760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5b9a9-169f-4b2d-a9d0-efdc9b7de1bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:36.188194 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5b9a9-169f-4b2d-a9d0-efdc9b7de1bc None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:36.196990 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 212/419] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:41:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:36.202494 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035d29d-9eda-462d-8aeb-9db8459ffe1d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:36.312833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035d29d-9eda-462d-8aeb-9db8459ffe1d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:36.346181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d327f8-52c5-4bfe-a91d-8a97da022662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:36.346841 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d327f8-52c5-4bfe-a91d-8a97da022662 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:36.347174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d327f8-52c5-4bfe-a91d-8a97da022662 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:36.347453 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d327f8-52c5-4bfe-a91d-8a97da022662 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:36.415463 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d327f8-52c5-4bfe-a91d-8a97da022662 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:36.416931 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d327f8-52c5-4bfe-a91d-8a97da022662 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:36.513283 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 208/420] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 06:41:36.518852 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5b9a9-169f-4b2d-a9d0-efdc9b7de1bc None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:36.638771 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5b9a9-169f-4b2d-a9d0-efdc9b7de1bc None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:36.685979 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c89c64-629a-422f-9e52-49f0d390737b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:36.686875 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c89c64-629a-422f-9e52-49f0d390737b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:36.687174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c89c64-629a-422f-9e52-49f0d390737b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:36.687454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c89c64-629a-422f-9e52-49f0d390737b None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:36.688673 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c89c64-629a-422f-9e52-49f0d390737b None admin] RBAC: Authorizing `identity:get_project(project_id=660afb35216c4b94a77b71d73962d86f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:36.690122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c89c64-629a-422f-9e52-49f0d390737b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:36.691871 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 213/421] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:36 2022] GET /identity/v3/projects/660afb35216c4b94a77b71d73962d86f => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:36.697969 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d327f8-52c5-4bfe-a91d-8a97da022662 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:36.823730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84fe59-4831-4e7a-9aa7-9520773024f3 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:36.824084 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84fe59-4831-4e7a-9aa7-9520773024f3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:36.824291 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84fe59-4831-4e7a-9aa7-9520773024f3 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:36.825802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 214/422] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:36.830769 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d327f8-52c5-4bfe-a91d-8a97da022662 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:36.831744 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31a769-7d57-4410-88a1-b97d36d23646 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:36.832032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31a769-7d57-4410-88a1-b97d36d23646 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:36.832311 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31a769-7d57-4410-88a1-b97d36d23646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:36.863596 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-de31a769-7d57-4410-88a1-b97d36d23646 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:36.864852 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-de31a769-7d57-4410-88a1-b97d36d23646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:36.870404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc6f93-845b-4264-9d81-8e6254ed2a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:36.871300 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc6f93-845b-4264-9d81-8e6254ed2a77 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:36.871579 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc6f93-845b-4264-9d81-8e6254ed2a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:36.871850 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc6f93-845b-4264-9d81-8e6254ed2a77 None admin] PATH_INFO: `/v3/groups/e1c638522292421fbb997f5ced0ea99c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:36.877226 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc6f93-845b-4264-9d81-8e6254ed2a77 None admin] RBAC: Authorizing `identity:get_group(group_id=e1c638522292421fbb997f5ced0ea99c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:36.878752 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc6f93-845b-4264-9d81-8e6254ed2a77 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:36.880826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 209/423] 10.222.0.77 () {56 vars in 1180 bytes} [Wed May 11 06:41:36 2022] GET /identity/v3/groups/e1c638522292421fbb997f5ced0ea99c => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:36.887952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc6f93-845b-4264-9d81-8e6254ed2a77 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:36.948978 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 215/424] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:41:36.971993 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31a769-7d57-4410-88a1-b97d36d23646 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:37.072492 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc6f93-845b-4264-9d81-8e6254ed2a77 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:37.095045 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31a769-7d57-4410-88a1-b97d36d23646 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:37.133416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91025fa0-7a7a-4407-a10d-4d18a2b0040f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:37.134230 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91025fa0-7a7a-4407-a10d-4d18a2b0040f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:37.134511 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91025fa0-7a7a-4407-a10d-4d18a2b0040f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:37.134784 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91025fa0-7a7a-4407-a10d-4d18a2b0040f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:37.153695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e9ca4-6d5d-4184-ac51-bdadeb34e3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:37.154398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e9ca4-6d5d-4184-ac51-bdadeb34e3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:37.154674 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e9ca4-6d5d-4184-ac51-bdadeb34e3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:37.154945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e9ca4-6d5d-4184-ac51-bdadeb34e3d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:37.155807 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e9ca4-6d5d-4184-ac51-bdadeb34e3d4 None admin] RBAC: Adding query filter params (group.id=e1c638522292421fbb997f5ced0ea99c, role.id=ae6b211774c34f47a3ac4853538f62ad, scope.project.id=660afb35216c4b94a77b71d73962d86f) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:37.156517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91025fa0-7a7a-4407-a10d-4d18a2b0040f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:37.164017 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e9ca4-6d5d-4184-ac51-bdadeb34e3d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:37.165467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e9ca4-6d5d-4184-ac51-bdadeb34e3d4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:37.167600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-91025fa0-7a7a-4407-a10d-4d18a2b0040f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:37.167600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:37.167600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:37.167600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:37.167600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:37.167600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:37.167600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:37.167600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:37.167600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:37.167600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:37.167600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:37.167600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:37.167600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:37.167600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:37.167600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:37.167600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:37.168477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:37.168477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:37.168477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:37.168477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:37.168477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:37.168477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:37.168477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:37.168477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:37.168477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:37.168477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:37.168477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:37.168477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:37.168477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:37.168477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:37.168477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:37.168477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:37.169266 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:37.169266 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:37.169266 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:37.169266 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:37.169266 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:37.169266 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:37.169266 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:37.169266 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:37.169266 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:37.169266 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:37.169266 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:37.169266 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:37.169266 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 216/425] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:41:37.173557 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 210/426] 10.222.0.77 () {56 vars in 1376 bytes} [Wed May 11 06:41:36 2022] GET /identity/v3/role_assignments?group.id=e1c638522292421fbb997f5ced0ea99c&scope.project.id=660afb35216c4b94a77b71d73962d86f&role.id=ae6b211774c34f47a3ac4853538f62ad => generated 611 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:37.178616 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91025fa0-7a7a-4407-a10d-4d18a2b0040f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:37.358203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91025fa0-7a7a-4407-a10d-4d18a2b0040f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:37.412544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baa083-ebe4-43b4-a504-82bba92a1944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:37.413621 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baa083-ebe4-43b4-a504-82bba92a1944 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:37.414091 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baa083-ebe4-43b4-a504-82bba92a1944 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:37.414554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baa083-ebe4-43b4-a504-82bba92a1944 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:37.415528 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baa083-ebe4-43b4-a504-82bba92a1944 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:37.416040 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baa083-ebe4-43b4-a504-82bba92a1944 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:37.417648 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baa083-ebe4-43b4-a504-82bba92a1944 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:37.426661 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 217/427] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:41:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:37.432830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e9ca4-6d5d-4184-ac51-bdadeb34e3d4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:37.481235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a223384-f642-4808-941c-77a8b096ce34 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:37.481949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a223384-f642-4808-941c-77a8b096ce34 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:37.482420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a223384-f642-4808-941c-77a8b096ce34 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:37.484079 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 218/428] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:41:37.490298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36029ce-6e6f-44f0-b356-2f6e246e122a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:37.490585 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36029ce-6e6f-44f0-b356-2f6e246e122a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:37.490861 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36029ce-6e6f-44f0-b356-2f6e246e122a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:37.507838 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a36029ce-6e6f-44f0-b356-2f6e246e122a None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:37.511013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a36029ce-6e6f-44f0-b356-2f6e246e122a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:37.597342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e9ca4-6d5d-4184-ac51-bdadeb34e3d4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:37.604687 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 219/429] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:37.629748 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04829f21-ecc3-4c1f-8231-57f21b424318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:37.630462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04829f21-ecc3-4c1f-8231-57f21b424318 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:37.630838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04829f21-ecc3-4c1f-8231-57f21b424318 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:37.631226 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04829f21-ecc3-4c1f-8231-57f21b424318 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:37.634306 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36029ce-6e6f-44f0-b356-2f6e246e122a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:37.703887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04829f21-ecc3-4c1f-8231-57f21b424318 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:37.705720 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04829f21-ecc3-4c1f-8231-57f21b424318 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:37.738129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36029ce-6e6f-44f0-b356-2f6e246e122a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:37.772980 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1205428-6b6e-4f23-9caa-2f1255ad0bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:37.774061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1205428-6b6e-4f23-9caa-2f1255ad0bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:37.774061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1205428-6b6e-4f23-9caa-2f1255ad0bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:37.774339 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1205428-6b6e-4f23-9caa-2f1255ad0bf6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:37.784736 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1205428-6b6e-4f23-9caa-2f1255ad0bf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:37.792501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c1205428-6b6e-4f23-9caa-2f1255ad0bf6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:37.792501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:37.792501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:37.792501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:37.792501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:37.792501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:37.792501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:37.792501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:37.792501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:37.792501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:37.792501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:37.792501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:37.792501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:37.792501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:37.792501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:37.792501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:37.793515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:37.793515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:37.793515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:37.793515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:37.793515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:37.793515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:37.793515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:37.793515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:37.793515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:37.793515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:37.793515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:37.793515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:37.793515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:37.793515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:37.793515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:37.793515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:37.794731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:37.794731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:37.794731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:37.794731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:37.794731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:37.794731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:37.794731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:37.794731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:37.794731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:37.794731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:37.794731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:41:37.794731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:37.794731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 220/430] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:41:37.799619 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1205428-6b6e-4f23-9caa-2f1255ad0bf6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:37.812758 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 211/431] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:41:37.815296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04829f21-ecc3-4c1f-8231-57f21b424318 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:37.896325 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1205428-6b6e-4f23-9caa-2f1255ad0bf6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:37.911865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04829f21-ecc3-4c1f-8231-57f21b424318 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:37.939744 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e68ed-edc6-4138-a621-3c76d8a8b79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:37.940441 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e68ed-edc6-4138-a621-3c76d8a8b79c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:37.940721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e68ed-edc6-4138-a621-3c76d8a8b79c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:37.940995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e68ed-edc6-4138-a621-3c76d8a8b79c None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:37.942007 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e68ed-edc6-4138-a621-3c76d8a8b79c None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:37.942315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e68ed-edc6-4138-a621-3c76d8a8b79c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:37.943993 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e68ed-edc6-4138-a621-3c76d8a8b79c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:37.951584 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07774041-d8dd-420b-b899-d0db085c45bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:37.952744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07774041-d8dd-420b-b899-d0db085c45bf None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:37.953241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07774041-d8dd-420b-b899-d0db085c45bf None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:37.953714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07774041-d8dd-420b-b899-d0db085c45bf None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:37.955206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07774041-d8dd-420b-b899-d0db085c45bf None admin] RBAC: Authorizing `identity:get_project(project_id=138bad15d42d49259cf68f4833e7841e)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:37.956451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 221/432] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:41:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:37.957463 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07774041-d8dd-420b-b899-d0db085c45bf None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:37.964044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e68ed-edc6-4138-a621-3c76d8a8b79c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:37.964358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 212/433] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:37 2022] GET /identity/v3/projects/138bad15d42d49259cf68f4833e7841e => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:37.965741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07774041-d8dd-420b-b899-d0db085c45bf None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:38.057949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e68ed-edc6-4138-a621-3c76d8a8b79c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:38.069056 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07774041-d8dd-420b-b899-d0db085c45bf None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:38.094367 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37aadc0-e0c7-4496-a00c-c3b250390454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:38.095066 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37aadc0-e0c7-4496-a00c-c3b250390454 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:38.095349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37aadc0-e0c7-4496-a00c-c3b250390454 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:38.095622 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37aadc0-e0c7-4496-a00c-c3b250390454 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:38.112454 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c98f47-eb38-4381-8e6f-8d2cdc689a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:38.113700 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c98f47-eb38-4381-8e6f-8d2cdc689a94 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:38.114213 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c98f47-eb38-4381-8e6f-8d2cdc689a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:38.114682 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c98f47-eb38-4381-8e6f-8d2cdc689a94 None admin] PATH_INFO: `/v3/groups/e1c638522292421fbb997f5ced0ea99c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:38.116200 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c98f47-eb38-4381-8e6f-8d2cdc689a94 None admin] RBAC: Authorizing `identity:get_group(group_id=e1c638522292421fbb997f5ced0ea99c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:38.117894 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c98f47-eb38-4381-8e6f-8d2cdc689a94 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:38.124801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 213/434] 10.222.0.77 () {56 vars in 1180 bytes} [Wed May 11 06:41:37 2022] GET /identity/v3/groups/e1c638522292421fbb997f5ced0ea99c => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:38.126262 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c98f47-eb38-4381-8e6f-8d2cdc689a94 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:38.163148 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37aadc0-e0c7-4496-a00c-c3b250390454 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:38.164562 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37aadc0-e0c7-4496-a00c-c3b250390454 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:38.225247 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c98f47-eb38-4381-8e6f-8d2cdc689a94 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:38.259917 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc040f-2d4e-42ee-87e3-2a2eaee7039f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:38.260170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 222/435] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 06:41:38.261026 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc040f-2d4e-42ee-87e3-2a2eaee7039f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:38.261470 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc040f-2d4e-42ee-87e3-2a2eaee7039f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:38.261886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc040f-2d4e-42ee-87e3-2a2eaee7039f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:38.262878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc040f-2d4e-42ee-87e3-2a2eaee7039f None admin] RBAC: Adding query filter params (group.id=e1c638522292421fbb997f5ced0ea99c, role.id=f8d42be71f034e1a88784699c04e7a89, scope.project.id=138bad15d42d49259cf68f4833e7841e) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:38.263368 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc040f-2d4e-42ee-87e3-2a2eaee7039f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:38.265013 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc040f-2d4e-42ee-87e3-2a2eaee7039f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:38.265650 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3afea4-4a19-4faa-b863-285958c28332 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:38.265934 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3afea4-4a19-4faa-b863-285958c28332 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:38.266204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3afea4-4a19-4faa-b863-285958c28332 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:38.267509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 223/436] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:38.268175 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3afea4-4a19-4faa-b863-285958c28332 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:38.278984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 214/437] 10.222.0.77 () {56 vars in 1376 bytes} [Wed May 11 06:41:38 2022] GET /identity/v3/role_assignments?group.id=e1c638522292421fbb997f5ced0ea99c&scope.project.id=138bad15d42d49259cf68f4833e7841e&role.id=f8d42be71f034e1a88784699c04e7a89 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:38.278984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b1fd4-0aeb-4083-823f-e04793ae62ad None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:38.278984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b1fd4-0aeb-4083-823f-e04793ae62ad None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:38.278984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b1fd4-0aeb-4083-823f-e04793ae62ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:38.299914 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-155b1fd4-0aeb-4083-823f-e04793ae62ad None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:38.301235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-155b1fd4-0aeb-4083-823f-e04793ae62ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:38.377183 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 215/438] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:38.400358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b1fd4-0aeb-4083-823f-e04793ae62ad None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:38.420852 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3afea4-4a19-4faa-b863-285958c28332 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:38.458524 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c04e9-36cd-4a28-80a3-db2b160b9591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:38.459524 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c04e9-36cd-4a28-80a3-db2b160b9591 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:38.459856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c04e9-36cd-4a28-80a3-db2b160b9591 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:38.460134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c04e9-36cd-4a28-80a3-db2b160b9591 None admin] PATH_INFO: `/v3/projects/660afb35216c4b94a77b71d73962d86f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:38.461404 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c04e9-36cd-4a28-80a3-db2b160b9591 None admin] RBAC: Authorizing `identity:get_project(project_id=660afb35216c4b94a77b71d73962d86f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:38.462991 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c04e9-36cd-4a28-80a3-db2b160b9591 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:38.465527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 224/439] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:38 2022] GET /identity/v3/projects/660afb35216c4b94a77b71d73962d86f => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:38.470337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c04e9-36cd-4a28-80a3-db2b160b9591 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:38.532546 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b1fd4-0aeb-4083-823f-e04793ae62ad None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:38.568968 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dbb1f-706d-4b90-8982-80b7beaddeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:38.569810 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dbb1f-706d-4b90-8982-80b7beaddeef None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:38.570095 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dbb1f-706d-4b90-8982-80b7beaddeef None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:38.570369 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dbb1f-706d-4b90-8982-80b7beaddeef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:38.574106 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c04e9-36cd-4a28-80a3-db2b160b9591 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:38.580651 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97dbb1f-706d-4b90-8982-80b7beaddeef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:38.588376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-a97dbb1f-706d-4b90-8982-80b7beaddeef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:41:38.588376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:38.588376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:38.588376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:38.588376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:38.588376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:38.588376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:38.588376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:38.588376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:38.588376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:38.588376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:38.588376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:38.588376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:38.588376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:38.588376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:38.588376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:38.589303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:38.589303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:38.589303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:38.589303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:38.589303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:38.589303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:38.589303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:38.589303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:38.589303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:38.589303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:38.589303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:38.589303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:38.589303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:38.589303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:38.589303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:38.589303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:38.590103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:38.590103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:38.590103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:38.590103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:38.590103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:38.590103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:38.590103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:38.590103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:38.590103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:38.590103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:38.590103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:41:38.590103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:38.590103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 216/440] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:41:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:41:38.591287 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee4d0d-279f-4e09-aeff-75d6ea4728f6 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:38.591554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee4d0d-279f-4e09-aeff-75d6ea4728f6 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:38.591831 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee4d0d-279f-4e09-aeff-75d6ea4728f6 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:38.593199 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 217/441] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:38.595200 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee4d0d-279f-4e09-aeff-75d6ea4728f6 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:38.607743 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff1cf3-8889-4f47-997a-1290f6f12bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:38.608614 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff1cf3-8889-4f47-997a-1290f6f12bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:38.608903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff1cf3-8889-4f47-997a-1290f6f12bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:38.609180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff1cf3-8889-4f47-997a-1290f6f12bb7 None admin] PATH_INFO: `/v3/groups/e1c638522292421fbb997f5ced0ea99c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:38.610386 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff1cf3-8889-4f47-997a-1290f6f12bb7 None admin] RBAC: Authorizing `identity:get_group(group_id=e1c638522292421fbb997f5ced0ea99c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:38.611870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff1cf3-8889-4f47-997a-1290f6f12bb7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:38.613526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 225/442] 10.222.0.77 () {56 vars in 1180 bytes} [Wed May 11 06:41:38 2022] GET /identity/v3/groups/e1c638522292421fbb997f5ced0ea99c => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:38.614638 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa98c4-852d-43aa-ad46-e5e5ee871f14 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:38.614953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa98c4-852d-43aa-ad46-e5e5ee871f14 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:38.615295 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa98c4-852d-43aa-ad46-e5e5ee871f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:38.631213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4cfa98c4-852d-43aa-ad46-e5e5ee871f14 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:38.633499 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4cfa98c4-852d-43aa-ad46-e5e5ee871f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:38.696651 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 226/443] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:38.697387 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa98c4-852d-43aa-ad46-e5e5ee871f14 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:38.697787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee4d0d-279f-4e09-aeff-75d6ea4728f6 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:38.730645 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad7beb-45db-480b-a261-28338e6a5a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:38.731340 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad7beb-45db-480b-a261-28338e6a5a50 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:38.731620 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad7beb-45db-480b-a261-28338e6a5a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:38.731896 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad7beb-45db-480b-a261-28338e6a5a50 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:38.732640 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad7beb-45db-480b-a261-28338e6a5a50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:38.732945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad7beb-45db-480b-a261-28338e6a5a50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:38.734357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad7beb-45db-480b-a261-28338e6a5a50 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:38.742702 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 218/444] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:38.743504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad7beb-45db-480b-a261-28338e6a5a50 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:38.790445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa98c4-852d-43aa-ad46-e5e5ee871f14 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:38.823590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aef3de-da7c-41ba-af2c-a3f53bf19405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:38.824236 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aef3de-da7c-41ba-af2c-a3f53bf19405 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:38.824516 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aef3de-da7c-41ba-af2c-a3f53bf19405 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:38.824787 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aef3de-da7c-41ba-af2c-a3f53bf19405 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:38.825601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aef3de-da7c-41ba-af2c-a3f53bf19405 None admin] RBAC: Adding query filter params (group.id=e1c638522292421fbb997f5ced0ea99c, role.id=f8d42be71f034e1a88784699c04e7a89, scope.project.id=660afb35216c4b94a77b71d73962d86f) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:38.825906 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aef3de-da7c-41ba-af2c-a3f53bf19405 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:38.827371 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aef3de-da7c-41ba-af2c-a3f53bf19405 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:38.833345 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 227/445] 10.222.0.77 () {56 vars in 1376 bytes} [Wed May 11 06:41:38 2022] GET /identity/v3/role_assignments?group.id=e1c638522292421fbb997f5ced0ea99c&scope.project.id=660afb35216c4b94a77b71d73962d86f&role.id=f8d42be71f034e1a88784699c04e7a89 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:38.833942 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aef3de-da7c-41ba-af2c-a3f53bf19405 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:38.849568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad7beb-45db-480b-a261-28338e6a5a50 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:38.886419 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1b6a1-240f-40d3-93b3-ae9bea42594a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:38.887280 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1b6a1-240f-40d3-93b3-ae9bea42594a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:38.887562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1b6a1-240f-40d3-93b3-ae9bea42594a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:38.887859 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1b6a1-240f-40d3-93b3-ae9bea42594a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:38.899437 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1b6a1-240f-40d3-93b3-ae9bea42594a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:38.907826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-6fe1b6a1-240f-40d3-93b3-ae9bea42594a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:41:38.907826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:38.907826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:38.907826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:38.907826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:38.907826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:38.907826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:38.907826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:38.907826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:38.907826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:38.907826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:38.907826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:38.907826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:38.907826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:38.907826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:38.907826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:38.908977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:38.908977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:38.908977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:38.908977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:38.908977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:38.908977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:38.908977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:38.908977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:38.908977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:38.908977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:38.908977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:38.908977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:38.908977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:38.908977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:38.908977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:38.908977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:38.909944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:38.909944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:38.909944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:38.909944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:38.909944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:38.909944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:38.909944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:38.909944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:38.909944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:38.909944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:38.909944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:41:38.909944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:38.909944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 219/446] 10.222.0.77 () {56 vars in 1114 bytes} [Wed May 11 06:41:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:38.915234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1b6a1-240f-40d3-93b3-ae9bea42594a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:38.952333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aef3de-da7c-41ba-af2c-a3f53bf19405 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:38.990566 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638e1f6-94dc-4fa4-8f78-5047e1427166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:38.991275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638e1f6-94dc-4fa4-8f78-5047e1427166 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:38.991562 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638e1f6-94dc-4fa4-8f78-5047e1427166 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:38.991837 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638e1f6-94dc-4fa4-8f78-5047e1427166 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:39.023181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1b6a1-240f-40d3-93b3-ae9bea42594a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:39.058467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c4722-0443-46ac-ad7d-8a439013cb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:39.059179 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c4722-0443-46ac-ad7d-8a439013cb4d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:39.059468 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c4722-0443-46ac-ad7d-8a439013cb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:39.059755 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c4722-0443-46ac-ad7d-8a439013cb4d None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:39.060488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c4722-0443-46ac-ad7d-8a439013cb4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:39.060796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c4722-0443-46ac-ad7d-8a439013cb4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:39.062179 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c4722-0443-46ac-ad7d-8a439013cb4d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:39.064142 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638e1f6-94dc-4fa4-8f78-5047e1427166 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:39.066640 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638e1f6-94dc-4fa4-8f78-5047e1427166 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:39.071527 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 220/447] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:41:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:39.077293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c4722-0443-46ac-ad7d-8a439013cb4d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:39.182782 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 228/448] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:41:39.186871 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c4722-0443-46ac-ad7d-8a439013cb4d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:39.188691 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638e1f6-94dc-4fa4-8f78-5047e1427166 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:39.225584 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2e5bf-2312-46a3-be47-7262de3549c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:39.226163 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2e5bf-2312-46a3-be47-7262de3549c0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:39.226443 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2e5bf-2312-46a3-be47-7262de3549c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:39.226715 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2e5bf-2312-46a3-be47-7262de3549c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:39.289634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638e1f6-94dc-4fa4-8f78-5047e1427166 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:39.305527 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2e5bf-2312-46a3-be47-7262de3549c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:39.307333 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2e5bf-2312-46a3-be47-7262de3549c0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:39.325602 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a11619-a540-4eeb-ad48-5a487336f607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:39.326574 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a11619-a540-4eeb-ad48-5a487336f607 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:39.326852 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a11619-a540-4eeb-ad48-5a487336f607 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:39.327244 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a11619-a540-4eeb-ad48-5a487336f607 None admin] PATH_INFO: `/v3/projects/486e01030b5e4bfaac8284834098ad35` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:39.328482 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a11619-a540-4eeb-ad48-5a487336f607 None admin] RBAC: Authorizing `identity:get_project(project_id=486e01030b5e4bfaac8284834098ad35)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:39.329948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a11619-a540-4eeb-ad48-5a487336f607 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:39.332691 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 229/449] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:39 2022] GET /identity/v3/projects/486e01030b5e4bfaac8284834098ad35 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:39.337876 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a11619-a540-4eeb-ad48-5a487336f607 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:39.422372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 221/450] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 06:41:39.428003 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2e5bf-2312-46a3-be47-7262de3549c0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:39.441139 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a11619-a540-4eeb-ad48-5a487336f607 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:39.477237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485574f7-c8a5-485b-b727-40d3c329f6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:39.478034 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485574f7-c8a5-485b-b727-40d3c329f6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:39.478315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485574f7-c8a5-485b-b727-40d3c329f6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:39.478781 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485574f7-c8a5-485b-b727-40d3c329f6b3 None admin] PATH_INFO: `/v3/groups/c2eabd42e02845d6bb55133d640baf03` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:39.483013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485574f7-c8a5-485b-b727-40d3c329f6b3 None admin] RBAC: Authorizing `identity:get_group(group_id=c2eabd42e02845d6bb55133d640baf03)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:39.483013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485574f7-c8a5-485b-b727-40d3c329f6b3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:39.484230 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 230/451] 10.222.0.77 () {56 vars in 1180 bytes} [Wed May 11 06:41:39 2022] GET /identity/v3/groups/c2eabd42e02845d6bb55133d640baf03 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:39.490010 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485574f7-c8a5-485b-b727-40d3c329f6b3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:39.535592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2e5bf-2312-46a3-be47-7262de3549c0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:39.567780 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434f30c-624a-4cfd-b8c5-a907797be36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:39.569797 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434f30c-624a-4cfd-b8c5-a907797be36d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:39.569797 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434f30c-624a-4cfd-b8c5-a907797be36d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:39.569797 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434f30c-624a-4cfd-b8c5-a907797be36d None admin] PATH_INFO: `/v3/projects/138bad15d42d49259cf68f4833e7841e` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:39.570760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434f30c-624a-4cfd-b8c5-a907797be36d None admin] RBAC: Authorizing `identity:get_project(project_id=138bad15d42d49259cf68f4833e7841e)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:39.572596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434f30c-624a-4cfd-b8c5-a907797be36d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:39.574308 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 222/452] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:41:39 2022] GET /identity/v3/projects/138bad15d42d49259cf68f4833e7841e => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:39.579939 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434f30c-624a-4cfd-b8c5-a907797be36d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:39.585029 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485574f7-c8a5-485b-b727-40d3c329f6b3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:39.616026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6086b51-7ba2-4da6-8bbf-b7fb0c353afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:39.616663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6086b51-7ba2-4da6-8bbf-b7fb0c353afa None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:39.616940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6086b51-7ba2-4da6-8bbf-b7fb0c353afa None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:39.617208 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6086b51-7ba2-4da6-8bbf-b7fb0c353afa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:39.618034 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6086b51-7ba2-4da6-8bbf-b7fb0c353afa None admin] RBAC: Adding query filter params (group.id=c2eabd42e02845d6bb55133d640baf03, role.id=5debd8ad07a74bedbf2efd53b11cd7cd, scope.project.id=486e01030b5e4bfaac8284834098ad35) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:39.618340 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6086b51-7ba2-4da6-8bbf-b7fb0c353afa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:39.619796 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6086b51-7ba2-4da6-8bbf-b7fb0c353afa None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:39.625673 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 231/453] 10.222.0.77 () {56 vars in 1376 bytes} [Wed May 11 06:41:39 2022] GET /identity/v3/role_assignments?group.id=c2eabd42e02845d6bb55133d640baf03&scope.project.id=486e01030b5e4bfaac8284834098ad35&role.id=5debd8ad07a74bedbf2efd53b11cd7cd => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:39.678402 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434f30c-624a-4cfd-b8c5-a907797be36d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:39.715186 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d346b-6671-407a-8eb0-25f5c5dfa92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:39.716053 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d346b-6671-407a-8eb0-25f5c5dfa92c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:39.716326 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d346b-6671-407a-8eb0-25f5c5dfa92c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:39.716597 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d346b-6671-407a-8eb0-25f5c5dfa92c None admin] PATH_INFO: `/v3/groups/e1c638522292421fbb997f5ced0ea99c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:39.717876 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d346b-6671-407a-8eb0-25f5c5dfa92c None admin] RBAC: Authorizing `identity:get_group(group_id=e1c638522292421fbb997f5ced0ea99c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:39.719370 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d346b-6671-407a-8eb0-25f5c5dfa92c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:39.721023 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 223/454] 10.222.0.77 () {56 vars in 1180 bytes} [Wed May 11 06:41:39 2022] GET /identity/v3/groups/e1c638522292421fbb997f5ced0ea99c => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:39.727591 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6086b51-7ba2-4da6-8bbf-b7fb0c353afa None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:39.833907 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6086b51-7ba2-4da6-8bbf-b7fb0c353afa None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:39.867921 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97c8c8-e89a-48fc-b75b-da09a64c3a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:39.868586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97c8c8-e89a-48fc-b75b-da09a64c3a5c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:39.868871 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97c8c8-e89a-48fc-b75b-da09a64c3a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:39.869144 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97c8c8-e89a-48fc-b75b-da09a64c3a5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:39.869981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97c8c8-e89a-48fc-b75b-da09a64c3a5c None admin] RBAC: Adding query filter params (group.id=e1c638522292421fbb997f5ced0ea99c, role.id=ae6b211774c34f47a3ac4853538f62ad, scope.project.id=138bad15d42d49259cf68f4833e7841e) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:39.870294 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97c8c8-e89a-48fc-b75b-da09a64c3a5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:39.871768 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97c8c8-e89a-48fc-b75b-da09a64c3a5c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:39.877469 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 232/455] 10.222.0.77 () {56 vars in 1376 bytes} [Wed May 11 06:41:39 2022] GET /identity/v3/role_assignments?group.id=e1c638522292421fbb997f5ced0ea99c&scope.project.id=138bad15d42d49259cf68f4833e7841e&role.id=ae6b211774c34f47a3ac4853538f62ad => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:42.661436 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845fc35-6b87-4d6f-8229-8959c2937508 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:42.662717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845fc35-6b87-4d6f-8229-8959c2937508 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:42.663240 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845fc35-6b87-4d6f-8229-8959c2937508 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:42.665038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 224/456] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:42.670871 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84590c-cd96-4831-b6bc-4d811cf40004 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:42.671748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84590c-cd96-4831-b6bc-4d811cf40004 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:42.672214 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84590c-cd96-4831-b6bc-4d811cf40004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:42.702082 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1b84590c-cd96-4831-b6bc-4d811cf40004 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:42.703740 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1b84590c-cd96-4831-b6bc-4d811cf40004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:42.781572 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 233/457] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 11 06:41:42.817979 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845fc35-6b87-4d6f-8229-8959c2937508 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:42.917793 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845fc35-6b87-4d6f-8229-8959c2937508 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:42.950087 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019532b0-aaea-4539-a67e-d134efd41e3f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:42.950748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019532b0-aaea-4539-a67e-d134efd41e3f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:42.951271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019532b0-aaea-4539-a67e-d134efd41e3f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:42.953077 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 234/458] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:42.953179 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb410a-d3c3-44a3-86e3-33e2e445e08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:42.959002 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb410a-d3c3-44a3-86e3-33e2e445e08e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:42.959002 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb410a-d3c3-44a3-86e3-33e2e445e08e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:42.959002 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb410a-d3c3-44a3-86e3-33e2e445e08e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:42.966215 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb410a-d3c3-44a3-86e3-33e2e445e08e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:42.967748 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb410a-d3c3-44a3-86e3-33e2e445e08e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:42.969067 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b465f-3ed0-4381-97bc-f34bf97a2ad4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:42.969360 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b465f-3ed0-4381-97bc-f34bf97a2ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:42.969645 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b465f-3ed0-4381-97bc-f34bf97a2ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:42.987857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-9adb410a-d3c3-44a3-86e3-33e2e445e08e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:42.987857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:42.987857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:42.987857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:42.987857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:42.987857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:42.987857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:42.987857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:42.987857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:42.987857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:42.987857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:42.987857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:42.987857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:42.987857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:42.987857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:42.988794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:42.988794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:42.988794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:42.988794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:42.988794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:42.988794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:42.988794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:42.988794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:42.988794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:42.988794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:42.988794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:42.988794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:42.988794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:42.988794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:42.988794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:42.988794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:42.988794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:42.989697 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:42.989697 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:42.989697 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:42.989697 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:42.989697 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 225/459] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:42.996176 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb410a-d3c3-44a3-86e3-33e2e445e08e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:43.023230 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7e3b465f-3ed0-4381-97bc-f34bf97a2ad4 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:43.024860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7e3b465f-3ed0-4381-97bc-f34bf97a2ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:43.105787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb410a-d3c3-44a3-86e3-33e2e445e08e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:43.146293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae4679-67f1-4c66-9760-f8cb76a3d39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:43.147229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae4679-67f1-4c66-9760-f8cb76a3d39d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:43.147642 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae4679-67f1-4c66-9760-f8cb76a3d39d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:43.149743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae4679-67f1-4c66-9760-f8cb76a3d39d None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:43.150614 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae4679-67f1-4c66-9760-f8cb76a3d39d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:43.151105 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae4679-67f1-4c66-9760-f8cb76a3d39d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:43.153002 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae4679-67f1-4c66-9760-f8cb76a3d39d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:43.171972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 226/460] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:43.177679 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae4679-67f1-4c66-9760-f8cb76a3d39d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:43.206996 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 235/461] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:43.208819 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ace33e-3868-43a3-bb9a-313d0898bb03 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:43.209303 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ace33e-3868-43a3-bb9a-313d0898bb03 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:43.209774 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ace33e-3868-43a3-bb9a-313d0898bb03 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:43.211500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 236/462] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:43.218987 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bbfe1-14af-453d-aa0d-4b1d48bac71d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:43.218987 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bbfe1-14af-453d-aa0d-4b1d48bac71d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:43.218987 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bbfe1-14af-453d-aa0d-4b1d48bac71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:43.233370 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3d1bbfe1-14af-453d-aa0d-4b1d48bac71d None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:43.234559 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3d1bbfe1-14af-453d-aa0d-4b1d48bac71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:43.285589 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae4679-67f1-4c66-9760-f8cb76a3d39d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:43.307037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 237/463] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:41:43.308219 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bbfe1-14af-453d-aa0d-4b1d48bac71d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:43.331388 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d576b-7adc-4933-be0f-882c10859300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:43.332219 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d576b-7adc-4933-be0f-882c10859300 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:43.332496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d576b-7adc-4933-be0f-882c10859300 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:43.332757 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d576b-7adc-4933-be0f-882c10859300 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:43.333657 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d576b-7adc-4933-be0f-882c10859300 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:43.335100 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d576b-7adc-4933-be0f-882c10859300 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:43.362996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 227/464] 10.222.0.77 () {60 vars in 1132 bytes} [Wed May 11 06:41:43 2022] POST /identity/v3/users => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:41:43.362996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec412d3-9a9c-499b-be10-8c54012ab918 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:43.362996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec412d3-9a9c-499b-be10-8c54012ab918 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:43.362996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec412d3-9a9c-499b-be10-8c54012ab918 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:43.366178 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 228/465] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:43.367596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec412d3-9a9c-499b-be10-8c54012ab918 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:43.422605 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bbfe1-14af-453d-aa0d-4b1d48bac71d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:43.459787 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd432aa-6ff2-4cee-a85f-14a4f72e29f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:43.461507 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd432aa-6ff2-4cee-a85f-14a4f72e29f6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:43.462142 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd432aa-6ff2-4cee-a85f-14a4f72e29f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:43.462420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd432aa-6ff2-4cee-a85f-14a4f72e29f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:43.476233 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd432aa-6ff2-4cee-a85f-14a4f72e29f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:43.477959 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd432aa-6ff2-4cee-a85f-14a4f72e29f6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:43.501806 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec412d3-9a9c-499b-be10-8c54012ab918 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:43.504025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-6dd432aa-6ff2-4cee-a85f-14a4f72e29f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:43.504025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:43.504025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:43.504025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:43.504025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:43.504025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:43.504025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:43.504025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:43.504025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:43.504025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:43.504025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:43.504025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:43.504025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:43.504025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:43.504025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:43.504891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:43.504891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:43.504891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:43.504891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:43.504891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:43.504891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:43.504891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:43.504891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:43.504891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:43.504891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:43.504891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:43.504891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:43.504891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:43.504891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:43.504891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:43.504891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:43.504891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:43.505800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:43.505800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:43.505800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:43.505800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:43.506436 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 238/466] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:43.507582 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85df3b-a096-460c-a550-7076886f1131 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:43.507995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85df3b-a096-460c-a550-7076886f1131 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:43.508268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85df3b-a096-460c-a550-7076886f1131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:43.536625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9b85df3b-a096-460c-a550-7076886f1131 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:43.538509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9b85df3b-a096-460c-a550-7076886f1131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:43.544851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b787b3e-21cf-4836-87d5-3eb141c1e498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:43.545869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b787b3e-21cf-4836-87d5-3eb141c1e498 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:43.546282 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b787b3e-21cf-4836-87d5-3eb141c1e498 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:43.546651 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b787b3e-21cf-4836-87d5-3eb141c1e498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:43.560417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b787b3e-21cf-4836-87d5-3eb141c1e498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:43.562055 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b787b3e-21cf-4836-87d5-3eb141c1e498 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:43.580576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-5b787b3e-21cf-4836-87d5-3eb141c1e498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:43.580576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:43.580576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:43.580576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:43.580576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:43.580576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:43.580576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:43.580576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:43.580576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:43.580576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:43.580576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:43.580576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:43.580576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:43.580576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:43.580576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:43.582424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:43.582424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:43.582424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:43.582424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:43.582424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:43.582424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:43.582424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:43.582424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:43.582424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:43.582424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:43.582424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:43.582424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:43.582424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:43.582424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:43.582424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:43.582424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:43.582424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:43.584659 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:43.584659 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:43.584659 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:43.584659 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:43.584659 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 229/467] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:43.584659 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b787b3e-21cf-4836-87d5-3eb141c1e498 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:43.619225 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 239/468] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:43.619560 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85df3b-a096-460c-a550-7076886f1131 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:43.720991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b787b3e-21cf-4836-87d5-3eb141c1e498 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:43.726432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85df3b-a096-460c-a550-7076886f1131 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:43.755068 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edfc2e-e834-4c37-802b-0ffa9f4e6e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:43.756307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edfc2e-e834-4c37-802b-0ffa9f4e6e1c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:43.756865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edfc2e-e834-4c37-802b-0ffa9f4e6e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:43.757424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edfc2e-e834-4c37-802b-0ffa9f4e6e1c None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:43.758586 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edfc2e-e834-4c37-802b-0ffa9f4e6e1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:43.759186 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edfc2e-e834-4c37-802b-0ffa9f4e6e1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:43.759563 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1c364-96c4-4973-afc7-905e906274d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:43.760231 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1c364-96c4-4973-afc7-905e906274d7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:43.760516 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1c364-96c4-4973-afc7-905e906274d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:43.760791 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1c364-96c4-4973-afc7-905e906274d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:43.761510 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1c364-96c4-4973-afc7-905e906274d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:43.761813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1c364-96c4-4973-afc7-905e906274d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:43.762057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edfc2e-e834-4c37-802b-0ffa9f4e6e1c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:43.763207 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1c364-96c4-4973-afc7-905e906274d7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:43.774576 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 240/469] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:43.779083 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1c364-96c4-4973-afc7-905e906274d7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:43.780572 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 230/470] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:43.781677 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edfc2e-e834-4c37-802b-0ffa9f4e6e1c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:43.880273 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1c364-96c4-4973-afc7-905e906274d7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:43.881143 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edfc2e-e834-4c37-802b-0ffa9f4e6e1c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:43.913378 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a9be0-772d-4eaa-bb53-9107d52ab731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:43.914190 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a9be0-772d-4eaa-bb53-9107d52ab731 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:43.914468 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a9be0-772d-4eaa-bb53-9107d52ab731 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:43.914747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a9be0-772d-4eaa-bb53-9107d52ab731 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:43.915777 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3aa004-190c-43ca-8eed-3586a31207c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:43.916667 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3aa004-190c-43ca-8eed-3586a31207c5 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:43.917132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3aa004-190c-43ca-8eed-3586a31207c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:43.917604 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3aa004-190c-43ca-8eed-3586a31207c5 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:43.918557 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3aa004-190c-43ca-8eed-3586a31207c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:43.920271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3aa004-190c-43ca-8eed-3586a31207c5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:43.925259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a9be0-772d-4eaa-bb53-9107d52ab731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:43.926714 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a9be0-772d-4eaa-bb53-9107d52ab731 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:43.951253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-cb8a9be0-772d-4eaa-bb53-9107d52ab731 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:43.951253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:43.951253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:43.951253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:43.951253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:43.951253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:43.951253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:43.951253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:43.951253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:43.951253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:43.951253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:43.951253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:43.951253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:43.951253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:43.951253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:43.952196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:43.952196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:43.952196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:43.952196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:43.952196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:43.952196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:43.952196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:43.952196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:43.952196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:43.952196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:43.952196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:43.952196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:43.952196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:43.952196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:43.952196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:43.952196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:43.952196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:43.953094 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:43.953094 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:43.953094 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:43.953094 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:43.953094 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 241/472] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:43.953094 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a9be0-772d-4eaa-bb53-9107d52ab731 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:43.954251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 231/472] 10.222.0.77 () {60 vars in 1132 bytes} [Wed May 11 06:41:43 2022] POST /identity/v3/users => generated 248 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:41:43.955502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3aa004-190c-43ca-8eed-3586a31207c5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:44.077661 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3aa004-190c-43ca-8eed-3586a31207c5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:44.122693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff603d24-07fe-49ec-8b7b-4cf077232a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:44.123869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff603d24-07fe-49ec-8b7b-4cf077232a6d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:44.124383 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff603d24-07fe-49ec-8b7b-4cf077232a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:44.124843 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff603d24-07fe-49ec-8b7b-4cf077232a6d None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:44.125933 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff603d24-07fe-49ec-8b7b-4cf077232a6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:44.126443 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff603d24-07fe-49ec-8b7b-4cf077232a6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:44.128122 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff603d24-07fe-49ec-8b7b-4cf077232a6d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:44.142836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 232/473] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:44.151017 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff603d24-07fe-49ec-8b7b-4cf077232a6d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:44.198910 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a9be0-772d-4eaa-bb53-9107d52ab731 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:44.240611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c98b15-543b-4828-bd50-38cd77809950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:44.241587 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c98b15-543b-4828-bd50-38cd77809950 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:44.242033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c98b15-543b-4828-bd50-38cd77809950 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:44.242308 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c98b15-543b-4828-bd50-38cd77809950 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:44.243051 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c98b15-543b-4828-bd50-38cd77809950 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:44.244507 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c98b15-543b-4828-bd50-38cd77809950 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:44.278088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 242/474] 10.222.0.77 () {60 vars in 1132 bytes} [Wed May 11 06:41:43 2022] POST /identity/v3/users => generated 248 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:41:44.284994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978a91b-468f-4f6c-b905-6ade94b9af00 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:44.285292 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978a91b-468f-4f6c-b905-6ade94b9af00 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:44.285574 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978a91b-468f-4f6c-b905-6ade94b9af00 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:44.288225 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 243/475] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:44.289724 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff603d24-07fe-49ec-8b7b-4cf077232a6d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:44.295440 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b1501-232c-4ba9-9d3b-3248957a81d5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:44.295741 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b1501-232c-4ba9-9d3b-3248957a81d5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:44.296006 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b1501-232c-4ba9-9d3b-3248957a81d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:44.326318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3a6b1501-232c-4ba9-9d3b-3248957a81d5 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:44.327585 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3a6b1501-232c-4ba9-9d3b-3248957a81d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:44.332863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffe9e0-0b5c-4307-96b2-c3957c138d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:44.333729 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffe9e0-0b5c-4307-96b2-c3957c138d09 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:44.334216 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffe9e0-0b5c-4307-96b2-c3957c138d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:44.334502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffe9e0-0b5c-4307-96b2-c3957c138d09 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:44.335478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffe9e0-0b5c-4307-96b2-c3957c138d09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:44.337189 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffe9e0-0b5c-4307-96b2-c3957c138d09 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:44.363890 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 233/476] 10.222.0.77 () {60 vars in 1132 bytes} [Wed May 11 06:41:44 2022] POST /identity/v3/users => generated 249 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:41:44.408713 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 244/477] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:41:44.433183 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffe9e0-0b5c-4307-96b2-c3957c138d09 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:44.556892 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffe9e0-0b5c-4307-96b2-c3957c138d09 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:44.593968 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec1cf2-4f86-47fb-860b-ed8195bf4746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:44.594944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec1cf2-4f86-47fb-860b-ed8195bf4746 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:44.595251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec1cf2-4f86-47fb-860b-ed8195bf4746 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:44.595526 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec1cf2-4f86-47fb-860b-ed8195bf4746 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:44.596288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec1cf2-4f86-47fb-860b-ed8195bf4746 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:44.597693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec1cf2-4f86-47fb-860b-ed8195bf4746 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:44.609396 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.sql.core [None req-46ec1cf2-4f86-47fb-860b-ed8195bf4746 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 11 06:41:44.609396 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 11 06:41:44.609396 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [parameters: {'id': 'dbc9b22fe126433c8786328a5da57617', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 11 06:41:44.609396 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80059) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 06:41:44.625712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-46ec1cf2-4f86-47fb-860b-ed8195bf4746 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 11 06:41:44.625712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:44.625712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 06:41:44.625712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 06:41:44.625712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 06:41:44.625712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 06:41:44.625712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 06:41:44.625712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application result = self._query(query) May 11 06:41:44.625712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 06:41:44.625712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application conn.query(q) May 11 06:41:44.625712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 06:41:44.625712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 06:41:44.625712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 06:41:44.625712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application result.read() May 11 06:41:44.625712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 06:41:44.626599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 06:41:44.626599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 06:41:44.626599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 06:41:44.626599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 06:41:44.626599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 06:41:44.626599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 06:41:44.626599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 06:41:44.626599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 11 06:41:44.626599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:44.626599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 06:41:44.626599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:44.626599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:44.626599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 06:41:44.626599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 06:41:44.626599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 11 06:41:44.626599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return ref.to_dict() May 11 06:41:44.626599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 06:41:44.626599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application next(self.gen) May 11 06:41:44.627623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 06:41:44.627623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application yield resource May 11 06:41:44.627623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 06:41:44.627623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application next(self.gen) May 11 06:41:44.627623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 06:41:44.627623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self.session.rollback() May 11 06:41:44.627623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 06:41:44.627623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self.force_reraise() May 11 06:41:44.627623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 06:41:44.627623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise self.value May 11 06:41:44.627623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 06:41:44.627623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 06:41:44.627623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 06:41:44.627623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application session.commit() May 11 06:41:44.627623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 06:41:44.627623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 06:41:44.627623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 06:41:44.628519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._prepare_impl() May 11 06:41:44.628519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 06:41:44.628519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self.session.flush() May 11 06:41:44.628519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 06:41:44.628519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._flush(objects) May 11 06:41:44.628519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 06:41:44.628519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 06:41:44.628519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 06:41:44.628519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application compat.raise_( May 11 06:41:44.628519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 06:41:44.628519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception May 11 06:41:44.628519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 06:41:44.628519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application flush_context.execute() May 11 06:41:44.628519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 06:41:44.628519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rec.execute(self) May 11 06:41:44.628519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 06:41:44.628519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 06:41:44.629372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 06:41:44.629372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 06:41:44.629372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 11 06:41:44.629372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application c = connection._execute_20( May 11 06:41:44.629372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 06:41:44.629372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 06:41:44.629372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 06:41:44.629372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 06:41:44.629372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 06:41:44.629372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 06:41:44.629372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 06:41:44.629372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 06:41:44.629372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 06:41:44.629372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 06:41:44.629372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 06:41:44.629372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception May 11 06:41:44.630165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 06:41:44.630165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 06:41:44.630165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 06:41:44.630165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 06:41:44.630165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 06:41:44.630165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application result = self._query(query) May 11 06:41:44.630165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 06:41:44.630165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application conn.query(q) May 11 06:41:44.630165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 06:41:44.630165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 06:41:44.630165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 06:41:44.630165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application result.read() May 11 06:41:44.630165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 06:41:44.630165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 06:41:44.630165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 06:41:44.630165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 06:41:44.632190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 06:41:44.632190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 06:41:44.632190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 06:41:44.632190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 06:41:44.632190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 11 06:41:44.632190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 11 06:41:44.632190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [parameters: {'id': 'dbc9b22fe126433c8786328a5da57617', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 11 06:41:44.632190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 06:41:44.632190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:44.632190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:41:44.632190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:44.632190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:44.632190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:44.632190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:44.632190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:44.632190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:44.634101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:44.634101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:44.634101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:44.634101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:44.634101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:44.634101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:44.634101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 11 06:41:44.634101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 11 06:41:44.634101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:44.634101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:44.634101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 11 06:41:44.634101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 11 06:41:44.634101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 06:41:44.634101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 06:41:44.634101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 11 06:41:44.634101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:44.635868 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 234/478] 10.222.0.77 () {60 vars in 1131 bytes} [Wed May 11 06:41:44 2022] POST /identity/v3/roles => generated 144 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:44.635944 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b1501-232c-4ba9-9d3b-3248957a81d5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:44.739238 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b1501-232c-4ba9-9d3b-3248957a81d5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:44.773134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7a4b6-3f41-4974-8765-3b0b459246f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:44.773968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7a4b6-3f41-4974-8765-3b0b459246f7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:44.774249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7a4b6-3f41-4974-8765-3b0b459246f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:44.774525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7a4b6-3f41-4974-8765-3b0b459246f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:44.784957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7a4b6-3f41-4974-8765-3b0b459246f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:44.793092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-9ad7a4b6-3f41-4974-8765-3b0b459246f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:41:44.793092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:44.793092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:44.793092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:44.793092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:44.793092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:44.793092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:44.793092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:44.793092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:44.793092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:44.793092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:44.793092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:44.793092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:44.793092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:44.793092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:44.793092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:44.794264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:44.794264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:44.794264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:44.794264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:44.794264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:44.794264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:44.794264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:44.794264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:44.794264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:44.794264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:44.794264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:44.794264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:44.794264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:44.794264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:44.794264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:44.794264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:44.795155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:44.795155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:44.795155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:44.795155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:44.795155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:44.795155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:44.795155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:44.795155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:44.795155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:44.795155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:44.795155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:41:44.795155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:44.795155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 245/479] 10.222.0.77 () {56 vars in 1114 bytes} [Wed May 11 06:41:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:44.800414 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec1cf2-4f86-47fb-860b-ed8195bf4746 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:44.901278 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec1cf2-4f86-47fb-860b-ed8195bf4746 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:44.934118 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbde7de-36a7-49f3-89dc-35005e896491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:44.934789 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbde7de-36a7-49f3-89dc-35005e896491 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:44.935098 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbde7de-36a7-49f3-89dc-35005e896491 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:44.935379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbde7de-36a7-49f3-89dc-35005e896491 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:44.936116 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbde7de-36a7-49f3-89dc-35005e896491 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:44.936419 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbde7de-36a7-49f3-89dc-35005e896491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:44.937792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbde7de-36a7-49f3-89dc-35005e896491 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:44.946520 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 235/480] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:41:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:45.799921 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3ff9f-9d6d-4344-be73-82b60e266321 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:45.800653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3ff9f-9d6d-4344-be73-82b60e266321 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:45.800653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3ff9f-9d6d-4344-be73-82b60e266321 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:45.802186 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 246/481] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:45.808370 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869197d-7df2-4b61-af3e-a504094e7361 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:45.809003 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869197d-7df2-4b61-af3e-a504094e7361 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:45.809003 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869197d-7df2-4b61-af3e-a504094e7361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:45.836348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d869197d-7df2-4b61-af3e-a504094e7361 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:45.837555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d869197d-7df2-4b61-af3e-a504094e7361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:45.926585 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 236/482] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:41:45.968512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3ff9f-9d6d-4344-be73-82b60e266321 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:46.084457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3ff9f-9d6d-4344-be73-82b60e266321 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:46.117346 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399be0e-cd5c-4283-8f66-1b5fb47a55cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:46.118160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399be0e-cd5c-4283-8f66-1b5fb47a55cc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:46.118447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399be0e-cd5c-4283-8f66-1b5fb47a55cc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:46.118725 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399be0e-cd5c-4283-8f66-1b5fb47a55cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:46.129337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399be0e-cd5c-4283-8f66-1b5fb47a55cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:46.137298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-2399be0e-cd5c-4283-8f66-1b5fb47a55cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:46.137298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:46.137298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:46.137298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:46.137298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:46.137298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:46.137298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:46.137298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:46.137298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:46.137298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:46.137298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:46.137298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:46.137298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:46.137298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:46.137298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:46.137298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:46.138162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:46.138162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:46.138162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:46.138162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:46.138162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:46.138162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:46.138162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:46.138162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:46.138162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:46.138162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:46.138162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:46.138162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:46.138162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:46.138162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:46.138162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:46.138162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:46.139076 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:46.139076 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:46.139076 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:46.139076 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:46.139076 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:46.139076 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:46.139076 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:46.139076 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:46.139076 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:46.139076 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:46.139076 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:46.139076 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:46.139076 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 247/483] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:41:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:46.144803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869197d-7df2-4b61-af3e-a504094e7361 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:46.243703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869197d-7df2-4b61-af3e-a504094e7361 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:46.276804 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443de03-7dfd-4e3c-afd0-e9cf96df18e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:46.277480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443de03-7dfd-4e3c-afd0-e9cf96df18e2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:46.277762 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443de03-7dfd-4e3c-afd0-e9cf96df18e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:46.278036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443de03-7dfd-4e3c-afd0-e9cf96df18e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:46.278783 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443de03-7dfd-4e3c-afd0-e9cf96df18e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:46.279125 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443de03-7dfd-4e3c-afd0-e9cf96df18e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:46.280495 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443de03-7dfd-4e3c-afd0-e9cf96df18e2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:46.289128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 237/484] 10.222.0.77 () {56 vars in 1103 bytes} [Wed May 11 06:41:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:46.298979 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399be0e-cd5c-4283-8f66-1b5fb47a55cc None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:46.394496 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399be0e-cd5c-4283-8f66-1b5fb47a55cc None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:46.427969 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d28108-9e8f-462d-9998-b707c244ec88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:46.428787 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d28108-9e8f-462d-9998-b707c244ec88 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:46.429071 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d28108-9e8f-462d-9998-b707c244ec88 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:46.429342 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d28108-9e8f-462d-9998-b707c244ec88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:46.442050 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d28108-9e8f-462d-9998-b707c244ec88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:46.443767 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d28108-9e8f-462d-9998-b707c244ec88 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:46.463129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-55d28108-9e8f-462d-9998-b707c244ec88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:46.463129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:46.463129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:46.463129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:46.463129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:46.463129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:46.463129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:46.463129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:46.463129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:46.463129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:46.463129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:46.463129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:46.463129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:46.463129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:46.463129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:46.464052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:46.464052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:46.464052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:46.464052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:46.464052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:46.464052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:46.464052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:46.464052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:46.464052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:46.464052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:46.464052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:46.464052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:46.464052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:46.464052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:46.464052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:46.464052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:46.464052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:46.465453 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:46.465453 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:46.465453 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:46.465453 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:46.465453 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 248/485] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:46.470608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443de03-7dfd-4e3c-afd0-e9cf96df18e2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:46.572460 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443de03-7dfd-4e3c-afd0-e9cf96df18e2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:46.604593 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9789617-07c3-4779-b68c-6b6f8ae07bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:46.605257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9789617-07c3-4779-b68c-6b6f8ae07bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:46.605537 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9789617-07c3-4779-b68c-6b6f8ae07bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:46.605811 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9789617-07c3-4779-b68c-6b6f8ae07bd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:46.606537 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9789617-07c3-4779-b68c-6b6f8ae07bd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:46.606839 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9789617-07c3-4779-b68c-6b6f8ae07bd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:46.608309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9789617-07c3-4779-b68c-6b6f8ae07bd9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:46.620415 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 238/486] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:46.625840 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d28108-9e8f-462d-9998-b707c244ec88 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:46.711858 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c6cfc-a7af-43c5-8c8a-76b4e9a26e0b None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:46.712185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c6cfc-a7af-43c5-8c8a-76b4e9a26e0b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:46.712338 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c6cfc-a7af-43c5-8c8a-76b4e9a26e0b None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:46.713802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 239/487] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:41:46.719182 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd491bb8-eee2-4136-8cd9-aead1b5874d7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:46.719475 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd491bb8-eee2-4136-8cd9-aead1b5874d7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:46.719753 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd491bb8-eee2-4136-8cd9-aead1b5874d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:46.728196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d28108-9e8f-462d-9998-b707c244ec88 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:46.758991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-cd491bb8-eee2-4136-8cd9-aead1b5874d7 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:46.760211 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cd491bb8-eee2-4136-8cd9-aead1b5874d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:46.763250 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4d3bd-49fd-4ec5-8e0a-b0278eabbd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:46.764061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4d3bd-49fd-4ec5-8e0a-b0278eabbd05 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:46.764340 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4d3bd-49fd-4ec5-8e0a-b0278eabbd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:46.764617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4d3bd-49fd-4ec5-8e0a-b0278eabbd05 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:46.774030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4d3bd-49fd-4ec5-8e0a-b0278eabbd05 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:46.775537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4d3bd-49fd-4ec5-8e0a-b0278eabbd05 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:46.792354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5cc4d3bd-49fd-4ec5-8e0a-b0278eabbd05 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 06:41:46.792354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:46.792354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:46.792354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:46.792354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:46.792354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:46.792354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:46.792354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:46.792354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:46.792354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:46.792354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:46.792354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:46.792354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:41:46.792354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:41:46.792354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:41:46.792354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:41:46.794495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:46.794495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:46.794495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:41:46.794495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:41:46.794495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:41:46.794495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:41:46.794495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:46.794495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:46.794495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:46.794495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:46.794495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:46.794495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:46.794495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:46.794495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:46.794495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:46.794495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:46.794495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:46.794495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:46.796695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:46.796695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:46.796695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:41:46.796695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:41:46.796695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:41:46.796695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:41:46.796695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:41:46.796695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:41:46.796695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 06:41:46.796695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:46.796695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 249/488] 10.222.0.77 () {56 vars in 1093 bytes} [Wed May 11 06:41:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:46.802246 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4d3bd-49fd-4ec5-8e0a-b0278eabbd05 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:46.907022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4d3bd-49fd-4ec5-8e0a-b0278eabbd05 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:46.943146 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fed3b4-0127-4669-93f9-4ef680940213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:46.944110 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fed3b4-0127-4669-93f9-4ef680940213 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:46.944395 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fed3b4-0127-4669-93f9-4ef680940213 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:46.944667 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fed3b4-0127-4669-93f9-4ef680940213 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:46.945680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fed3b4-0127-4669-93f9-4ef680940213 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:46.945992 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fed3b4-0127-4669-93f9-4ef680940213 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:46.947825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fed3b4-0127-4669-93f9-4ef680940213 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:46.972846 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 240/489] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:46.986666 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 250/490] 10.222.0.77 () {56 vars in 1133 bytes} [Wed May 11 06:41:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:46.992228 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd491bb8-eee2-4136-8cd9-aead1b5874d7 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:47.007779 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fed3b4-0127-4669-93f9-4ef680940213 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:47.143809 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fed3b4-0127-4669-93f9-4ef680940213 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:47.179431 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9a606-0785-4b87-9fa5-6f86208bbd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:47.180238 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9a606-0785-4b87-9fa5-6f86208bbd2a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:47.180519 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9a606-0785-4b87-9fa5-6f86208bbd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:47.180796 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9a606-0785-4b87-9fa5-6f86208bbd2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:47.192178 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9a606-0785-4b87-9fa5-6f86208bbd2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:47.200663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-2ef9a606-0785-4b87-9fa5-6f86208bbd2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:47.200663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:47.200663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:47.200663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:47.200663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:47.200663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:47.200663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:47.200663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:47.200663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:47.200663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:47.200663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:47.200663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:47.200663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:47.200663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:47.200663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:47.200663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:47.203060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:47.203060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:47.203060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:47.203060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:47.203060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:47.203060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:47.203060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:47.203060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:47.203060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:47.203060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:47.203060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:47.203060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:47.203060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:47.203060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:47.203060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:47.203060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:47.205032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:47.205032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:47.205032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:47.205032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:47.205032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:47.205032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:47.205032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:47.205032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:47.205032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:47.205032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:47.205032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:47.205032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:47.205032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 251/491] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:41:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:47.211021 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9a606-0785-4b87-9fa5-6f86208bbd2a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:47.266284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd491bb8-eee2-4136-8cd9-aead1b5874d7 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:47.318168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9a606-0785-4b87-9fa5-6f86208bbd2a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:47.358120 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ae560-e5fa-4a11-8d7a-32e015c91012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:47.358817 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ae560-e5fa-4a11-8d7a-32e015c91012 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:47.359134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ae560-e5fa-4a11-8d7a-32e015c91012 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:47.359413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ae560-e5fa-4a11-8d7a-32e015c91012 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:47.360177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ae560-e5fa-4a11-8d7a-32e015c91012 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:47.360486 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ae560-e5fa-4a11-8d7a-32e015c91012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:47.362936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ae560-e5fa-4a11-8d7a-32e015c91012 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:47.371339 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f59e0-8c7b-452f-990e-892ca195f4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:47.371999 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f59e0-8c7b-452f-990e-892ca195f4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:47.372270 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f59e0-8c7b-452f-990e-892ca195f4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:47.372423 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 252/492] 10.222.0.77 () {56 vars in 1103 bytes} [Wed May 11 06:41:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:47.372569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f59e0-8c7b-452f-990e-892ca195f4a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:47.373635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7784989-868f-4e2c-ac2d-70b7b647c0bc None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:47.373923 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7784989-868f-4e2c-ac2d-70b7b647c0bc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:47.374199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7784989-868f-4e2c-ac2d-70b7b647c0bc None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:47.384542 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 253/493] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:47 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:47.386335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7784989-868f-4e2c-ac2d-70b7b647c0bc None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:47.449364 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f59e0-8c7b-452f-990e-892ca195f4a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:47.451133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f59e0-8c7b-452f-990e-892ca195f4a2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:47.505896 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7784989-868f-4e2c-ac2d-70b7b647c0bc None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:47.538362 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7b42b-e9ed-410f-8c81-7f706f9c6b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:47.539131 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7b42b-e9ed-410f-8c81-7f706f9c6b6d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:47.539412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7b42b-e9ed-410f-8c81-7f706f9c6b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:47.539688 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7b42b-e9ed-410f-8c81-7f706f9c6b6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:47.551004 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7b42b-e9ed-410f-8c81-7f706f9c6b6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:47.551874 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7b42b-e9ed-410f-8c81-7f706f9c6b6d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:47.554322 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 241/494] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:41:47.555499 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe52f8-246d-4225-98d9-6a4234c7fbad None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:47.555790 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe52f8-246d-4225-98d9-6a4234c7fbad None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:47.556067 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe52f8-246d-4225-98d9-6a4234c7fbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:47.569723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-3ba7b42b-e9ed-410f-8c81-7f706f9c6b6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:47.569723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:47.569723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:47.569723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:47.569723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:47.569723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:47.569723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:47.569723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:47.569723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:47.569723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:47.569723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:47.569723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:47.569723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:47.569723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:47.569723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:47.570611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:47.570611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:47.570611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:47.570611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:47.570611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:47.570611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:47.570611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:47.570611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:47.570611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:47.570611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:47.570611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:47.570611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:47.570611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:47.570611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:47.570611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:47.570611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:47.570611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:47.571858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:47.571858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:47.571858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:47.571858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:47.571858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 254/495] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:47.572540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2549397-6a49-4798-bd3c-b1a3053d25cb None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:47.572872 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2549397-6a49-4798-bd3c-b1a3053d25cb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:47.573032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2549397-6a49-4798-bd3c-b1a3053d25cb None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:47.574378 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 255/496] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:47.575703 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2549397-6a49-4798-bd3c-b1a3053d25cb None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:47.577508 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-abfe52f8-246d-4225-98d9-6a4234c7fbad None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:47.578993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-abfe52f8-246d-4225-98d9-6a4234c7fbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:47.642575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 242/497] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:47.643684 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe52f8-246d-4225-98d9-6a4234c7fbad None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:47.686820 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2549397-6a49-4798-bd3c-b1a3053d25cb None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:47.719884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673d461-1b18-4a1c-9ee9-7dd1c5cacf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:47.720717 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673d461-1b18-4a1c-9ee9-7dd1c5cacf01 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:47.720987 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673d461-1b18-4a1c-9ee9-7dd1c5cacf01 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:47.721260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673d461-1b18-4a1c-9ee9-7dd1c5cacf01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:47.731978 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673d461-1b18-4a1c-9ee9-7dd1c5cacf01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:47.734169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673d461-1b18-4a1c-9ee9-7dd1c5cacf01 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:47.740472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe52f8-246d-4225-98d9-6a4234c7fbad None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:47.754884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c673d461-1b18-4a1c-9ee9-7dd1c5cacf01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:47.754884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:47.754884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:47.754884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:47.754884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:47.754884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:47.754884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:47.754884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:47.754884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:47.754884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:47.754884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:47.754884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:47.754884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:47.754884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:47.754884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:47.755922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:47.755922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:47.755922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:47.755922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:47.755922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:47.755922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:47.755922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:47.755922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:47.755922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:47.755922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:47.755922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:47.755922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:47.755922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:47.755922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:47.755922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:47.755922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:47.755922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:47.756801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:47.756801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:47.756801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:47.756801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:47.756801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 256/498] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:47.757680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fff232-5083-4c0f-8630-c30d738b9aec None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:47.757959 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fff232-5083-4c0f-8630-c30d738b9aec None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:47.758226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fff232-5083-4c0f-8630-c30d738b9aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:47.775241 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f7fff232-5083-4c0f-8630-c30d738b9aec None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:47.776421 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f7fff232-5083-4c0f-8630-c30d738b9aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:47.777770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e5ce9-3eb9-42f2-bc5e-dfa16b14933b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:47.778432 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e5ce9-3eb9-42f2-bc5e-dfa16b14933b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:47.778707 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e5ce9-3eb9-42f2-bc5e-dfa16b14933b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:47.778987 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e5ce9-3eb9-42f2-bc5e-dfa16b14933b None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:47.779733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e5ce9-3eb9-42f2-bc5e-dfa16b14933b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:47.780047 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e5ce9-3eb9-42f2-bc5e-dfa16b14933b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:47.781403 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e5ce9-3eb9-42f2-bc5e-dfa16b14933b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:47.797822 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 243/499] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:47.797822 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e5ce9-3eb9-42f2-bc5e-dfa16b14933b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:47.849187 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 257/500] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:47.849864 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fff232-5083-4c0f-8630-c30d738b9aec None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:47.908074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e5ce9-3eb9-42f2-bc5e-dfa16b14933b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:47.943629 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169499aa-0d0c-436d-876a-08aaea5aba58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:47.944435 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169499aa-0d0c-436d-876a-08aaea5aba58 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:47.944712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169499aa-0d0c-436d-876a-08aaea5aba58 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:47.944979 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169499aa-0d0c-436d-876a-08aaea5aba58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:47.948146 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fff232-5083-4c0f-8630-c30d738b9aec None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:47.955259 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169499aa-0d0c-436d-876a-08aaea5aba58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:47.962857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-169499aa-0d0c-436d-876a-08aaea5aba58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:47.962857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:47.962857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:47.962857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:47.962857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:47.962857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:47.962857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:47.962857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:47.962857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:47.962857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:47.962857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:47.962857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:47.962857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:47.962857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:47.962857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:47.962857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:47.963787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:47.963787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:47.963787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:47.963787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:47.963787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:47.963787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:47.963787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:47.963787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:47.963787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:47.963787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:47.963787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:47.963787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:47.963787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:47.963787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:47.963787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:47.963787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:47.964596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:47.964596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:47.964596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:47.964596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:47.964596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:47.964596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:47.964596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:47.964596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:47.964596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:47.964596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:47.964596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:47.964596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:47.968315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 244/501] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:41:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:47.968315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169499aa-0d0c-436d-876a-08aaea5aba58 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:47.981149 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9524d-ea37-4c05-868b-107c8026ce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:47.981843 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9524d-ea37-4c05-868b-107c8026ce05 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:47.982125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9524d-ea37-4c05-868b-107c8026ce05 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:47.982424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9524d-ea37-4c05-868b-107c8026ce05 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:47.983252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9524d-ea37-4c05-868b-107c8026ce05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:47.983444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9524d-ea37-4c05-868b-107c8026ce05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:47.984835 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9524d-ea37-4c05-868b-107c8026ce05 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:47.996060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 258/502] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:47.996664 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9524d-ea37-4c05-868b-107c8026ce05 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:48.061741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169499aa-0d0c-436d-876a-08aaea5aba58 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:48.091018 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9524d-ea37-4c05-868b-107c8026ce05 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:48.093330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03748a5f-c444-490c-9bb8-099d11601f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:48.094146 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03748a5f-c444-490c-9bb8-099d11601f19 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:48.094421 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03748a5f-c444-490c-9bb8-099d11601f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:48.094693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03748a5f-c444-490c-9bb8-099d11601f19 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:48.102085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03748a5f-c444-490c-9bb8-099d11601f19 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:48.103605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03748a5f-c444-490c-9bb8-099d11601f19 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:48.118744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-03748a5f-c444-490c-9bb8-099d11601f19 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 06:41:48.118744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:48.118744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:48.118744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:48.118744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:48.118744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:48.118744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:48.118744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:48.118744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:48.118744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:48.118744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:48.118744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:48.118744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:41:48.118744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:41:48.118744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:41:48.118744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:41:48.119805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:48.119805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:48.119805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:41:48.119805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:41:48.119805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:41:48.119805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:41:48.119805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:48.119805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:48.119805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:48.119805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:48.119805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:48.119805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:48.119805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:48.119805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:48.119805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:48.119805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:48.119805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:48.119805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:48.120725 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:48.120725 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:48.120725 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:41:48.120725 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:41:48.120725 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:41:48.120725 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:41:48.120725 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:41:48.120725 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:41:48.120725 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 06:41:48.120725 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:48.120725 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 245/503] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:48.120725 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03748a5f-c444-490c-9bb8-099d11601f19 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:48.126140 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236ae7f-9ee4-489c-92c8-c53f02a22704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:48.126993 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236ae7f-9ee4-489c-92c8-c53f02a22704 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:48.127240 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236ae7f-9ee4-489c-92c8-c53f02a22704 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:48.127526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236ae7f-9ee4-489c-92c8-c53f02a22704 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:48.137507 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236ae7f-9ee4-489c-92c8-c53f02a22704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:48.145090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-e236ae7f-9ee4-489c-92c8-c53f02a22704 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:48.145090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:48.145090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:48.145090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:48.145090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:48.145090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:48.145090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:48.145090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:48.145090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:48.145090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:48.145090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:48.145090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:48.145090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:48.145090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:48.145090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:48.145090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:48.146012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:48.146012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:48.146012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:48.146012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:48.146012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:48.146012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:48.146012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:48.146012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:48.146012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:48.146012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:48.146012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:48.146012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:48.146012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:48.146012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:48.146012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:48.146012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:48.147022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:48.147022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:48.147022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:48.147022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:48.147022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:48.147022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:48.147022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:48.147022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:48.147022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:48.147022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:48.147022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:48.147022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:48.147022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 259/504] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:41:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:48.148115 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fdfd2-8aff-4939-aa0b-f5187f24fd89 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:48.148115 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fdfd2-8aff-4939-aa0b-f5187f24fd89 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:48.148380 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fdfd2-8aff-4939-aa0b-f5187f24fd89 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:48.154035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 260/505] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:48.154035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fdfd2-8aff-4939-aa0b-f5187f24fd89 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:48.225504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03748a5f-c444-490c-9bb8-099d11601f19 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:48.246993 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fdfd2-8aff-4939-aa0b-f5187f24fd89 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:48.257958 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f981d6a-e9c1-42bb-8cfe-73d4edefd39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:48.258609 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f981d6a-e9c1-42bb-8cfe-73d4edefd39c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:48.258889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f981d6a-e9c1-42bb-8cfe-73d4edefd39c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:48.259185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f981d6a-e9c1-42bb-8cfe-73d4edefd39c None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:48.259906 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f981d6a-e9c1-42bb-8cfe-73d4edefd39c None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:48.260226 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f981d6a-e9c1-42bb-8cfe-73d4edefd39c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:48.261607 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f981d6a-e9c1-42bb-8cfe-73d4edefd39c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:48.269095 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 246/506] 10.222.0.77 () {56 vars in 1103 bytes} [Wed May 11 06:41:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:48.269853 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f981d6a-e9c1-42bb-8cfe-73d4edefd39c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:48.279489 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91c8b8-2e08-4863-a207-779c46d36b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:48.280281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91c8b8-2e08-4863-a207-779c46d36b85 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:48.280990 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91c8b8-2e08-4863-a207-779c46d36b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:48.281283 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91c8b8-2e08-4863-a207-779c46d36b85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:48.290134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91c8b8-2e08-4863-a207-779c46d36b85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:48.291646 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91c8b8-2e08-4863-a207-779c46d36b85 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:48.306430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5d91c8b8-2e08-4863-a207-779c46d36b85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:41:48.306430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:48.306430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:48.306430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:48.306430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:48.306430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:48.306430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:48.306430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:48.306430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:48.306430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:48.306430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:48.306430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:48.306430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:41:48.306430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:41:48.306430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:41:48.307407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:41:48.307407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:48.307407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:48.307407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:48.307407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:48.307407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:48.307407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:48.307407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:48.307407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:48.307407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:48.307407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:48.307407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:48.307407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:48.307407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:48.307407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:48.307407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:48.307407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:48.308292 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:41:48.308292 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:41:48.308292 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:41:48.308292 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:41:48.308292 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:41:48.308292 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:41:48.308292 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:41:48.308292 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:48.308292 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 261/507] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:41:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:48.308756 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91c8b8-2e08-4863-a207-779c46d36b85 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:48.368469 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f981d6a-e9c1-42bb-8cfe-73d4edefd39c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:48.400460 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97c0f5-ff19-4a1d-b8e6-cb50c5e6b22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:48.401214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97c0f5-ff19-4a1d-b8e6-cb50c5e6b22a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:48.401500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97c0f5-ff19-4a1d-b8e6-cb50c5e6b22a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:48.401760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97c0f5-ff19-4a1d-b8e6-cb50c5e6b22a None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:48.402599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97c0f5-ff19-4a1d-b8e6-cb50c5e6b22a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:48.402904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97c0f5-ff19-4a1d-b8e6-cb50c5e6b22a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:48.404365 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97c0f5-ff19-4a1d-b8e6-cb50c5e6b22a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:48.404999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91c8b8-2e08-4863-a207-779c46d36b85 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:48.437551 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bce6f-07bd-4af9-a1fe-0adc39afd238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:48.438214 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bce6f-07bd-4af9-a1fe-0adc39afd238 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:48.438504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bce6f-07bd-4af9-a1fe-0adc39afd238 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:48.438796 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bce6f-07bd-4af9-a1fe-0adc39afd238 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:48.439570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bce6f-07bd-4af9-a1fe-0adc39afd238 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:48.439714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 247/508] 10.222.0.77 () {56 vars in 1137 bytes} [Wed May 11 06:41:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:48.439850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bce6f-07bd-4af9-a1fe-0adc39afd238 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:48.440868 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8bf2d-a462-41e5-a3e6-4cc81718568b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:48.441152 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8bf2d-a462-41e5-a3e6-4cc81718568b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:48.441276 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bce6f-07bd-4af9-a1fe-0adc39afd238 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:48.441414 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8bf2d-a462-41e5-a3e6-4cc81718568b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:48.449555 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 262/509] 10.222.0.77 () {56 vars in 1103 bytes} [Wed May 11 06:41:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:48.450358 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bce6f-07bd-4af9-a1fe-0adc39afd238 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:48.458468 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-4ad8bf2d-a462-41e5-a3e6-4cc81718568b None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:48.459744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4ad8bf2d-a462-41e5-a3e6-4cc81718568b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:48.528118 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 248/510] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:48.529238 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8bf2d-a462-41e5-a3e6-4cc81718568b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:48.553731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bce6f-07bd-4af9-a1fe-0adc39afd238 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:48.585180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a89533-d259-4007-ae34-56dafe7fcce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:48.585977 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a89533-d259-4007-ae34-56dafe7fcce3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:48.586254 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a89533-d259-4007-ae34-56dafe7fcce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:48.586527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a89533-d259-4007-ae34-56dafe7fcce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:48.596468 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a89533-d259-4007-ae34-56dafe7fcce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:48.597903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a89533-d259-4007-ae34-56dafe7fcce3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:48.614475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-04a89533-d259-4007-ae34-56dafe7fcce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:48.614475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:48.614475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:48.614475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:48.614475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:48.614475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:48.614475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:48.614475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:48.614475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:48.614475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:48.614475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:48.614475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:48.614475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:48.614475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:48.614475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:48.615589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:48.615589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:48.615589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:48.615589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:48.615589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:48.615589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:48.615589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:48.615589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:48.615589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:48.615589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:48.615589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:48.615589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:48.615589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:48.615589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:48.615589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:48.615589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:48.615589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:48.616470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:48.616470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:48.616470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:48.616470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:48.616470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 263/511] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:48.616470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a89533-d259-4007-ae34-56dafe7fcce3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:48.634599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8bf2d-a462-41e5-a3e6-4cc81718568b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:48.667524 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd25998-2b46-4560-a551-6e86a8141241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:48.668181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd25998-2b46-4560-a551-6e86a8141241 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:48.668457 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd25998-2b46-4560-a551-6e86a8141241 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:48.668750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd25998-2b46-4560-a551-6e86a8141241 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:48.669532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd25998-2b46-4560-a551-6e86a8141241 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:48.669842 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd25998-2b46-4560-a551-6e86a8141241 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:48.671318 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd25998-2b46-4560-a551-6e86a8141241 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:48.688592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 249/512] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:41:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:48.689374 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd25998-2b46-4560-a551-6e86a8141241 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:48.710588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a89533-d259-4007-ae34-56dafe7fcce3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:48.743635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72690a0b-7d22-483a-8c84-393948056971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:48.744284 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72690a0b-7d22-483a-8c84-393948056971 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:48.744560 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72690a0b-7d22-483a-8c84-393948056971 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:48.744831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72690a0b-7d22-483a-8c84-393948056971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:48.787761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd25998-2b46-4560-a551-6e86a8141241 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:48.807757 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72690a0b-7d22-483a-8c84-393948056971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:48.809224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72690a0b-7d22-483a-8c84-393948056971 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:48.818762 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee91ee1-12fd-4e52-9221-632d9b0d7a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:48.819587 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee91ee1-12fd-4e52-9221-632d9b0d7a58 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:48.819862 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee91ee1-12fd-4e52-9221-632d9b0d7a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:48.820132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee91ee1-12fd-4e52-9221-632d9b0d7a58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:48.834074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee91ee1-12fd-4e52-9221-632d9b0d7a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:48.835606 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee91ee1-12fd-4e52-9221-632d9b0d7a58 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:48.852429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-9ee91ee1-12fd-4e52-9221-632d9b0d7a58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:48.852429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:48.852429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:48.852429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:48.852429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:48.852429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:48.852429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:48.852429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:48.852429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:48.852429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:48.852429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:48.852429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:48.852429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:48.852429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:48.852429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:48.853356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:48.853356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:48.853356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:48.853356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:48.853356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:48.853356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:48.853356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:48.853356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:48.853356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:48.853356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:48.853356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:48.853356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:48.853356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:48.853356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:48.853356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:48.853356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:48.853356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:48.854471 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:48.854471 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:48.854471 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:48.854471 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:48.854471 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 250/513] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:48.855036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee91ee1-12fd-4e52-9221-632d9b0d7a58 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:48.906240 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 264/514] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:41:48.907103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72690a0b-7d22-483a-8c84-393948056971 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:48.951381 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee91ee1-12fd-4e52-9221-632d9b0d7a58 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:48.984002 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa760f-d86c-4a61-887f-3af6cc6ebbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:48.984784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa760f-d86c-4a61-887f-3af6cc6ebbdc None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:48.985059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa760f-d86c-4a61-887f-3af6cc6ebbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:48.985334 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa760f-d86c-4a61-887f-3af6cc6ebbdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:48.995654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa760f-d86c-4a61-887f-3af6cc6ebbdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:48.997098 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa760f-d86c-4a61-887f-3af6cc6ebbdc None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:49.000416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72690a0b-7d22-483a-8c84-393948056971 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:49.013367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-95aa760f-d86c-4a61-887f-3af6cc6ebbdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:49.013367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:49.013367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:49.013367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:49.013367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:49.013367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:49.013367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:49.013367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:49.013367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:49.013367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:49.013367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:49.013367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:49.013367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:49.013367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:49.013367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:49.014235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:49.014235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:49.014235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:49.014235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:49.014235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:49.014235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:49.014235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:49.014235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:49.014235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:49.014235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:49.014235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:49.014235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:49.014235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:49.014235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:49.014235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:49.014235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:49.014235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:49.015129 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:49.015129 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:49.015129 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:49.015129 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:49.015129 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 251/515] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:49.015425 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa760f-d86c-4a61-887f-3af6cc6ebbdc None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:49.032255 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143b9d2-3ea0-493f-9ff3-44c26599fae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:49.032915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143b9d2-3ea0-493f-9ff3-44c26599fae8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:49.033192 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143b9d2-3ea0-493f-9ff3-44c26599fae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:49.033461 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143b9d2-3ea0-493f-9ff3-44c26599fae8 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:49.034174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143b9d2-3ea0-493f-9ff3-44c26599fae8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:49.034470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143b9d2-3ea0-493f-9ff3-44c26599fae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:49.035851 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143b9d2-3ea0-493f-9ff3-44c26599fae8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:49.046610 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 265/516] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:49.047376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143b9d2-3ea0-493f-9ff3-44c26599fae8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:49.111564 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa760f-d86c-4a61-887f-3af6cc6ebbdc None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:49.141595 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143b9d2-3ea0-493f-9ff3-44c26599fae8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:49.143364 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5672d1f-6ec2-47d4-b7f0-a9a2d543ce2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:49.144002 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5672d1f-6ec2-47d4-b7f0-a9a2d543ce2a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:49.144283 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5672d1f-6ec2-47d4-b7f0-a9a2d543ce2a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:49.144552 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5672d1f-6ec2-47d4-b7f0-a9a2d543ce2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:49.145360 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5672d1f-6ec2-47d4-b7f0-a9a2d543ce2a None admin] RBAC: Adding query filter params (role.id=46d109e3a1bd4f13b0d145cde46c75a9, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=edf9d57de89a4701ba1a5b079d0ad348) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:49.145663 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5672d1f-6ec2-47d4-b7f0-a9a2d543ce2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:49.147198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5672d1f-6ec2-47d4-b7f0-a9a2d543ce2a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:49.152513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 252/517] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:41:49 2022] GET /identity/v3/role_assignments?user.id=edf9d57de89a4701ba1a5b079d0ad348&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=46d109e3a1bd4f13b0d145cde46c75a9 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:49.153267 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5672d1f-6ec2-47d4-b7f0-a9a2d543ce2a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:49.177726 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960708c8-8feb-4e21-a269-ef1c0a93152a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:49.178323 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960708c8-8feb-4e21-a269-ef1c0a93152a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:49.178599 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960708c8-8feb-4e21-a269-ef1c0a93152a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:49.178864 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960708c8-8feb-4e21-a269-ef1c0a93152a None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:49.179632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960708c8-8feb-4e21-a269-ef1c0a93152a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:49.179960 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960708c8-8feb-4e21-a269-ef1c0a93152a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:49.181370 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960708c8-8feb-4e21-a269-ef1c0a93152a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:49.194314 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 266/518] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:49.195688 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960708c8-8feb-4e21-a269-ef1c0a93152a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:49.259003 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5672d1f-6ec2-47d4-b7f0-a9a2d543ce2a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:49.296592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc408ecd-0d81-41af-b006-e3ef79cc8daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:49.297406 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc408ecd-0d81-41af-b006-e3ef79cc8daf None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:49.297684 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc408ecd-0d81-41af-b006-e3ef79cc8daf None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:49.297955 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc408ecd-0d81-41af-b006-e3ef79cc8daf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:49.312912 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc408ecd-0d81-41af-b006-e3ef79cc8daf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:49.314480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc408ecd-0d81-41af-b006-e3ef79cc8daf None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:49.326921 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960708c8-8feb-4e21-a269-ef1c0a93152a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:49.333316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-bc408ecd-0d81-41af-b006-e3ef79cc8daf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:49.333316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:49.333316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:49.333316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:49.333316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:49.333316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:49.333316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:49.333316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:49.333316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:49.333316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:49.333316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:49.333316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:49.333316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:49.333316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:49.333316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:49.334181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:49.334181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:49.334181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:49.334181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:49.334181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:49.334181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:49.334181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:49.334181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:49.334181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:49.334181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:49.334181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:49.334181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:49.334181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:49.334181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:49.334181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:49.334181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:49.334181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:49.335075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:49.335075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:49.335075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:49.335075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:49.335075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 253/519] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:49.335830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc408ecd-0d81-41af-b006-e3ef79cc8daf None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:49.368803 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171940b9-3bc0-42f7-9cba-566d51b4c436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:49.369477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171940b9-3bc0-42f7-9cba-566d51b4c436 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:49.369754 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171940b9-3bc0-42f7-9cba-566d51b4c436 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:49.370023 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171940b9-3bc0-42f7-9cba-566d51b4c436 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:49.370750 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171940b9-3bc0-42f7-9cba-566d51b4c436 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:49.371085 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171940b9-3bc0-42f7-9cba-566d51b4c436 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:49.372457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171940b9-3bc0-42f7-9cba-566d51b4c436 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:49.388204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 267/520] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:49.388204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171940b9-3bc0-42f7-9cba-566d51b4c436 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:49.447413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc408ecd-0d81-41af-b006-e3ef79cc8daf None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:49.482506 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9804e-696b-4ed9-819b-9c65d2253c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:49.483351 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9804e-696b-4ed9-819b-9c65d2253c5d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:49.483691 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9804e-696b-4ed9-819b-9c65d2253c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:49.483953 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9804e-696b-4ed9-819b-9c65d2253c5d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:49.487139 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171940b9-3bc0-42f7-9cba-566d51b4c436 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:49.491804 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9804e-696b-4ed9-819b-9c65d2253c5d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:49.493288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9804e-696b-4ed9-819b-9c65d2253c5d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:49.513330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-f7c9804e-696b-4ed9-819b-9c65d2253c5d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 06:41:49.513330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:49.513330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:49.513330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:49.513330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:49.513330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:49.513330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:49.513330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:49.513330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:49.513330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:49.513330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:49.513330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:49.513330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:41:49.513330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:41:49.513330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:41:49.513330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:41:49.514291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:49.514291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:49.514291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:41:49.514291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:41:49.514291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:41:49.514291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:41:49.514291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:49.514291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:49.514291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:49.514291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:49.514291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:49.514291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:49.514291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:49.514291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:49.514291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:49.514291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:49.514291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:49.514291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:49.515224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:49.515224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:49.515224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:41:49.515224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:41:49.515224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:41:49.515224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:41:49.515224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:41:49.515224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:41:49.515224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 06:41:49.515224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:49.515224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 254/521] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:49.515808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9804e-696b-4ed9-819b-9c65d2253c5d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:49.528929 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a532d-4298-4f21-bcef-9340390a5073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:49.529739 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a532d-4298-4f21-bcef-9340390a5073 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:49.530004 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a532d-4298-4f21-bcef-9340390a5073 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:49.530295 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a532d-4298-4f21-bcef-9340390a5073 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:49.538010 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a532d-4298-4f21-bcef-9340390a5073 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:49.539518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a532d-4298-4f21-bcef-9340390a5073 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:49.553732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-530a532d-4298-4f21-bcef-9340390a5073 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 06:41:49.553732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:49.553732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:49.553732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:49.553732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:49.553732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:49.553732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:49.553732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:49.553732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:49.553732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:49.553732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:49.553732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:49.553732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:41:49.553732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:41:49.553732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:41:49.553732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:41:49.554643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:49.554643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:49.554643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:41:49.554643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:41:49.554643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:41:49.554643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:41:49.554643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:49.554643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:49.554643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:49.554643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:49.554643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:49.554643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:49.554643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:49.554643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:49.554643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:49.554643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:49.554643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:49.554643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:49.555598 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:49.555598 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:49.555598 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:41:49.555598 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:41:49.555598 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:41:49.555598 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:41:49.555598 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:41:49.555598 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:41:49.555598 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 06:41:49.555598 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:49.559721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 268/522] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:41:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:49.560396 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a532d-4298-4f21-bcef-9340390a5073 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:49.616980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9804e-696b-4ed9-819b-9c65d2253c5d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:49.649105 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3f3ad-09f9-4d1e-aaf4-cdb78c5dec46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:49.649781 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3f3ad-09f9-4d1e-aaf4-cdb78c5dec46 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:49.650061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3f3ad-09f9-4d1e-aaf4-cdb78c5dec46 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:49.650334 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3f3ad-09f9-4d1e-aaf4-cdb78c5dec46 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:49.651090 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3f3ad-09f9-4d1e-aaf4-cdb78c5dec46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:49.651398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3f3ad-09f9-4d1e-aaf4-cdb78c5dec46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:49.652775 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3f3ad-09f9-4d1e-aaf4-cdb78c5dec46 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:49.658521 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a532d-4298-4f21-bcef-9340390a5073 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:49.664584 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 255/523] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:49.665954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3f3ad-09f9-4d1e-aaf4-cdb78c5dec46 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:49.691093 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8e83a-f650-42f0-bf16-308e9e1d3d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:49.691899 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8e83a-f650-42f0-bf16-308e9e1d3d98 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:49.692272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8e83a-f650-42f0-bf16-308e9e1d3d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:49.692658 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8e83a-f650-42f0-bf16-308e9e1d3d98 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:49.693459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8e83a-f650-42f0-bf16-308e9e1d3d98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:49.695025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8e83a-f650-42f0-bf16-308e9e1d3d98 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:49.717485 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 269/524] 10.222.0.77 () {60 vars in 1132 bytes} [Wed May 11 06:41:49 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:41:49.718510 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8e83a-f650-42f0-bf16-308e9e1d3d98 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:49.784454 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3f3ad-09f9-4d1e-aaf4-cdb78c5dec46 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:49.822124 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceabed48-07a3-44da-9c22-5db8a26b8a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:49.822854 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabed48-07a3-44da-9c22-5db8a26b8a76 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:49.823192 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabed48-07a3-44da-9c22-5db8a26b8a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:49.823456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabed48-07a3-44da-9c22-5db8a26b8a76 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:49.824441 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceabed48-07a3-44da-9c22-5db8a26b8a76 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:49.824629 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceabed48-07a3-44da-9c22-5db8a26b8a76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:49.826196 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceabed48-07a3-44da-9c22-5db8a26b8a76 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:49.845885 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 256/525] 10.222.0.77 () {56 vars in 1137 bytes} [Wed May 11 06:41:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:49.846816 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceabed48-07a3-44da-9c22-5db8a26b8a76 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:49.849480 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8e83a-f650-42f0-bf16-308e9e1d3d98 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:49.886083 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a5be2-db92-4b29-b922-49ca396f2fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:49.887191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a5be2-db92-4b29-b922-49ca396f2fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:49.887616 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a5be2-db92-4b29-b922-49ca396f2fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:49.888026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a5be2-db92-4b29-b922-49ca396f2fe5 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:49.889037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a5be2-db92-4b29-b922-49ca396f2fe5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:49.889500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a5be2-db92-4b29-b922-49ca396f2fe5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:49.891217 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a5be2-db92-4b29-b922-49ca396f2fe5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:49.915225 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 270/526] 10.222.0.77 () {56 vars in 1139 bytes} [Wed May 11 06:41:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:49.916826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a5be2-db92-4b29-b922-49ca396f2fe5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:49.952100 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceabed48-07a3-44da-9c22-5db8a26b8a76 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:49.986201 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71dfb3-4cb4-41f8-a9c1-2ddd718e1582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:49.986941 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71dfb3-4cb4-41f8-a9c1-2ddd718e1582 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:49.987246 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71dfb3-4cb4-41f8-a9c1-2ddd718e1582 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:49.987521 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71dfb3-4cb4-41f8-a9c1-2ddd718e1582 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:49.994844 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71dfb3-4cb4-41f8-a9c1-2ddd718e1582 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:49.996413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71dfb3-4cb4-41f8-a9c1-2ddd718e1582 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:50.010994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-4c71dfb3-4cb4-41f8-a9c1-2ddd718e1582 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:41:50.010994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:50.010994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:50.010994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:50.010994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:50.010994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:50.010994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:50.010994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:50.010994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:50.010994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:50.010994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:50.010994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:50.010994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:41:50.010994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:41:50.010994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:41:50.011855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:41:50.011855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:50.011855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:50.011855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:50.011855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:50.011855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:50.011855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:50.011855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:50.011855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:50.011855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:50.011855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:50.011855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:50.011855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:50.011855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:50.011855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:50.011855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:50.011855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:50.013145 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:41:50.013145 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:41:50.013145 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:41:50.013145 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:41:50.013145 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:41:50.013145 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:41:50.013145 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:41:50.013145 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:50.013145 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 257/527] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:41:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:50.013612 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71dfb3-4cb4-41f8-a9c1-2ddd718e1582 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:50.019562 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a5be2-db92-4b29-b922-49ca396f2fe5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:50.052938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b310b9-c1c4-486e-ab93-1f060539fe26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:50.053979 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b310b9-c1c4-486e-ab93-1f060539fe26 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:50.054472 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b310b9-c1c4-486e-ab93-1f060539fe26 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:50.054930 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b310b9-c1c4-486e-ab93-1f060539fe26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:50.110818 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71dfb3-4cb4-41f8-a9c1-2ddd718e1582 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:50.120789 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b310b9-c1c4-486e-ab93-1f060539fe26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:50.122486 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b310b9-c1c4-486e-ab93-1f060539fe26 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:50.143985 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d204e50-f930-4807-b308-5e6d42da7603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:50.144599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d204e50-f930-4807-b308-5e6d42da7603 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:50.144877 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d204e50-f930-4807-b308-5e6d42da7603 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:50.145151 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d204e50-f930-4807-b308-5e6d42da7603 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:50.211361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d204e50-f930-4807-b308-5e6d42da7603 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:50.212835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d204e50-f930-4807-b308-5e6d42da7603 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:50.228096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 271/528] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:41:50.229311 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b310b9-c1c4-486e-ab93-1f060539fe26 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:50.315537 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 258/529] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:41:50.316318 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d204e50-f930-4807-b308-5e6d42da7603 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:50.331817 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b310b9-c1c4-486e-ab93-1f060539fe26 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:50.365464 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabbe13-c111-4380-a930-4b7d3f429947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:50.366482 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabbe13-c111-4380-a930-4b7d3f429947 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:50.366952 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabbe13-c111-4380-a930-4b7d3f429947 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:50.367472 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabbe13-c111-4380-a930-4b7d3f429947 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:50.368470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabbe13-c111-4380-a930-4b7d3f429947 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:50.368971 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabbe13-c111-4380-a930-4b7d3f429947 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:50.370613 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabbe13-c111-4380-a930-4b7d3f429947 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:50.393947 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 272/530] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:41:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:50.395186 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabbe13-c111-4380-a930-4b7d3f429947 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:50.414021 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d204e50-f930-4807-b308-5e6d42da7603 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:50.448011 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4251109-7c0b-4b43-ae75-90dedf6fbd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:50.449094 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4251109-7c0b-4b43-ae75-90dedf6fbd4e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:50.449386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4251109-7c0b-4b43-ae75-90dedf6fbd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:50.449657 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4251109-7c0b-4b43-ae75-90dedf6fbd4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:50.462737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4251109-7c0b-4b43-ae75-90dedf6fbd4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:50.465143 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4251109-7c0b-4b43-ae75-90dedf6fbd4e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:50.486361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-b4251109-7c0b-4b43-ae75-90dedf6fbd4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:50.486361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:50.486361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:50.486361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:50.486361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:50.486361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:50.486361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:50.486361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:50.486361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:50.486361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:50.486361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:50.486361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:50.486361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:50.486361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:50.486361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:50.487297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:50.487297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:50.487297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:50.487297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:50.487297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:50.487297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:50.487297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:50.487297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:50.487297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:50.487297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:50.487297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:50.487297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:50.487297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:50.487297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:50.487297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:50.487297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:50.487297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:50.488583 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:50.488583 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:50.488583 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:50.488583 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:50.488583 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 259/531] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:50.488583 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4251109-7c0b-4b43-ae75-90dedf6fbd4e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:50.496446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabbe13-c111-4380-a930-4b7d3f429947 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:50.533136 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2462f-a290-4b6d-bfd8-47de6a13402b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:50.534308 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2462f-a290-4b6d-bfd8-47de6a13402b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:50.534778 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2462f-a290-4b6d-bfd8-47de6a13402b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:50.535419 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2462f-a290-4b6d-bfd8-47de6a13402b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:50.549042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2462f-a290-4b6d-bfd8-47de6a13402b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:50.550999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2462f-a290-4b6d-bfd8-47de6a13402b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:50.573463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-70c2462f-a290-4b6d-bfd8-47de6a13402b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:50.573463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:50.573463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:50.573463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:50.573463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:50.573463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:50.573463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:50.573463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:50.573463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:50.573463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:50.573463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:50.573463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:50.573463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:50.573463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:50.573463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:50.574374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:50.574374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:50.574374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:50.574374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:50.574374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:50.574374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:50.574374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:50.574374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:50.574374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:50.574374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:50.574374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:50.574374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:50.574374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:50.574374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:50.574374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:50.574374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:50.574374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:50.575261 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:50.575261 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:50.575261 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:50.575261 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:50.581097 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 273/532] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:50.581097 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2462f-a290-4b6d-bfd8-47de6a13402b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:50.604770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4251109-7c0b-4b43-ae75-90dedf6fbd4e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:50.638951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a5f8e-3fcd-4e10-b211-4b2e7ed7ad06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:50.639913 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a5f8e-3fcd-4e10-b211-4b2e7ed7ad06 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:50.640207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a5f8e-3fcd-4e10-b211-4b2e7ed7ad06 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:50.640476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a5f8e-3fcd-4e10-b211-4b2e7ed7ad06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:50.641311 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a5f8e-3fcd-4e10-b211-4b2e7ed7ad06 None admin] RBAC: Adding query filter params (role.id=46d109e3a1bd4f13b0d145cde46c75a9, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=628e4779afa24fb187c4b10a3765af9a) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:50.641798 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a5f8e-3fcd-4e10-b211-4b2e7ed7ad06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:50.643720 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a5f8e-3fcd-4e10-b211-4b2e7ed7ad06 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:50.650583 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 260/533] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:41:50 2022] GET /identity/v3/role_assignments?user.id=628e4779afa24fb187c4b10a3765af9a&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=46d109e3a1bd4f13b0d145cde46c75a9 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:50.651745 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a5f8e-3fcd-4e10-b211-4b2e7ed7ad06 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:50.707228 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2462f-a290-4b6d-bfd8-47de6a13402b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:50.748087 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0103d85-6ca2-49f9-95bc-e06bb5346275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:50.748850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0103d85-6ca2-49f9-95bc-e06bb5346275 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:50.749112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0103d85-6ca2-49f9-95bc-e06bb5346275 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:50.749456 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0103d85-6ca2-49f9-95bc-e06bb5346275 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:50.750164 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0103d85-6ca2-49f9-95bc-e06bb5346275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:50.750516 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0103d85-6ca2-49f9-95bc-e06bb5346275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:50.752142 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0103d85-6ca2-49f9-95bc-e06bb5346275 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:50.762319 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a5f8e-3fcd-4e10-b211-4b2e7ed7ad06 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:50.763524 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 274/534] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:50.769347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0103d85-6ca2-49f9-95bc-e06bb5346275 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:50.819909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5d744-2aec-4504-8de0-c7a6f687451f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:50.821317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5d744-2aec-4504-8de0-c7a6f687451f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:50.821791 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5d744-2aec-4504-8de0-c7a6f687451f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:50.822261 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5d744-2aec-4504-8de0-c7a6f687451f None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:50.823228 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5d744-2aec-4504-8de0-c7a6f687451f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:50.823729 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5d744-2aec-4504-8de0-c7a6f687451f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:50.825367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5d744-2aec-4504-8de0-c7a6f687451f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:50.852480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 261/535] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:50.857824 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5d744-2aec-4504-8de0-c7a6f687451f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:50.972837 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0103d85-6ca2-49f9-95bc-e06bb5346275 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:50.999000 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5d744-2aec-4504-8de0-c7a6f687451f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:51.042131 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f2f8e-8cbc-47f7-ac56-620cb2c49a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:51.043394 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f2f8e-8cbc-47f7-ac56-620cb2c49a27 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:51.043672 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f2f8e-8cbc-47f7-ac56-620cb2c49a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:51.043941 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f2f8e-8cbc-47f7-ac56-620cb2c49a27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:51.053913 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f2f8e-8cbc-47f7-ac56-620cb2c49a27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:51.055670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f2f8e-8cbc-47f7-ac56-620cb2c49a27 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:51.057594 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa43a66-aac2-4d28-b246-9b03a66d7582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:51.060612 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa43a66-aac2-4d28-b246-9b03a66d7582 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:51.061370 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa43a66-aac2-4d28-b246-9b03a66d7582 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:51.065034 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa43a66-aac2-4d28-b246-9b03a66d7582 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:51.080940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-931f2f8e-8cbc-47f7-ac56-620cb2c49a27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:41:51.080940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:51.080940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:51.080940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:51.080940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:51.080940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:51.080940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:51.080940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:51.080940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:51.080940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:51.080940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:51.080940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:51.080940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:41:51.080940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:41:51.080940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:41:51.081821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:41:51.081821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:51.081821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:51.081821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:51.081821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:51.081821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:51.081821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:51.081821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:51.081821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:51.081821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:51.081821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:51.081821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:51.081821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:51.081821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:51.081821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:51.081821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:51.081821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:51.082765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:41:51.082765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:41:51.082765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:41:51.082765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:41:51.082765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:41:51.082765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:41:51.082765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:41:51.082765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:51.085056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa43a66-aac2-4d28-b246-9b03a66d7582 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:51.086768 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa43a66-aac2-4d28-b246-9b03a66d7582 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:51.090055 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 262/536] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:41:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:51.097189 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f2f8e-8cbc-47f7-ac56-620cb2c49a27 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:51.111048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-eaa43a66-aac2-4d28-b246-9b03a66d7582 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:41:51.111048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:51.111048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:51.111048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:51.111048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:51.111048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:51.111048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:51.111048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:51.111048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:51.111048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:51.111048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:51.111048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:51.111048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:41:51.111048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:41:51.111048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:41:51.111936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:41:51.111936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:51.111936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:51.111936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:51.111936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:51.111936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:51.111936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:51.111936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:51.111936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:51.111936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:51.111936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:51.111936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:51.111936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:51.111936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:51.111936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:51.111936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:51.111936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:51.112800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:41:51.112800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:41:51.112800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:41:51.112800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:41:51.112800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:41:51.112800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:41:51.112800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:41:51.112800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:51.123961 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 275/537] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:41:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:51.129642 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa43a66-aac2-4d28-b246-9b03a66d7582 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:51.259422 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f2f8e-8cbc-47f7-ac56-620cb2c49a27 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:51.309664 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4eb9b-a040-4a01-8701-1be4b4d5cfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:51.310344 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4eb9b-a040-4a01-8701-1be4b4d5cfd3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:51.310620 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4eb9b-a040-4a01-8701-1be4b4d5cfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:51.310891 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4eb9b-a040-4a01-8701-1be4b4d5cfd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:51.312448 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4eb9b-a040-4a01-8701-1be4b4d5cfd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:51.312757 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4eb9b-a040-4a01-8701-1be4b4d5cfd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:51.314217 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4eb9b-a040-4a01-8701-1be4b4d5cfd3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:51.336062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 263/538] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:41:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:51.340800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa43a66-aac2-4d28-b246-9b03a66d7582 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:51.342997 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4eb9b-a040-4a01-8701-1be4b4d5cfd3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:51.403597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b01ae-039b-4018-9112-cabc224b1811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:51.404272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b01ae-039b-4018-9112-cabc224b1811 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:51.404553 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b01ae-039b-4018-9112-cabc224b1811 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:51.404822 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b01ae-039b-4018-9112-cabc224b1811 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:51.405618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b01ae-039b-4018-9112-cabc224b1811 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:51.405924 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b01ae-039b-4018-9112-cabc224b1811 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:51.407418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b01ae-039b-4018-9112-cabc224b1811 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:51.419632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 276/539] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:41:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:51.420957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b64f1-e9c9-4714-9533-a7a246d90df6 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:51.421242 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b64f1-e9c9-4714-9533-a7a246d90df6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:51.421515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b64f1-e9c9-4714-9533-a7a246d90df6 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:51.422951 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 277/540] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:51.425097 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b64f1-e9c9-4714-9533-a7a246d90df6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:51.486482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4eb9b-a040-4a01-8701-1be4b4d5cfd3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:51.525376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baf712-3ca1-494b-86b2-4ee345d4145c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:51.526038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baf712-3ca1-494b-86b2-4ee345d4145c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:51.526317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baf712-3ca1-494b-86b2-4ee345d4145c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:51.526632 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baf712-3ca1-494b-86b2-4ee345d4145c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:51.527512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baf712-3ca1-494b-86b2-4ee345d4145c None admin] RBAC: Adding query filter params (role.id=46d109e3a1bd4f13b0d145cde46c75a9, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=3c92f4b777a644ad8055f15b1a8bd0be) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:51.527824 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baf712-3ca1-494b-86b2-4ee345d4145c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:51.529272 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baf712-3ca1-494b-86b2-4ee345d4145c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:51.535163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b64f1-e9c9-4714-9533-a7a246d90df6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:51.540517 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 264/541] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:41:51 2022] GET /identity/v3/role_assignments?user.id=3c92f4b777a644ad8055f15b1a8bd0be&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=46d109e3a1bd4f13b0d145cde46c75a9 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:51.542292 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00faf92-fdaa-4bcf-9b79-2d67aeea5d4a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:51.542628 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00faf92-fdaa-4bcf-9b79-2d67aeea5d4a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:51.542910 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00faf92-fdaa-4bcf-9b79-2d67aeea5d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:51.581230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f00faf92-fdaa-4bcf-9b79-2d67aeea5d4a None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:51.582908 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae6f33-5aa1-49bb-8b28-fbd768b884ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:51.583721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae6f33-5aa1-49bb-8b28-fbd768b884ee None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:51.584003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae6f33-5aa1-49bb-8b28-fbd768b884ee None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:51.584335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae6f33-5aa1-49bb-8b28-fbd768b884ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:51.585268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae6f33-5aa1-49bb-8b28-fbd768b884ee None admin] RBAC: Adding query filter params (role.id=46d109e3a1bd4f13b0d145cde46c75a9, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=281c923b01a143dbb79d8c0ea04f55b6) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:51.586464 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f00faf92-fdaa-4bcf-9b79-2d67aeea5d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:51.588156 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae6f33-5aa1-49bb-8b28-fbd768b884ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:51.591097 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae6f33-5aa1-49bb-8b28-fbd768b884ee None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:51.604763 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 278/542] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:41:51 2022] GET /identity/v3/role_assignments?user.id=281c923b01a143dbb79d8c0ea04f55b6&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=46d109e3a1bd4f13b0d145cde46c75a9 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:51.692295 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 265/543] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:51.727542 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae6f33-5aa1-49bb-8b28-fbd768b884ee None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:51.849374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae6f33-5aa1-49bb-8b28-fbd768b884ee None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:51.895543 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfae83c-8cdd-4cca-8693-6d69bffc2a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:51.896513 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfae83c-8cdd-4cca-8693-6d69bffc2a5e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:51.896792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfae83c-8cdd-4cca-8693-6d69bffc2a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:51.897061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfae83c-8cdd-4cca-8693-6d69bffc2a5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:51.908354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfae83c-8cdd-4cca-8693-6d69bffc2a5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:51.916452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-3bfae83c-8cdd-4cca-8693-6d69bffc2a5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:51.916452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:51.916452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:51.916452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:51.916452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:51.916452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:51.916452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:51.916452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:51.916452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:51.916452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:51.916452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:51.916452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:51.916452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:51.916452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:51.916452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:51.916452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:51.918517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:51.918517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:51.918517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:51.918517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:51.918517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:51.918517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:51.918517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:51.918517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:51.918517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:51.918517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:51.918517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:51.918517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:51.918517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:51.918517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:51.918517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:51.918517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:51.919541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:51.919541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:51.919541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:51.919541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:51.919541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:51.919541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:51.919541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:51.919541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:51.919541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:51.919541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:51.919541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:51.919541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:51.919541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 279/544] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:41:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:51.923907 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00faf92-fdaa-4bcf-9b79-2d67aeea5d4a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:52.037845 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00faf92-fdaa-4bcf-9b79-2d67aeea5d4a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:52.082717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1493ca3-d760-4932-9265-d0912f0da4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:52.083530 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1493ca3-d760-4932-9265-d0912f0da4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:52.083814 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1493ca3-d760-4932-9265-d0912f0da4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:52.084090 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1493ca3-d760-4932-9265-d0912f0da4d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:52.084858 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1493ca3-d760-4932-9265-d0912f0da4d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:52.085165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1493ca3-d760-4932-9265-d0912f0da4d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:52.086557 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1493ca3-d760-4932-9265-d0912f0da4d6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:52.095714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 266/545] 10.222.0.77 () {56 vars in 1103 bytes} [Wed May 11 06:41:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:52.102038 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfae83c-8cdd-4cca-8693-6d69bffc2a5e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:52.262605 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfae83c-8cdd-4cca-8693-6d69bffc2a5e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:52.312828 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a46590-5b43-4a2f-b622-436bf1a0289e None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:52.313373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3829f9-9fb8-4aaa-bd86-c85a1755cf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:52.313508 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a46590-5b43-4a2f-b622-436bf1a0289e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:52.313508 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a46590-5b43-4a2f-b622-436bf1a0289e None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:52.313715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3829f9-9fb8-4aaa-bd86-c85a1755cf8a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:52.313997 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3829f9-9fb8-4aaa-bd86-c85a1755cf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:52.314268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3829f9-9fb8-4aaa-bd86-c85a1755cf8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:52.314719 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 267/546] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:41:52.320661 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb74fa0-7d6c-4fc6-b584-48eabe4c6eb8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:52.321478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb74fa0-7d6c-4fc6-b584-48eabe4c6eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:52.321906 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb74fa0-7d6c-4fc6-b584-48eabe4c6eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:52.328423 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3829f9-9fb8-4aaa-bd86-c85a1755cf8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:52.330088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3829f9-9fb8-4aaa-bd86-c85a1755cf8a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:52.351288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ddb74fa0-7d6c-4fc6-b584-48eabe4c6eb8 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:52.352543 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ddb74fa0-7d6c-4fc6-b584-48eabe4c6eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:52.362518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-bc3829f9-9fb8-4aaa-bd86-c85a1755cf8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:52.362518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:52.362518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:52.362518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:52.362518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:52.362518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:52.362518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:52.362518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:52.362518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:52.362518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:52.362518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:52.362518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:52.362518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:52.362518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:52.362518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:52.363454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:52.363454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:52.363454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:52.363454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:52.363454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:52.363454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:52.363454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:52.363454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:52.363454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:52.363454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:52.363454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:52.363454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:52.363454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:52.363454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:52.363454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:52.363454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:52.363454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:52.364322 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:52.364322 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:52.364322 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:52.364322 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:52.370425 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 280/547] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:52.375759 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3829f9-9fb8-4aaa-bd86-c85a1755cf8a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:52.481429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 268/548] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:41:52.513299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3829f9-9fb8-4aaa-bd86-c85a1755cf8a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:52.529016 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb74fa0-7d6c-4fc6-b584-48eabe4c6eb8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:52.561997 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d6ca7-e82d-4584-a21a-a2a57df5a814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:52.562680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d6ca7-e82d-4584-a21a-a2a57df5a814 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:52.562990 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d6ca7-e82d-4584-a21a-a2a57df5a814 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:52.563587 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d6ca7-e82d-4584-a21a-a2a57df5a814 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:52.564466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d6ca7-e82d-4584-a21a-a2a57df5a814 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:52.564777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d6ca7-e82d-4584-a21a-a2a57df5a814 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:52.566159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d6ca7-e82d-4584-a21a-a2a57df5a814 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:52.585053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 281/549] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:52.590767 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d6ca7-e82d-4584-a21a-a2a57df5a814 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:52.713733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb74fa0-7d6c-4fc6-b584-48eabe4c6eb8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:52.725904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d6ca7-e82d-4584-a21a-a2a57df5a814 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:52.761898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89ea55-7610-4083-91fe-6e5685cef674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:52.762703 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89ea55-7610-4083-91fe-6e5685cef674 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:52.762999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89ea55-7610-4083-91fe-6e5685cef674 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:52.763270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89ea55-7610-4083-91fe-6e5685cef674 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:52.771580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e89ea55-7610-4083-91fe-6e5685cef674 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:52.773081 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e89ea55-7610-4083-91fe-6e5685cef674 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:52.789169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5e89ea55-7610-4083-91fe-6e5685cef674 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 06:41:52.789169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:52.789169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:52.789169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:52.789169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:52.789169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:52.789169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:52.789169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:52.789169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:52.789169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:52.789169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:52.789169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:52.789169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:41:52.789169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:41:52.789169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:41:52.789169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:41:52.790134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:52.790134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:52.790134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:41:52.790134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:41:52.790134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:41:52.790134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:41:52.790134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:52.790134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:52.790134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:52.790134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:52.790134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:52.790134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:52.790134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:52.790134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:52.790134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:52.790134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:52.790134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:52.790134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:52.791057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:52.791057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:52.791057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:41:52.791057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:41:52.791057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:41:52.791057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:41:52.791057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:41:52.791057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:41:52.791057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 06:41:52.791057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:52.791057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 282/550] 10.222.0.77 () {56 vars in 1093 bytes} [Wed May 11 06:41:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:52.793134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bf28c-7e59-40bf-90cb-b3f7d64472c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:52.794179 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bf28c-7e59-40bf-90cb-b3f7d64472c1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:52.794635 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bf28c-7e59-40bf-90cb-b3f7d64472c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:52.795119 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bf28c-7e59-40bf-90cb-b3f7d64472c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:52.798800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89ea55-7610-4083-91fe-6e5685cef674 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:52.816950 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5bf28c-7e59-40bf-90cb-b3f7d64472c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:52.836004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-5a5bf28c-7e59-40bf-90cb-b3f7d64472c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:52.836004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:52.836004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:52.836004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:52.836004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:52.836004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:52.836004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:52.836004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:52.836004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:52.836004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:52.836004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:52.836004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:52.836004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:52.836004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:52.836004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:52.836004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:52.836974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:52.836974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:52.836974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:52.836974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:52.836974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:52.836974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:52.836974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:52.836974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:52.836974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:52.836974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:52.836974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:52.836974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:52.836974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:52.836974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:52.836974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:52.836974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:52.837778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:52.837778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:52.837778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:52.837778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:52.837778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:52.837778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:52.837778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:52.837778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:52.837778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:52.837778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:52.837778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:52.837778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:52.841948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 269/551] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:41:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:41:52.856122 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bf28c-7e59-40bf-90cb-b3f7d64472c1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:52.966451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89ea55-7610-4083-91fe-6e5685cef674 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:53.014166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b06bfa-50ec-475d-b768-ded3af065963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:53.015144 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b06bfa-50ec-475d-b768-ded3af065963 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:53.015589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b06bfa-50ec-475d-b768-ded3af065963 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:53.016006 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b06bfa-50ec-475d-b768-ded3af065963 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:53.017014 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b06bfa-50ec-475d-b768-ded3af065963 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:53.017473 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b06bfa-50ec-475d-b768-ded3af065963 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:53.019143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b06bfa-50ec-475d-b768-ded3af065963 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:53.041899 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 283/552] 10.222.0.77 () {56 vars in 1133 bytes} [Wed May 11 06:41:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:53.052919 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b06bfa-50ec-475d-b768-ded3af065963 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:53.089046 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bf28c-7e59-40bf-90cb-b3f7d64472c1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:53.148298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9e85e-bc81-4d72-a854-ecbcdb13f432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:53.148298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9e85e-bc81-4d72-a854-ecbcdb13f432 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:53.148824 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9e85e-bc81-4d72-a854-ecbcdb13f432 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:53.149977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9e85e-bc81-4d72-a854-ecbcdb13f432 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:53.150338 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9e85e-bc81-4d72-a854-ecbcdb13f432 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:53.150710 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9e85e-bc81-4d72-a854-ecbcdb13f432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:53.152469 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9e85e-bc81-4d72-a854-ecbcdb13f432 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:53.163505 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 270/553] 10.222.0.77 () {56 vars in 1103 bytes} [Wed May 11 06:41:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:53.164843 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff616ce8-eb52-47f5-9406-9ddb721e3244 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:53.165126 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff616ce8-eb52-47f5-9406-9ddb721e3244 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:53.165397 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff616ce8-eb52-47f5-9406-9ddb721e3244 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:53.170876 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 271/554] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:53.171931 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff616ce8-eb52-47f5-9406-9ddb721e3244 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:53.192627 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b06bfa-50ec-475d-b768-ded3af065963 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:53.230787 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5128e9-ddfe-4429-b9a4-6da13f7843cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:53.232157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5128e9-ddfe-4429-b9a4-6da13f7843cf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:53.232929 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5128e9-ddfe-4429-b9a4-6da13f7843cf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:53.233488 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5128e9-ddfe-4429-b9a4-6da13f7843cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:53.246581 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5128e9-ddfe-4429-b9a4-6da13f7843cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:53.249065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5128e9-ddfe-4429-b9a4-6da13f7843cf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:53.276056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-6e5128e9-ddfe-4429-b9a4-6da13f7843cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:53.276056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:53.276056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:53.276056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:53.276056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:53.276056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:53.276056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:53.276056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:53.276056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:53.276056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:53.276056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:53.276056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:53.276056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:53.276056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:53.276056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:53.277009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:53.277009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:53.277009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:53.277009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:53.277009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:53.277009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:53.277009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:53.277009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:53.277009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:53.277009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:53.277009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:53.277009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:53.277009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:53.277009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:53.277009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:53.277009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:53.277009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:53.277870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:53.277870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:53.277870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:53.277870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:53.284983 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 284/555] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:53.287296 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea9f43-b592-4856-b3e0-41d5a35be985 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:53.287728 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea9f43-b592-4856-b3e0-41d5a35be985 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:53.288268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea9f43-b592-4856-b3e0-41d5a35be985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:53.299115 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff616ce8-eb52-47f5-9406-9ddb721e3244 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:53.311160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6eea9f43-b592-4856-b3e0-41d5a35be985 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:53.312563 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6eea9f43-b592-4856-b3e0-41d5a35be985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:53.339679 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0134155-e8f2-4f21-9e9e-7f453912186c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:53.340928 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0134155-e8f2-4f21-9e9e-7f453912186c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:53.341503 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0134155-e8f2-4f21-9e9e-7f453912186c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:53.342018 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0134155-e8f2-4f21-9e9e-7f453912186c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:53.354723 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0134155-e8f2-4f21-9e9e-7f453912186c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:53.356945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0134155-e8f2-4f21-9e9e-7f453912186c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:53.379185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-c0134155-e8f2-4f21-9e9e-7f453912186c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:53.379185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:53.379185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:53.379185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:53.379185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:53.379185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:53.379185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:53.379185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:53.379185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:53.379185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:53.379185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:53.379185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:53.379185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:53.379185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:53.379185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:53.380309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:53.380309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:53.380309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:53.380309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:53.380309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:53.380309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:53.380309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:53.380309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:53.380309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:53.380309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:53.380309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:53.380309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:53.380309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:53.380309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:53.380309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:53.380309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:53.380309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:53.381208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:53.381208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:53.381208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:53.381208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:53.388471 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 272/556] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:53.390422 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0134155-e8f2-4f21-9e9e-7f453912186c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:53.395275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 285/557] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:53.396286 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea9f43-b592-4856-b3e0-41d5a35be985 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:53.503039 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0134155-e8f2-4f21-9e9e-7f453912186c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:53.519162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea9f43-b592-4856-b3e0-41d5a35be985 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:53.541343 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5e538-6b67-4940-88f1-c3d7f4e252d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:53.543423 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5e538-6b67-4940-88f1-c3d7f4e252d2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:53.544399 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5e538-6b67-4940-88f1-c3d7f4e252d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:53.545239 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5e538-6b67-4940-88f1-c3d7f4e252d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:53.546485 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5e538-6b67-4940-88f1-c3d7f4e252d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:53.547221 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5e538-6b67-4940-88f1-c3d7f4e252d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:53.549197 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5e538-6b67-4940-88f1-c3d7f4e252d2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:53.553881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311b264-325f-4769-b8ce-e8c1a5f43fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:53.554665 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311b264-325f-4769-b8ce-e8c1a5f43fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:53.555082 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311b264-325f-4769-b8ce-e8c1a5f43fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:53.555451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311b264-325f-4769-b8ce-e8c1a5f43fa6 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:53.556290 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311b264-325f-4769-b8ce-e8c1a5f43fa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:53.556686 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311b264-325f-4769-b8ce-e8c1a5f43fa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:53.558164 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311b264-325f-4769-b8ce-e8c1a5f43fa6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:53.569206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 273/558] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:53.569206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5e538-6b67-4940-88f1-c3d7f4e252d2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:53.581999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 286/559] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:53.583649 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311b264-325f-4769-b8ce-e8c1a5f43fa6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:53.672789 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5e538-6b67-4940-88f1-c3d7f4e252d2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:53.706637 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fa9e5-4bfe-4c8c-9148-04d9b0ad473c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:53.707732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fa9e5-4bfe-4c8c-9148-04d9b0ad473c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:53.707951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fa9e5-4bfe-4c8c-9148-04d9b0ad473c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:53.708254 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fa9e5-4bfe-4c8c-9148-04d9b0ad473c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:53.713576 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311b264-325f-4769-b8ce-e8c1a5f43fa6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:53.718224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2fa9e5-4bfe-4c8c-9148-04d9b0ad473c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:53.726108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-ee2fa9e5-4bfe-4c8c-9148-04d9b0ad473c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:53.726108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:53.726108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:53.726108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:53.726108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:53.726108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:53.726108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:53.726108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:53.726108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:53.726108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:53.726108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:53.726108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:53.726108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:53.726108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:53.726108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:53.726108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:53.727072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:53.727072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:53.727072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:53.727072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:53.727072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:53.727072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:53.727072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:53.727072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:53.727072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:53.727072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:53.727072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:53.727072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:53.727072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:53.727072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:53.727072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:53.727072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:53.727880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:53.727880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:53.727880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:53.727880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:53.727880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:53.727880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:53.727880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:53.727880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:53.727880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:53.727880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:53.727880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:53.727880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:53.727880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 274/560] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:41:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:53.728573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fa9e5-4bfe-4c8c-9148-04d9b0ad473c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:53.758196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a800dad-9636-46e8-9f9b-2df53d59a57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:53.759563 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a800dad-9636-46e8-9f9b-2df53d59a57f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:53.760315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a800dad-9636-46e8-9f9b-2df53d59a57f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:53.761022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a800dad-9636-46e8-9f9b-2df53d59a57f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:53.769995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a800dad-9636-46e8-9f9b-2df53d59a57f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:53.772247 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a800dad-9636-46e8-9f9b-2df53d59a57f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:53.792232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-6a800dad-9636-46e8-9f9b-2df53d59a57f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:41:53.792232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:53.792232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:53.792232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:53.792232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:53.792232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:53.792232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:53.792232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:53.792232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:53.792232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:53.792232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:53.792232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:53.792232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:41:53.792232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:41:53.792232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:41:53.793165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:41:53.793165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:53.793165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:53.793165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:53.793165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:53.793165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:53.793165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:53.793165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:53.793165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:53.793165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:53.793165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:53.793165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:53.793165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:53.793165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:53.793165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:53.793165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:53.793165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:53.794540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:41:53.794540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:41:53.794540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:41:53.794540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:41:53.794540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:41:53.794540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:41:53.794540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:41:53.794540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:53.801247 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 287/561] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:41:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:53.801247 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a800dad-9636-46e8-9f9b-2df53d59a57f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:53.848719 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fa9e5-4bfe-4c8c-9148-04d9b0ad473c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:53.891315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc43c33-393b-47f3-a72c-e1afca829d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:53.892606 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc43c33-393b-47f3-a72c-e1afca829d19 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:53.893220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc43c33-393b-47f3-a72c-e1afca829d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:53.894028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc43c33-393b-47f3-a72c-e1afca829d19 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:53.896799 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a800dad-9636-46e8-9f9b-2df53d59a57f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:53.904832 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc43c33-393b-47f3-a72c-e1afca829d19 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:53.906883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc43c33-393b-47f3-a72c-e1afca829d19 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:53.926714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-cfc43c33-393b-47f3-a72c-e1afca829d19 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 06:41:53.926714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:53.926714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:53.926714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:53.926714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:53.926714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:53.926714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:53.926714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:53.926714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:53.926714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:53.926714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:53.926714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:53.926714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:41:53.926714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:41:53.926714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:41:53.926714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:41:53.927802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:53.927802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:53.927802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:41:53.927802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:41:53.927802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:41:53.927802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:41:53.927802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:53.927802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:53.927802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:53.927802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:53.927802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:53.927802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:53.927802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:53.927802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:53.927802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:53.927802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:53.927802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:53.927802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:53.928750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:53.928750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:53.928750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:41:53.928750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:41:53.928750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:41:53.928750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:41:53.928750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:41:53.928750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:41:53.928750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 06:41:53.928750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:53.931646 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 275/562] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:41:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:53.932715 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc43c33-393b-47f3-a72c-e1afca829d19 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:53.937910 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e219b-4558-4f5a-a208-1a75b217cb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:53.938594 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e219b-4558-4f5a-a208-1a75b217cb98 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:53.938874 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e219b-4558-4f5a-a208-1a75b217cb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:53.939175 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e219b-4558-4f5a-a208-1a75b217cb98 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:53.939931 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e219b-4558-4f5a-a208-1a75b217cb98 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:53.940226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e219b-4558-4f5a-a208-1a75b217cb98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:53.941746 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e219b-4558-4f5a-a208-1a75b217cb98 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:53.955685 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 288/563] 10.222.0.77 () {56 vars in 1103 bytes} [Wed May 11 06:41:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:53.956575 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e219b-4558-4f5a-a208-1a75b217cb98 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:54.033251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc43c33-393b-47f3-a72c-e1afca829d19 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:54.056721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e219b-4558-4f5a-a208-1a75b217cb98 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:54.069978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecd037-8fe2-4c41-81df-c8d01a40278a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:54.071512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecd037-8fe2-4c41-81df-c8d01a40278a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:54.072009 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecd037-8fe2-4c41-81df-c8d01a40278a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:54.072491 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecd037-8fe2-4c41-81df-c8d01a40278a None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:54.073497 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecd037-8fe2-4c41-81df-c8d01a40278a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:54.074002 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecd037-8fe2-4c41-81df-c8d01a40278a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:54.075694 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecd037-8fe2-4c41-81df-c8d01a40278a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:54.088335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 276/564] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:41:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:54.093201 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecd037-8fe2-4c41-81df-c8d01a40278a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:54.096414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd25fd-9139-49c1-b3ec-943c5daddc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:54.097873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd25fd-9139-49c1-b3ec-943c5daddc19 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:54.097873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd25fd-9139-49c1-b3ec-943c5daddc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:54.097873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd25fd-9139-49c1-b3ec-943c5daddc19 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:54.098479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd25fd-9139-49c1-b3ec-943c5daddc19 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:54.098782 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd25fd-9139-49c1-b3ec-943c5daddc19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:54.100317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd25fd-9139-49c1-b3ec-943c5daddc19 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:54.122605 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 289/565] 10.222.0.77 () {56 vars in 1135 bytes} [Wed May 11 06:41:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:54.123547 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd25fd-9139-49c1-b3ec-943c5daddc19 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:54.196314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecd037-8fe2-4c41-81df-c8d01a40278a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:54.225225 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd25fd-9139-49c1-b3ec-943c5daddc19 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:54.232475 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cdd64-29e3-47a7-b23c-dfd2c34c3f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:54.233278 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cdd64-29e3-47a7-b23c-dfd2c34c3f1f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:54.233555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cdd64-29e3-47a7-b23c-dfd2c34c3f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:54.233827 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cdd64-29e3-47a7-b23c-dfd2c34c3f1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:54.243799 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cdd64-29e3-47a7-b23c-dfd2c34c3f1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:54.245250 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cdd64-29e3-47a7-b23c-dfd2c34c3f1f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:54.258680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a2396-c0ce-475b-882f-d92674c1b97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:54.259617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a2396-c0ce-475b-882f-d92674c1b97c None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:54.259891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a2396-c0ce-475b-882f-d92674c1b97c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:54.260156 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a2396-c0ce-475b-882f-d92674c1b97c None admin] PATH_INFO: `/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/edf9d57de89a4701ba1a5b079d0ad348/roles/46d109e3a1bd4f13b0d145cde46c75a9` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:54.262038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-294cdd64-29e3-47a7-b23c-dfd2c34c3f1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:54.262038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:54.262038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:54.262038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:54.262038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:54.262038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:54.262038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:54.262038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:54.262038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:54.262038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:54.262038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:54.262038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:54.262038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:54.262038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:54.262038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:54.262951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:54.262951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:54.262951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:54.262951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:54.262951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:54.262951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:54.262951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:54.262951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:54.262951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:54.262951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:54.262951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:54.262951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:54.262951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:54.262951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:54.262951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:54.262951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:54.262951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:54.263904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:54.263904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:54.263904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:54.263904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:54.263904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 277/566] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:54.264473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cdd64-29e3-47a7-b23c-dfd2c34c3f1f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:54.281620 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a2396-c0ce-475b-882f-d92674c1b97c None admin] RBAC: Authorizing `identity:create_grant(project_id=0f573a9de6904664ace6287072a8a7dc, user_id=edf9d57de89a4701ba1a5b079d0ad348, role_id=46d109e3a1bd4f13b0d145cde46c75a9)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:54.283210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a2396-c0ce-475b-882f-d92674c1b97c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:54.302827 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 290/567] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:41:54 2022] PUT /identity/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/edf9d57de89a4701ba1a5b079d0ad348/roles/46d109e3a1bd4f13b0d145cde46c75a9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:54.316558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe5602-1d8b-4df4-9bd1-c811cfdcc239 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:54.316845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe5602-1d8b-4df4-9bd1-c811cfdcc239 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:54.317125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe5602-1d8b-4df4-9bd1-c811cfdcc239 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:54.322995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 291/568] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:54 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:54.322995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe5602-1d8b-4df4-9bd1-c811cfdcc239 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:54.379965 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cdd64-29e3-47a7-b23c-dfd2c34c3f1f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:54.416047 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2891538-47e6-4b4a-a9b8-e58aec558619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:54.416722 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2891538-47e6-4b4a-a9b8-e58aec558619 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:54.417020 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2891538-47e6-4b4a-a9b8-e58aec558619 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:54.417268 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2891538-47e6-4b4a-a9b8-e58aec558619 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:54.436106 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe5602-1d8b-4df4-9bd1-c811cfdcc239 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:54.471589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab4944-cfb5-4fb1-a487-a7258b5c15a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:54.472302 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab4944-cfb5-4fb1-a487-a7258b5c15a3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:54.472556 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab4944-cfb5-4fb1-a487-a7258b5c15a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:54.472830 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab4944-cfb5-4fb1-a487-a7258b5c15a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:54.473608 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab4944-cfb5-4fb1-a487-a7258b5c15a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:54.473974 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab4944-cfb5-4fb1-a487-a7258b5c15a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:54.475419 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab4944-cfb5-4fb1-a487-a7258b5c15a3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:54.487885 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 292/569] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:54.489216 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed0874-6347-406c-aa65-612e03bee88b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:54.489590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed0874-6347-406c-aa65-612e03bee88b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:54.489871 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed0874-6347-406c-aa65-612e03bee88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:54.497588 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2891538-47e6-4b4a-a9b8-e58aec558619 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:54.499477 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2891538-47e6-4b4a-a9b8-e58aec558619 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:54.508860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-81ed0874-6347-406c-aa65-612e03bee88b None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:54.510074 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-81ed0874-6347-406c-aa65-612e03bee88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:54.576548 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 293/570] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:54.577774 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587897bb-b658-43d8-a0ba-78221253c524 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:54.578064 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587897bb-b658-43d8-a0ba-78221253c524 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:54.578344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587897bb-b658-43d8-a0ba-78221253c524 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:54.583792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 294/571] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:54.584614 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587897bb-b658-43d8-a0ba-78221253c524 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:54.613059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 278/572] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:41:54.614704 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ce43b-661e-4bf7-98b6-704f6e28edc2 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:54.615237 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ce43b-661e-4bf7-98b6-704f6e28edc2 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:54.615722 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ce43b-661e-4bf7-98b6-704f6e28edc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:54.632725 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f04ce43b-661e-4bf7-98b6-704f6e28edc2 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:54.633902 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f04ce43b-661e-4bf7-98b6-704f6e28edc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:54.687450 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587897bb-b658-43d8-a0ba-78221253c524 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:54.707135 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 279/573] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:54.707135 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ce43b-661e-4bf7-98b6-704f6e28edc2 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:54.725630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e91ae-430c-4b01-a28e-21b911dc7bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:54.726497 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e91ae-430c-4b01-a28e-21b911dc7bbf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:54.726914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e91ae-430c-4b01-a28e-21b911dc7bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:54.727216 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e91ae-430c-4b01-a28e-21b911dc7bbf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:54.734319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e91ae-430c-4b01-a28e-21b911dc7bbf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:54.735833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e91ae-430c-4b01-a28e-21b911dc7bbf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:54.749962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-9a7e91ae-430c-4b01-a28e-21b911dc7bbf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 06:41:54.749962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:54.749962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:54.749962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:54.749962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:54.749962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:54.749962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:54.749962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:54.749962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:54.749962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:54.749962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:54.749962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:54.749962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:41:54.749962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:41:54.749962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:41:54.749962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:41:54.751466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:54.751466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:54.751466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:41:54.751466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:41:54.751466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:41:54.751466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:41:54.751466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:54.751466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:54.751466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:54.751466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:54.751466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:54.751466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:54.751466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:54.751466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:54.751466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:54.751466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:54.751466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:54.751466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:54.752449 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:54.752449 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:54.752449 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:41:54.752449 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:41:54.752449 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:41:54.752449 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:41:54.752449 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:41:54.752449 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:41:54.752449 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 06:41:54.752449 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:54.752449 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 295/574] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:54.752449 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e91ae-430c-4b01-a28e-21b911dc7bbf None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:54.814592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ce43b-661e-4bf7-98b6-704f6e28edc2 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:54.849031 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b2030-69a6-4f82-90cd-bf76cca48db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:54.849757 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b2030-69a6-4f82-90cd-bf76cca48db3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:54.850044 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b2030-69a6-4f82-90cd-bf76cca48db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:54.850299 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b2030-69a6-4f82-90cd-bf76cca48db3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:54.854923 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e91ae-430c-4b01-a28e-21b911dc7bbf None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:54.860089 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b2030-69a6-4f82-90cd-bf76cca48db3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:54.867823 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-333b2030-69a6-4f82-90cd-bf76cca48db3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:54.867823 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:54.867823 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:54.867823 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:54.867823 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:54.867823 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:54.867823 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:54.867823 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:54.867823 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:54.867823 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:54.867823 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:54.867823 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:54.867823 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:54.867823 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:54.867823 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:54.867823 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:54.868938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:54.868938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:54.868938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:54.868938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:54.868938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:54.868938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:54.868938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:54.868938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:54.868938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:54.868938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:54.868938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:54.868938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:54.868938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:54.868938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:54.868938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:54.868938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:54.870049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:54.870049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:54.870049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:54.870049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:54.870049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:54.870049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:54.870049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:54.870049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:54.870049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:54.870049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:54.870049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:54.870049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:54.873838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 280/575] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:41:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:54.874676 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b2030-69a6-4f82-90cd-bf76cca48db3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:54.893008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6de3d-4b5b-4508-819c-7f22463b1439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:54.893953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6de3d-4b5b-4508-819c-7f22463b1439 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:54.894316 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6de3d-4b5b-4508-819c-7f22463b1439 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:54.894597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6de3d-4b5b-4508-819c-7f22463b1439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:54.904844 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6de3d-4b5b-4508-819c-7f22463b1439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:54.906300 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6de3d-4b5b-4508-819c-7f22463b1439 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:54.923879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-8fe6de3d-4b5b-4508-819c-7f22463b1439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:54.923879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:54.923879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:54.923879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:54.923879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:54.923879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:54.923879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:54.923879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:54.923879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:54.923879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:54.923879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:54.923879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:54.923879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:54.923879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:54.923879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:54.924818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:54.924818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:54.924818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:54.924818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:54.924818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:54.924818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:54.924818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:54.924818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:54.924818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:54.924818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:54.924818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:54.924818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:54.924818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:54.924818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:54.924818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:54.924818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:54.924818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:54.925727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:54.925727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:54.925727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:54.925727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:54.927278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 296/576] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:54.928611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6de3d-4b5b-4508-819c-7f22463b1439 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:54.970820 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b2030-69a6-4f82-90cd-bf76cca48db3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:55.003011 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69eb05b-6969-4591-b669-337305d2f59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:55.004076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69eb05b-6969-4591-b669-337305d2f59d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:55.004351 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69eb05b-6969-4591-b669-337305d2f59d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:55.004621 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69eb05b-6969-4591-b669-337305d2f59d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:55.014783 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69eb05b-6969-4591-b669-337305d2f59d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:55.022767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-e69eb05b-6969-4591-b669-337305d2f59d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:55.022767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:55.022767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:55.022767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:55.022767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:55.022767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:55.022767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:55.022767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:55.022767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:55.022767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:55.022767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:55.022767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:55.022767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:55.022767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:55.022767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:55.022767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:55.023716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:55.023716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:55.023716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:55.023716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:55.023716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:55.023716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:55.023716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:55.023716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:55.023716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:55.023716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:55.023716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:55.023716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:55.023716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:55.023716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:55.023716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:55.023716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:55.024562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:55.024562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:55.024562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:55.024562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:55.024562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:55.024562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:55.024562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:55.024562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:55.024562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:55.024562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:55.024562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:55.024562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:55.024562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 281/577] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:41:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:55.025264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69eb05b-6969-4591-b669-337305d2f59d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:55.031693 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6de3d-4b5b-4508-819c-7f22463b1439 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:55.064458 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605f2ca-587c-4e18-ae86-b79debc95ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:55.065144 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605f2ca-587c-4e18-ae86-b79debc95ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:55.065416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605f2ca-587c-4e18-ae86-b79debc95ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:55.065678 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605f2ca-587c-4e18-ae86-b79debc95ad9 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:55.066512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605f2ca-587c-4e18-ae86-b79debc95ad9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:55.066802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605f2ca-587c-4e18-ae86-b79debc95ad9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:55.068329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605f2ca-587c-4e18-ae86-b79debc95ad9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:55.089634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 297/578] 10.222.0.77 () {56 vars in 1137 bytes} [Wed May 11 06:41:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:55.089634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605f2ca-587c-4e18-ae86-b79debc95ad9 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:55.120625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69eb05b-6969-4591-b669-337305d2f59d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:55.152541 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3badeb-452e-4f43-b523-4d40be8a7d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:55.153578 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3badeb-452e-4f43-b523-4d40be8a7d73 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:55.154075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3badeb-452e-4f43-b523-4d40be8a7d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:55.154585 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3badeb-452e-4f43-b523-4d40be8a7d73 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:55.155437 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3badeb-452e-4f43-b523-4d40be8a7d73 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:55.155748 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3badeb-452e-4f43-b523-4d40be8a7d73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:55.157124 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3badeb-452e-4f43-b523-4d40be8a7d73 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:55.169574 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 282/579] 10.222.0.77 () {56 vars in 1103 bytes} [Wed May 11 06:41:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:55.169574 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3badeb-452e-4f43-b523-4d40be8a7d73 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:55.190760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605f2ca-587c-4e18-ae86-b79debc95ad9 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:55.223704 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7b518-536e-4a8f-99b6-ec4737e9c601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:55.224466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7b518-536e-4a8f-99b6-ec4737e9c601 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:55.224743 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7b518-536e-4a8f-99b6-ec4737e9c601 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:55.225012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7b518-536e-4a8f-99b6-ec4737e9c601 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:55.225730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7b518-536e-4a8f-99b6-ec4737e9c601 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:55.226273 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7b518-536e-4a8f-99b6-ec4737e9c601 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:55.227426 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7b518-536e-4a8f-99b6-ec4737e9c601 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:55.242764 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 298/580] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:55.242764 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7b518-536e-4a8f-99b6-ec4737e9c601 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:55.264176 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3badeb-452e-4f43-b523-4d40be8a7d73 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:55.301142 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc54dc-4883-4bc9-b3ad-5a4ea52e3ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:55.301819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc54dc-4883-4bc9-b3ad-5a4ea52e3ecd None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:55.302106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc54dc-4883-4bc9-b3ad-5a4ea52e3ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:55.302385 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc54dc-4883-4bc9-b3ad-5a4ea52e3ecd None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:55.303181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc54dc-4883-4bc9-b3ad-5a4ea52e3ecd None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:55.303492 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc54dc-4883-4bc9-b3ad-5a4ea52e3ecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:55.304862 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc54dc-4883-4bc9-b3ad-5a4ea52e3ecd None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:55.317288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 283/581] 10.222.0.77 () {56 vars in 1103 bytes} [Wed May 11 06:41:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:55.317288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc54dc-4883-4bc9-b3ad-5a4ea52e3ecd None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:55.342111 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7b518-536e-4a8f-99b6-ec4737e9c601 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:55.373600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463501be-5f04-4770-944b-9ba7aa8443cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:55.374342 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463501be-5f04-4770-944b-9ba7aa8443cf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:55.374623 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463501be-5f04-4770-944b-9ba7aa8443cf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:55.374895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463501be-5f04-4770-944b-9ba7aa8443cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:55.385276 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463501be-5f04-4770-944b-9ba7aa8443cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:55.386748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463501be-5f04-4770-944b-9ba7aa8443cf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:55.403749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-463501be-5f04-4770-944b-9ba7aa8443cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:55.403749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:55.403749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:55.403749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:55.403749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:55.403749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:55.403749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:55.403749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:55.403749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:55.403749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:55.403749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:55.403749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:55.403749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:55.403749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:55.403749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:55.404669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:55.404669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:55.404669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:55.404669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:55.404669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:55.404669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:55.404669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:55.404669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:55.404669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:55.404669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:55.404669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:55.404669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:55.404669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:55.404669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:55.404669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:55.404669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:55.404669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:55.405549 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:55.405549 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:55.405549 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:55.405549 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:55.407264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 299/582] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:55.408379 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463501be-5f04-4770-944b-9ba7aa8443cf None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:55.411820 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc54dc-4883-4bc9-b3ad-5a4ea52e3ecd None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:55.448150 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b54c93-0f45-4126-9eac-1ab4b192f666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:55.448947 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b54c93-0f45-4126-9eac-1ab4b192f666 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:55.449231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b54c93-0f45-4126-9eac-1ab4b192f666 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:55.449507 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b54c93-0f45-4126-9eac-1ab4b192f666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:55.461554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b54c93-0f45-4126-9eac-1ab4b192f666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:55.463099 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b54c93-0f45-4126-9eac-1ab4b192f666 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:55.481141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-b2b54c93-0f45-4126-9eac-1ab4b192f666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:55.481141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:55.481141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:55.481141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:55.481141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:55.481141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:55.481141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:55.481141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:55.481141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:55.481141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:55.481141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:55.481141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:55.481141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:55.481141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:55.481141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:55.482111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:55.482111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:55.482111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:55.482111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:55.482111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:55.482111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:55.482111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:55.482111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:55.482111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:55.482111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:55.482111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:55.482111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:55.482111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:55.482111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:55.482111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:55.482111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:55.482111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:55.483483 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:55.483483 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:55.483483 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:55.483483 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:55.483483 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 284/583] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:55.483483 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b54c93-0f45-4126-9eac-1ab4b192f666 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:55.517802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463501be-5f04-4770-944b-9ba7aa8443cf None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:55.550385 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daef01-8cbe-4373-803d-e635deb1e6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:55.551220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daef01-8cbe-4373-803d-e635deb1e6fe None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:55.551499 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daef01-8cbe-4373-803d-e635deb1e6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:55.551769 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daef01-8cbe-4373-803d-e635deb1e6fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:55.558529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daef01-8cbe-4373-803d-e635deb1e6fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:55.560012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daef01-8cbe-4373-803d-e635deb1e6fe None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:55.574680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-30daef01-8cbe-4373-803d-e635deb1e6fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:41:55.574680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:55.574680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:55.574680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:55.574680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:55.574680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:55.574680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:55.574680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:55.574680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:55.574680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:55.574680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:55.574680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:55.574680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:41:55.574680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:41:55.574680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:41:55.575806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:41:55.575806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:55.575806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:55.575806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:55.575806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:55.575806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:55.575806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:55.575806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:55.575806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:55.575806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:55.575806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:55.575806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:55.575806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:55.575806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:55.575806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:55.575806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:55.575806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:55.576721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:41:55.576721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:41:55.576721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:41:55.576721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:41:55.576721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:41:55.576721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:41:55.576721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:41:55.576721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:55.576721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 300/584] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:41:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:55.576721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daef01-8cbe-4373-803d-e635deb1e6fe None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:55.587735 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b54c93-0f45-4126-9eac-1ab4b192f666 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:55.620984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4ed92-dc10-44b6-bb45-9b3e8f631a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:55.621779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4ed92-dc10-44b6-bb45-9b3e8f631a8c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:55.622056 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4ed92-dc10-44b6-bb45-9b3e8f631a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:55.622338 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4ed92-dc10-44b6-bb45-9b3e8f631a8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:55.632713 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4ed92-dc10-44b6-bb45-9b3e8f631a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:55.634095 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4ed92-dc10-44b6-bb45-9b3e8f631a8c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:55.650411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-9df4ed92-dc10-44b6-bb45-9b3e8f631a8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:55.650411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:55.650411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:55.650411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:55.650411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:55.650411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:55.650411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:55.650411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:55.650411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:55.650411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:55.650411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:55.650411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:55.650411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:55.650411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:55.650411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:55.651404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:55.651404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:55.651404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:55.651404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:55.651404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:55.651404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:55.651404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:55.651404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:55.651404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:55.651404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:55.651404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:55.651404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:55.651404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:55.651404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:55.651404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:55.651404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:55.651404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:55.652565 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:55.652565 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:55.652565 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:55.652565 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:55.652565 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 285/585] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:55.656815 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4ed92-dc10-44b6-bb45-9b3e8f631a8c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:55.681992 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daef01-8cbe-4373-803d-e635deb1e6fe None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:55.714504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767c10b-3f91-43cd-80be-209bbdacd0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:55.715199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767c10b-3f91-43cd-80be-209bbdacd0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:55.715478 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767c10b-3f91-43cd-80be-209bbdacd0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:55.715746 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767c10b-3f91-43cd-80be-209bbdacd0d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:55.716460 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767c10b-3f91-43cd-80be-209bbdacd0d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:55.716760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767c10b-3f91-43cd-80be-209bbdacd0d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:55.718134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767c10b-3f91-43cd-80be-209bbdacd0d1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:55.733332 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 301/586] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:55.733332 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767c10b-3f91-43cd-80be-209bbdacd0d1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:55.759930 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4ed92-dc10-44b6-bb45-9b3e8f631a8c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:55.795580 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cbd24-1998-4abf-b27f-b0c8f882204b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:55.796227 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cbd24-1998-4abf-b27f-b0c8f882204b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:55.796506 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cbd24-1998-4abf-b27f-b0c8f882204b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:55.796776 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cbd24-1998-4abf-b27f-b0c8f882204b None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:55.797498 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cbd24-1998-4abf-b27f-b0c8f882204b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:55.797828 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cbd24-1998-4abf-b27f-b0c8f882204b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:55.799185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cbd24-1998-4abf-b27f-b0c8f882204b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:55.810475 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 286/587] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:55.814878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cbd24-1998-4abf-b27f-b0c8f882204b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:55.834040 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767c10b-3f91-43cd-80be-209bbdacd0d1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:55.869597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe7bce-cbc9-4892-b391-1dcff58e6f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:55.870430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe7bce-cbc9-4892-b391-1dcff58e6f16 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:55.870719 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe7bce-cbc9-4892-b391-1dcff58e6f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:55.871331 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe7bce-cbc9-4892-b391-1dcff58e6f16 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:55.872403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe7bce-cbc9-4892-b391-1dcff58e6f16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:55.872720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe7bce-cbc9-4892-b391-1dcff58e6f16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:55.874473 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe7bce-cbc9-4892-b391-1dcff58e6f16 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:55.891746 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 302/588] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:41:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:55.891746 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe7bce-cbc9-4892-b391-1dcff58e6f16 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:55.911314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cbd24-1998-4abf-b27f-b0c8f882204b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:55.945438 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac760aab-150d-40ac-9f2f-7e28d34c8f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:55.946465 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac760aab-150d-40ac-9f2f-7e28d34c8f04 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:55.946719 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac760aab-150d-40ac-9f2f-7e28d34c8f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:55.947003 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac760aab-150d-40ac-9f2f-7e28d34c8f04 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:55.947898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac760aab-150d-40ac-9f2f-7e28d34c8f04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:55.948201 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac760aab-150d-40ac-9f2f-7e28d34c8f04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:55.949563 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac760aab-150d-40ac-9f2f-7e28d34c8f04 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:55.960676 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 287/589] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:55.961479 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac760aab-150d-40ac-9f2f-7e28d34c8f04 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:55.984321 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe7bce-cbc9-4892-b391-1dcff58e6f16 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:56.018348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc1a84-4737-46e3-87ff-d5431c6fd9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:56.019584 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc1a84-4737-46e3-87ff-d5431c6fd9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:56.019920 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc1a84-4737-46e3-87ff-d5431c6fd9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:56.020253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc1a84-4737-46e3-87ff-d5431c6fd9c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:56.026833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc1a84-4737-46e3-87ff-d5431c6fd9c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:56.028338 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc1a84-4737-46e3-87ff-d5431c6fd9c7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:56.042008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-fafc1a84-4737-46e3-87ff-d5431c6fd9c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:41:56.042008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:56.042008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:56.042008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:56.042008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:56.042008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:56.042008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:56.042008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:56.042008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:56.042008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:56.042008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:56.042008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:56.042008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:41:56.042008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:41:56.042008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:41:56.042949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:41:56.042949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:56.042949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:56.042949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:56.042949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:56.042949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:56.042949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:56.042949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:56.042949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:56.042949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:56.042949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:56.042949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:56.042949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:56.042949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:56.042949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:56.042949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:56.042949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:56.044460 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:41:56.044460 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:41:56.044460 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:41:56.044460 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:41:56.044460 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:41:56.044460 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:41:56.044460 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:41:56.044460 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:56.047986 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 303/590] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:41:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:56.048569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc1a84-4737-46e3-87ff-d5431c6fd9c7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:56.054037 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac760aab-150d-40ac-9f2f-7e28d34c8f04 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:56.087808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae8686-a00f-4dc8-9e4c-a30f7c1d2caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:56.089289 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae8686-a00f-4dc8-9e4c-a30f7c1d2caf None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:56.090067 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae8686-a00f-4dc8-9e4c-a30f7c1d2caf None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:56.090805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae8686-a00f-4dc8-9e4c-a30f7c1d2caf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:56.100960 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae8686-a00f-4dc8-9e4c-a30f7c1d2caf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:56.103531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae8686-a00f-4dc8-9e4c-a30f7c1d2caf None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:56.118937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-d8ae8686-a00f-4dc8-9e4c-a30f7c1d2caf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 06:41:56.118937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:56.118937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:56.118937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:56.118937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:56.118937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:56.118937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:56.118937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:56.118937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:56.118937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:56.118937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:56.118937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:56.118937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:41:56.118937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:41:56.118937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:41:56.118937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:41:56.120112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:56.120112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:56.120112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:41:56.120112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:41:56.120112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:41:56.120112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:41:56.120112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:56.120112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:56.120112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:56.120112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:56.120112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:56.120112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:56.120112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:56.120112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:56.120112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:56.120112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:56.120112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:56.120112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:56.121265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:56.121265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:56.121265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:41:56.121265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:41:56.121265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:41:56.121265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:41:56.121265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:41:56.121265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:41:56.121265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 06:41:56.121265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:56.126850 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 288/591] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:41:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:56.126850 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae8686-a00f-4dc8-9e4c-a30f7c1d2caf None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:56.145878 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc1a84-4737-46e3-87ff-d5431c6fd9c7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:56.177995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d24eec-694e-47ec-814b-c0a800cdb5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:56.178419 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d24eec-694e-47ec-814b-c0a800cdb5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:56.178770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d24eec-694e-47ec-814b-c0a800cdb5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:56.179161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d24eec-694e-47ec-814b-c0a800cdb5c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:56.180001 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d24eec-694e-47ec-814b-c0a800cdb5c4 None admin] RBAC: Adding query filter params (role.id=46d109e3a1bd4f13b0d145cde46c75a9, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=f726f58d30734be7abf15400bff89533) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:56.180315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d24eec-694e-47ec-814b-c0a800cdb5c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:56.181759 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d24eec-694e-47ec-814b-c0a800cdb5c4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:56.187467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 304/592] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:41:56 2022] GET /identity/v3/role_assignments?user.id=f726f58d30734be7abf15400bff89533&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=46d109e3a1bd4f13b0d145cde46c75a9 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:56.188471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d24eec-694e-47ec-814b-c0a800cdb5c4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:56.249452 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae8686-a00f-4dc8-9e4c-a30f7c1d2caf None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:56.301372 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d24eec-694e-47ec-814b-c0a800cdb5c4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:56.303717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40af710-653b-4946-a3f9-186e5ffa8c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:56.305628 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40af710-653b-4946-a3f9-186e5ffa8c59 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:56.306069 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40af710-653b-4946-a3f9-186e5ffa8c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:56.306509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40af710-653b-4946-a3f9-186e5ffa8c59 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:56.317351 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40af710-653b-4946-a3f9-186e5ffa8c59 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:56.319462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40af710-653b-4946-a3f9-186e5ffa8c59 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:56.339977 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc5b22-2753-472e-b83d-5fe15d2084c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:56.340608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-b40af710-653b-4946-a3f9-186e5ffa8c59 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 06:41:56.340608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:56.340608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:56.340608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:56.340608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:56.340608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:56.340608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:56.340608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:56.340608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:56.340608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:56.340608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:56.340608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:56.340608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:41:56.340608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:41:56.340608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:41:56.340608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:41:56.341733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:56.341733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:56.341733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:41:56.341733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:41:56.341733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:41:56.341733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:41:56.341733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:56.341733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:56.341733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:56.341733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:56.341733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:56.341733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:56.341733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:56.341733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:56.341733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:56.341733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:56.341733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:56.341733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:56.342999 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:56.342999 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:56.342999 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:41:56.342999 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:41:56.342999 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:41:56.342999 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:41:56.342999 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:41:56.342999 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:41:56.342999 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 06:41:56.342999 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:56.343653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc5b22-2753-472e-b83d-5fe15d2084c4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:56.343935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc5b22-2753-472e-b83d-5fe15d2084c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:56.344316 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc5b22-2753-472e-b83d-5fe15d2084c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:56.345262 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc5b22-2753-472e-b83d-5fe15d2084c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:56.350575 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc5b22-2753-472e-b83d-5fe15d2084c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:56.350575 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc5b22-2753-472e-b83d-5fe15d2084c4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:56.351257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 289/593] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:41:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:56.352935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40af710-653b-4946-a3f9-186e5ffa8c59 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:56.368945 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 305/594] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:41:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:56.370115 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc5b22-2753-472e-b83d-5fe15d2084c4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:56.457458 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40af710-653b-4946-a3f9-186e5ffa8c59 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:56.469390 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc5b22-2753-472e-b83d-5fe15d2084c4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:56.493127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b05af-c95c-43ac-adfe-3a0f9576ea8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:56.493976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b05af-c95c-43ac-adfe-3a0f9576ea8a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:56.494346 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b05af-c95c-43ac-adfe-3a0f9576ea8a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:56.494707 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b05af-c95c-43ac-adfe-3a0f9576ea8a None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:56.495867 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b05af-c95c-43ac-adfe-3a0f9576ea8a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:56.496285 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b05af-c95c-43ac-adfe-3a0f9576ea8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:56.497894 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b05af-c95c-43ac-adfe-3a0f9576ea8a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:56.506607 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31786b41-d5eb-4afd-bdfc-3116adfc514a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:56.507673 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31786b41-d5eb-4afd-bdfc-3116adfc514a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:56.508116 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31786b41-d5eb-4afd-bdfc-3116adfc514a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:56.508522 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31786b41-d5eb-4afd-bdfc-3116adfc514a None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:56.509496 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31786b41-d5eb-4afd-bdfc-3116adfc514a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:56.509962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31786b41-d5eb-4afd-bdfc-3116adfc514a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:56.511653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31786b41-d5eb-4afd-bdfc-3116adfc514a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:56.521577 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 290/595] 10.222.0.77 () {56 vars in 1139 bytes} [Wed May 11 06:41:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:56.522471 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b05af-c95c-43ac-adfe-3a0f9576ea8a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:56.529910 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 306/596] 10.222.0.77 () {56 vars in 1137 bytes} [Wed May 11 06:41:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:56.531472 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1abcc-6485-4c6a-b2ee-ced41c5b4ea6 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:56.531902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1abcc-6485-4c6a-b2ee-ced41c5b4ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:56.532310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1abcc-6485-4c6a-b2ee-ced41c5b4ea6 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:56.533691 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 307/597] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:56.534747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1abcc-6485-4c6a-b2ee-ced41c5b4ea6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:56.618937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b05af-c95c-43ac-adfe-3a0f9576ea8a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:56.635493 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1abcc-6485-4c6a-b2ee-ced41c5b4ea6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:56.651244 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a75f3-9525-4049-9037-3ec91a8f62ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:56.653364 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a75f3-9525-4049-9037-3ec91a8f62ce None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:56.654452 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a75f3-9525-4049-9037-3ec91a8f62ce None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:56.654825 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a75f3-9525-4049-9037-3ec91a8f62ce None admin] PATH_INFO: `/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/628e4779afa24fb187c4b10a3765af9a/roles/46d109e3a1bd4f13b0d145cde46c75a9` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:56.669001 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a75f3-9525-4049-9037-3ec91a8f62ce None admin] RBAC: Authorizing `identity:create_grant(project_id=0f573a9de6904664ace6287072a8a7dc, user_id=628e4779afa24fb187c4b10a3765af9a, role_id=46d109e3a1bd4f13b0d145cde46c75a9)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:56.670322 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab0a6a-aa0b-4900-b38d-519094770ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:56.670678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a75f3-9525-4049-9037-3ec91a8f62ce None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:56.671161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab0a6a-aa0b-4900-b38d-519094770ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:56.671439 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab0a6a-aa0b-4900-b38d-519094770ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:56.671710 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab0a6a-aa0b-4900-b38d-519094770ad9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:56.682328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab0a6a-aa0b-4900-b38d-519094770ad9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:56.684125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab0a6a-aa0b-4900-b38d-519094770ad9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:56.695221 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 291/598] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:41:56 2022] PUT /identity/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/628e4779afa24fb187c4b10a3765af9a/roles/46d109e3a1bd4f13b0d145cde46c75a9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:56.695221 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c9aab-b6b0-490f-960d-01c9716985e4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:56.695221 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c9aab-b6b0-490f-960d-01c9716985e4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:56.695221 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c9aab-b6b0-490f-960d-01c9716985e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:56.715035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-08ab0a6a-aa0b-4900-b38d-519094770ad9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:56.715035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:56.715035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:56.715035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:56.715035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:56.715035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:56.715035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:56.715035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:56.715035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:56.715035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:56.715035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:56.715035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:56.715035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:56.715035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:56.715035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:56.716150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:56.716150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:56.716150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:56.716150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:56.716150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:56.716150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:56.716150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:56.716150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:56.716150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:56.716150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:56.716150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:56.716150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:56.716150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:56.716150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:56.716150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:56.716150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:56.716150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:56.717244 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:56.717244 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:56.717244 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:56.717244 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:56.717244 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 308/599] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:56.717589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab0a6a-aa0b-4900-b38d-519094770ad9 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:56.719566 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fc9c9aab-b6b0-490f-960d-01c9716985e4 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:56.722306 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fc9c9aab-b6b0-490f-960d-01c9716985e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:56.820151 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 292/600] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:56.821510 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c9aab-b6b0-490f-960d-01c9716985e4 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:56.858892 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab0a6a-aa0b-4900-b38d-519094770ad9 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:56.895533 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a4e93-17a9-4a92-ba22-51e2723c4faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:56.896399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a4e93-17a9-4a92-ba22-51e2723c4faf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:56.896680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a4e93-17a9-4a92-ba22-51e2723c4faf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:56.896956 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a4e93-17a9-4a92-ba22-51e2723c4faf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:56.908054 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a4e93-17a9-4a92-ba22-51e2723c4faf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:56.909518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a4e93-17a9-4a92-ba22-51e2723c4faf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:56.927278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-1a0a4e93-17a9-4a92-ba22-51e2723c4faf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:56.927278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:56.927278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:56.927278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:56.927278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:56.927278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:56.927278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:56.927278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:56.927278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:56.927278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:56.927278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:56.927278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:56.927278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:56.927278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:56.927278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:56.928399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:56.928399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:56.928399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:56.928399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:56.928399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:56.928399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:56.928399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:56.928399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:56.928399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:56.928399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:56.928399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:56.928399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:56.928399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:56.928399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:56.928399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:56.928399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:56.928399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:56.929490 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:56.929490 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:56.929490 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:56.929490 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:56.929490 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 309/601] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:56.929825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a4e93-17a9-4a92-ba22-51e2723c4faf None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:56.944534 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c9aab-b6b0-490f-960d-01c9716985e4 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:56.980282 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc35e96-7833-48f5-9269-24ca94e19d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:56.980874 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc35e96-7833-48f5-9269-24ca94e19d7a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:56.981156 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc35e96-7833-48f5-9269-24ca94e19d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:56.981433 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc35e96-7833-48f5-9269-24ca94e19d7a None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:56.982170 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc35e96-7833-48f5-9269-24ca94e19d7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:56.982475 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc35e96-7833-48f5-9269-24ca94e19d7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:56.983903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc35e96-7833-48f5-9269-24ca94e19d7a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:56.995888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 293/602] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:56.996855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc35e96-7833-48f5-9269-24ca94e19d7a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:57.030497 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a4e93-17a9-4a92-ba22-51e2723c4faf None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:57.064658 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628e60d-5297-40f5-ba12-c1b06c6a442f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:57.065628 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628e60d-5297-40f5-ba12-c1b06c6a442f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:57.066013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628e60d-5297-40f5-ba12-c1b06c6a442f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:57.066386 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628e60d-5297-40f5-ba12-c1b06c6a442f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:57.077290 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628e60d-5297-40f5-ba12-c1b06c6a442f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:57.085414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b628e60d-5297-40f5-ba12-c1b06c6a442f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:57.085414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:57.085414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:57.085414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:57.085414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:57.085414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:57.085414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:57.085414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:57.085414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:57.085414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:57.085414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:57.085414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:57.085414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:57.085414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:57.085414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:57.085414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:57.086512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:57.086512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:57.086512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:57.086512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:57.086512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:57.086512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:57.086512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:57.086512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:57.086512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:57.086512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:57.086512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:57.086512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:57.086512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:57.086512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:57.086512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:57.086512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:57.087692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:57.087692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:57.087692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:57.087692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:57.087692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:57.087692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:57.087692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:57.087692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:57.087692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:57.087692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:57.087692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:57.087692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:57.094189 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc35e96-7833-48f5-9269-24ca94e19d7a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:57.094389 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 310/603] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:41:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:57.095522 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628e60d-5297-40f5-ba12-c1b06c6a442f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:57.128237 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ce86d-b885-4ea5-a994-20977fc78e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:57.128916 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ce86d-b885-4ea5-a994-20977fc78e76 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:57.129198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ce86d-b885-4ea5-a994-20977fc78e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:57.129480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ce86d-b885-4ea5-a994-20977fc78e76 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:57.131202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ce86d-b885-4ea5-a994-20977fc78e76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:57.131519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ce86d-b885-4ea5-a994-20977fc78e76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:57.132900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ce86d-b885-4ea5-a994-20977fc78e76 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:57.147540 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 294/604] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:57.148380 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ce86d-b885-4ea5-a994-20977fc78e76 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:57.199129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628e60d-5297-40f5-ba12-c1b06c6a442f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:57.232630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1790d4-3dad-40fd-85c8-1628aeb2c5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:57.233512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1790d4-3dad-40fd-85c8-1628aeb2c5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:57.233905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1790d4-3dad-40fd-85c8-1628aeb2c5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:57.234287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1790d4-3dad-40fd-85c8-1628aeb2c5c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:57.241313 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1790d4-3dad-40fd-85c8-1628aeb2c5c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:57.243074 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1790d4-3dad-40fd-85c8-1628aeb2c5c8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:57.257635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-dc1790d4-3dad-40fd-85c8-1628aeb2c5c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:41:57.257635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:57.257635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:57.257635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:57.257635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:57.257635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:57.257635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:57.257635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:57.257635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:57.257635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:57.257635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:57.257635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:57.257635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:41:57.257635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:41:57.257635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:41:57.258975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:41:57.258975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:57.258975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:57.258975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:57.258975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:57.258975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:57.258975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:57.258975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:57.258975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:57.258975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:57.258975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:57.258975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:57.258975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:57.258975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:57.258975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:57.258975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:57.258975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:57.260203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:41:57.260203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:41:57.260203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:41:57.260203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:41:57.260203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:41:57.260203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:41:57.260203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:41:57.260203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:57.262458 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ce86d-b885-4ea5-a994-20977fc78e76 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:57.262586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 311/605] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:41:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:57.264440 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1790d4-3dad-40fd-85c8-1628aeb2c5c8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:57.305921 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c28bb5-9626-47f4-a42f-739cf70a7b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:57.306608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c28bb5-9626-47f4-a42f-739cf70a7b71 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:57.306893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c28bb5-9626-47f4-a42f-739cf70a7b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:57.307333 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c28bb5-9626-47f4-a42f-739cf70a7b71 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:57.308900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c28bb5-9626-47f4-a42f-739cf70a7b71 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:57.309221 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c28bb5-9626-47f4-a42f-739cf70a7b71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:57.310604 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c28bb5-9626-47f4-a42f-739cf70a7b71 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:57.321965 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 295/606] 10.222.0.77 () {56 vars in 1103 bytes} [Wed May 11 06:41:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:57.322983 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c28bb5-9626-47f4-a42f-739cf70a7b71 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:57.380373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1790d4-3dad-40fd-85c8-1628aeb2c5c8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:57.417056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d4018-92fe-473e-95ca-347dfe4993e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:57.418538 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d4018-92fe-473e-95ca-347dfe4993e4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:57.418818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d4018-92fe-473e-95ca-347dfe4993e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:57.419136 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d4018-92fe-473e-95ca-347dfe4993e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:57.426404 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d4018-92fe-473e-95ca-347dfe4993e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:57.427929 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d4018-92fe-473e-95ca-347dfe4993e4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:57.431395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c28bb5-9626-47f4-a42f-739cf70a7b71 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:57.441504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b86d4018-92fe-473e-95ca-347dfe4993e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:41:57.441504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:57.441504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:57.441504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:57.441504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:57.441504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:57.441504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:57.441504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:57.441504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:57.441504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:57.441504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:57.441504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:57.441504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:41:57.441504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:41:57.441504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:41:57.445189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:41:57.445189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:57.445189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:57.445189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:57.445189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:57.445189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:57.445189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:57.445189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:57.445189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:57.445189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:57.445189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:57.445189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:57.445189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:57.445189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:57.445189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:57.445189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:57.445189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:57.449376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:41:57.449376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:41:57.449376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:41:57.449376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:41:57.449376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:41:57.449376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:41:57.449376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:41:57.449376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:57.449376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 312/607] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:41:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:57.449376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d4018-92fe-473e-95ca-347dfe4993e4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:57.465744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b13407-48ed-4485-b2f9-dd56302da8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:57.466573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b13407-48ed-4485-b2f9-dd56302da8ac None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:57.466859 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b13407-48ed-4485-b2f9-dd56302da8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:57.467501 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b13407-48ed-4485-b2f9-dd56302da8ac None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:57.468313 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b13407-48ed-4485-b2f9-dd56302da8ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:57.468626 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b13407-48ed-4485-b2f9-dd56302da8ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:57.470485 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b13407-48ed-4485-b2f9-dd56302da8ac None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:57.486856 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 296/608] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:41:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:57.487908 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b13407-48ed-4485-b2f9-dd56302da8ac None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:57.560409 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d4018-92fe-473e-95ca-347dfe4993e4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:57.589373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b13407-48ed-4485-b2f9-dd56302da8ac None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:57.594848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b6e07-f6c4-462b-a486-513bb533d69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:57.595797 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b6e07-f6c4-462b-a486-513bb533d69d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:57.596139 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b6e07-f6c4-462b-a486-513bb533d69d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:57.596476 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b6e07-f6c4-462b-a486-513bb533d69d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:57.611077 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b6e07-f6c4-462b-a486-513bb533d69d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:57.613333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b6e07-f6c4-462b-a486-513bb533d69d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:57.623258 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ff06d-d5b6-48bf-b758-c0c95b680d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:57.624278 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ff06d-d5b6-48bf-b758-c0c95b680d40 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:57.624627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ff06d-d5b6-48bf-b758-c0c95b680d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:57.624969 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ff06d-d5b6-48bf-b758-c0c95b680d40 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:57.625841 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ff06d-d5b6-48bf-b758-c0c95b680d40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:57.626221 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ff06d-d5b6-48bf-b758-c0c95b680d40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:57.627802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ff06d-d5b6-48bf-b758-c0c95b680d40 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:57.632330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-856b6e07-f6c4-462b-a486-513bb533d69d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:57.632330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:57.632330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:57.632330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:57.632330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:57.632330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:57.632330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:57.632330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:57.632330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:57.632330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:57.632330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:57.632330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:57.632330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:57.632330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:57.632330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:57.634252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:57.634252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:57.634252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:57.634252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:57.634252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:57.634252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:57.634252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:57.634252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:57.634252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:57.634252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:57.634252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:57.634252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:57.634252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:57.634252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:57.634252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:57.634252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:57.634252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:57.636307 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:57.636307 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:57.636307 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:57.636307 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:57.636307 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 313/609] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:57.636307 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b6e07-f6c4-462b-a486-513bb533d69d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:57.642196 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 297/610] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:41:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:57.643211 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ff06d-d5b6-48bf-b758-c0c95b680d40 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:57.745318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b6e07-f6c4-462b-a486-513bb533d69d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:57.759390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ff06d-d5b6-48bf-b758-c0c95b680d40 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:57.784144 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdd06c-e6a6-4a4e-b478-23cf8ef3bcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:57.785217 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdd06c-e6a6-4a4e-b478-23cf8ef3bcf1 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:57.785496 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdd06c-e6a6-4a4e-b478-23cf8ef3bcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:57.786063 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdd06c-e6a6-4a4e-b478-23cf8ef3bcf1 None admin] PATH_INFO: `/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/3c92f4b777a644ad8055f15b1a8bd0be/roles/46d109e3a1bd4f13b0d145cde46c75a9` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:57.797458 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768fc040-fa96-4252-ba5d-4c3fcdfc4e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:57.798299 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fc040-fa96-4252-ba5d-4c3fcdfc4e56 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:57.798586 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fc040-fa96-4252-ba5d-4c3fcdfc4e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:57.799067 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fc040-fa96-4252-ba5d-4c3fcdfc4e56 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:57.800126 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768fc040-fa96-4252-ba5d-4c3fcdfc4e56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:57.800681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768fc040-fa96-4252-ba5d-4c3fcdfc4e56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:57.802162 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768fc040-fa96-4252-ba5d-4c3fcdfc4e56 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:57.802513 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fdd06c-e6a6-4a4e-b478-23cf8ef3bcf1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f573a9de6904664ace6287072a8a7dc, user_id=3c92f4b777a644ad8055f15b1a8bd0be, role_id=46d109e3a1bd4f13b0d145cde46c75a9)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:57.804590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fdd06c-e6a6-4a4e-b478-23cf8ef3bcf1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:57.815822 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 298/611] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:57.816820 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768fc040-fa96-4252-ba5d-4c3fcdfc4e56 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:57.823442 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 314/612] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:41:57 2022] PUT /identity/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/3c92f4b777a644ad8055f15b1a8bd0be/roles/46d109e3a1bd4f13b0d145cde46c75a9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:57.827913 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdd06c-e6a6-4a4e-b478-23cf8ef3bcf1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:57.992029 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdd06c-e6a6-4a4e-b478-23cf8ef3bcf1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:58.008674 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768fc040-fa96-4252-ba5d-4c3fcdfc4e56 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:58.028381 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78d92b-13de-42d0-a971-a526be7691c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:58.029219 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78d92b-13de-42d0-a971-a526be7691c3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:58.029504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78d92b-13de-42d0-a971-a526be7691c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:58.029781 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78d92b-13de-42d0-a971-a526be7691c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:58.038114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78d92b-13de-42d0-a971-a526be7691c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:58.039653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78d92b-13de-42d0-a971-a526be7691c3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:58.055373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-2d78d92b-13de-42d0-a971-a526be7691c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 06:41:58.055373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:58.055373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:58.055373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:58.055373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:58.055373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:58.055373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:58.055373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:58.055373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:58.055373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:58.055373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:58.055373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:58.055373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:41:58.055373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:41:58.055373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:41:58.055373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:41:58.056653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:58.056653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:58.056653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:41:58.056653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:41:58.056653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:41:58.056653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:41:58.056653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:58.056653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:58.056653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:58.056653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:58.056653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:58.056653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:58.056653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:58.056653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:58.056653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:58.056653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:58.056653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:58.056653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:58.057911 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:58.057911 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:58.057911 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:41:58.057911 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:41:58.057911 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:41:58.057911 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:41:58.057911 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:41:58.057911 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:41:58.057911 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 06:41:58.057911 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:58.057911 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 315/613] 10.222.0.77 () {56 vars in 1093 bytes} [Wed May 11 06:41:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:58.062242 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78d92b-13de-42d0-a971-a526be7691c3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:58.089882 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d47a61-5916-4629-8bf9-fa26f8bae054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:58.090933 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d47a61-5916-4629-8bf9-fa26f8bae054 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:58.091335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d47a61-5916-4629-8bf9-fa26f8bae054 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:58.091703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d47a61-5916-4629-8bf9-fa26f8bae054 None admin] PATH_INFO: `/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/281c923b01a143dbb79d8c0ea04f55b6/roles/46d109e3a1bd4f13b0d145cde46c75a9` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:58.108338 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d47a61-5916-4629-8bf9-fa26f8bae054 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f573a9de6904664ace6287072a8a7dc, user_id=281c923b01a143dbb79d8c0ea04f55b6, role_id=46d109e3a1bd4f13b0d145cde46c75a9)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:58.109980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d47a61-5916-4629-8bf9-fa26f8bae054 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:58.128406 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 299/614] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:41:57 2022] PUT /identity/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/281c923b01a143dbb79d8c0ea04f55b6/roles/46d109e3a1bd4f13b0d145cde46c75a9 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:58.182333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78d92b-13de-42d0-a971-a526be7691c3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:58.229787 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8b086-5703-4ffc-b3e8-13a67ea55142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:58.229787 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8b086-5703-4ffc-b3e8-13a67ea55142 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:58.229787 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8b086-5703-4ffc-b3e8-13a67ea55142 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:58.230163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8b086-5703-4ffc-b3e8-13a67ea55142 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:58.230859 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8b086-5703-4ffc-b3e8-13a67ea55142 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:58.231166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8b086-5703-4ffc-b3e8-13a67ea55142 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:58.232639 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8b086-5703-4ffc-b3e8-13a67ea55142 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:58.261584 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 316/615] 10.222.0.77 () {56 vars in 1133 bytes} [Wed May 11 06:41:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:58.266686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d47a61-5916-4629-8bf9-fa26f8bae054 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:58.381953 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d47a61-5916-4629-8bf9-fa26f8bae054 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:58.418410 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef8c3b-1517-4102-9feb-49bb975f9203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:58.419105 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef8c3b-1517-4102-9feb-49bb975f9203 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:58.419389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef8c3b-1517-4102-9feb-49bb975f9203 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:58.419724 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef8c3b-1517-4102-9feb-49bb975f9203 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:58.487394 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef8c3b-1517-4102-9feb-49bb975f9203 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:58.488942 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef8c3b-1517-4102-9feb-49bb975f9203 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:58.523848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ae376-0050-4ca5-b96e-87b1f2f2146d None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:58.524860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ae376-0050-4ca5-b96e-87b1f2f2146d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:58.525145 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ae376-0050-4ca5-b96e-87b1f2f2146d None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:58.526801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 317/616] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:41:58.532186 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e894e-6db8-4a45-9c52-e43c0a10f2dd None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:58.532472 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e894e-6db8-4a45-9c52-e43c0a10f2dd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:58.533112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e894e-6db8-4a45-9c52-e43c0a10f2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:58.562453 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a37e894e-6db8-4a45-9c52-e43c0a10f2dd None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:58.563766 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a37e894e-6db8-4a45-9c52-e43c0a10f2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:58.591564 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 300/617] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:41:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:41:58.597200 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef8c3b-1517-4102-9feb-49bb975f9203 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:58.668915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 318/618] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:58.713300 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e894e-6db8-4a45-9c52-e43c0a10f2dd None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:58.754885 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef8c3b-1517-4102-9feb-49bb975f9203 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:58.793022 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae754a62-13d1-4038-bc25-2076ec177e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:58.793747 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae754a62-13d1-4038-bc25-2076ec177e9d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:58.794029 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae754a62-13d1-4038-bc25-2076ec177e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:58.794303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae754a62-13d1-4038-bc25-2076ec177e9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:58.810718 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae754a62-13d1-4038-bc25-2076ec177e9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:58.812215 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae754a62-13d1-4038-bc25-2076ec177e9d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:58.847102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-ae754a62-13d1-4038-bc25-2076ec177e9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:58.847102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:58.847102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:58.847102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:58.847102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:58.847102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:58.847102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:58.847102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:58.847102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:58.847102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:58.847102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:58.847102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:58.847102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:58.847102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:58.847102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:58.848077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:58.848077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:58.848077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:58.848077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:58.848077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:58.848077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:58.848077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:58.848077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:58.848077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:58.848077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:58.848077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:58.848077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:58.848077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:58.848077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:58.848077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:58.848077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:58.848077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:58.849076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:58.849076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:58.849076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:58.849076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:58.854984 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e894e-6db8-4a45-9c52-e43c0a10f2dd None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:58.855647 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 301/619] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:58.864561 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae754a62-13d1-4038-bc25-2076ec177e9d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:58.912270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8d296-7dc4-4951-b507-655c7f944384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:58.913096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8d296-7dc4-4951-b507-655c7f944384 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:58.913377 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8d296-7dc4-4951-b507-655c7f944384 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:58.913656 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8d296-7dc4-4951-b507-655c7f944384 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:58.936177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8d296-7dc4-4951-b507-655c7f944384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:58.946417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-00d8d296-7dc4-4951-b507-655c7f944384 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:58.946417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:58.946417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:58.946417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:58.946417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:58.946417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:58.946417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:58.946417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:58.946417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:58.946417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:58.946417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:58.946417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:58.946417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:58.946417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:58.946417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:58.946417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:58.947457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:58.947457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:58.947457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:58.947457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:58.947457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:58.947457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:58.947457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:58.947457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:58.947457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:58.947457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:58.947457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:58.947457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:58.947457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:58.947457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:58.947457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:58.947457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:58.948319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:58.948319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:58.948319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:58.948319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:58.948319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:58.948319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:58.948319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:58.948319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:58.948319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:58.948319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:58.948319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:58.948319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:58.955290 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 319/620] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:41:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:41:58.958867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8d296-7dc4-4951-b507-655c7f944384 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:59.033617 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae754a62-13d1-4038-bc25-2076ec177e9d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:59.107850 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6234f9-7990-4cca-81fc-6dd071af49f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:59.108898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6234f9-7990-4cca-81fc-6dd071af49f0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:59.109384 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6234f9-7990-4cca-81fc-6dd071af49f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:59.109869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6234f9-7990-4cca-81fc-6dd071af49f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:59.110791 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6234f9-7990-4cca-81fc-6dd071af49f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:59.111309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6234f9-7990-4cca-81fc-6dd071af49f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:59.112946 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6234f9-7990-4cca-81fc-6dd071af49f0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:59.132056 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 302/621] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:59.134426 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8d296-7dc4-4951-b507-655c7f944384 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:59.137861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6234f9-7990-4cca-81fc-6dd071af49f0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:59.194508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef94ec-ac1e-4d51-92c1-a4bb23ed9caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:59.195216 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef94ec-ac1e-4d51-92c1-a4bb23ed9caa None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:59.195498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef94ec-ac1e-4d51-92c1-a4bb23ed9caa None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:59.195771 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef94ec-ac1e-4d51-92c1-a4bb23ed9caa None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:59.196874 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef94ec-ac1e-4d51-92c1-a4bb23ed9caa None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:59.197177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef94ec-ac1e-4d51-92c1-a4bb23ed9caa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:59.198568 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef94ec-ac1e-4d51-92c1-a4bb23ed9caa None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:59.215484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 320/622] 10.222.0.77 () {56 vars in 1103 bytes} [Wed May 11 06:41:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:59.224634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef94ec-ac1e-4d51-92c1-a4bb23ed9caa None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:59.249436 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6234f9-7990-4cca-81fc-6dd071af49f0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:59.294588 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617338e1-b25e-46ae-8f46-6571d4316132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:59.294849 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617338e1-b25e-46ae-8f46-6571d4316132 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:59.295162 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617338e1-b25e-46ae-8f46-6571d4316132 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:59.295435 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617338e1-b25e-46ae-8f46-6571d4316132 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:59.304689 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617338e1-b25e-46ae-8f46-6571d4316132 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:59.306346 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617338e1-b25e-46ae-8f46-6571d4316132 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:59.328952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-617338e1-b25e-46ae-8f46-6571d4316132 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:41:59.328952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:59.328952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:59.328952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:59.328952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:59.328952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:59.328952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:59.328952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:59.328952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:59.328952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:59.328952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:59.328952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:59.328952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:41:59.328952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:41:59.328952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:41:59.329883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:41:59.329883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:59.329883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:59.329883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:59.329883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:59.329883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:59.329883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:59.329883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:59.329883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:59.329883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:59.329883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:59.329883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:59.329883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:59.329883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:59.329883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:59.329883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:59.329883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:59.330791 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:41:59.330791 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:41:59.330791 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:41:59.330791 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:41:59.330791 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:41:59.330791 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:41:59.330791 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:41:59.330791 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:59.332476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 303/623] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:41:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:59.337470 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5f13e-7252-4c8a-aa7f-51033e758a91 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:59.337470 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5f13e-7252-4c8a-aa7f-51033e758a91 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:59.337470 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5f13e-7252-4c8a-aa7f-51033e758a91 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:59.337470 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 304/624] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:41:59.339761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5f13e-7252-4c8a-aa7f-51033e758a91 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:59.360072 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef94ec-ac1e-4d51-92c1-a4bb23ed9caa None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:59.394168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73484950-76ff-4b9d-b82d-58f6e91eec1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:59.394989 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73484950-76ff-4b9d-b82d-58f6e91eec1e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:59.395279 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73484950-76ff-4b9d-b82d-58f6e91eec1e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:59.395585 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73484950-76ff-4b9d-b82d-58f6e91eec1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:59.406530 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73484950-76ff-4b9d-b82d-58f6e91eec1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:59.408476 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73484950-76ff-4b9d-b82d-58f6e91eec1e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:59.429692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-73484950-76ff-4b9d-b82d-58f6e91eec1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:59.429692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:59.429692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:59.429692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:59.429692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:59.429692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:59.429692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:59.429692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:59.429692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:59.429692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:59.429692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:59.429692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:59.429692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:41:59.429692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:41:59.429692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:41:59.430903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:41:59.430903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:59.430903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:59.430903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:59.430903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:59.430903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:59.430903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:59.430903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:59.430903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:59.430903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:59.430903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:59.430903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:59.430903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:59.430903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:59.430903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:59.430903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:59.430903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:59.432130 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:41:59.432130 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:41:59.432130 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:41:59.432130 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:59.435910 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 321/625] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:59.437307 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044799e-9883-4b4c-914b-25e41479f1fe None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:59.437599 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044799e-9883-4b4c-914b-25e41479f1fe None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:59.437880 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044799e-9883-4b4c-914b-25e41479f1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:59.459144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5f13e-7252-4c8a-aa7f-51033e758a91 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:59.459414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c044799e-9883-4b4c-914b-25e41479f1fe None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:59.460557 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c044799e-9883-4b4c-914b-25e41479f1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:59.496223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a22ad-82ac-4d19-a041-45d58e8695ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:59.497602 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a22ad-82ac-4d19-a041-45d58e8695ac None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:59.498107 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a22ad-82ac-4d19-a041-45d58e8695ac None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:59.498557 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a22ad-82ac-4d19-a041-45d58e8695ac None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:59.499667 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a22ad-82ac-4d19-a041-45d58e8695ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:59.500190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a22ad-82ac-4d19-a041-45d58e8695ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:59.501911 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a22ad-82ac-4d19-a041-45d58e8695ac None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:59.520205 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 305/626] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:41:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:59.521593 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a22ad-82ac-4d19-a041-45d58e8695ac None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:59.533527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 322/627] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:41:59.539425 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044799e-9883-4b4c-914b-25e41479f1fe None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:59.622904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a22ad-82ac-4d19-a041-45d58e8695ac None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:59.654928 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044799e-9883-4b4c-914b-25e41479f1fe None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:59.658108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070b80d-368f-4c6e-b8cb-a4d60beb0f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:59.659062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070b80d-368f-4c6e-b8cb-a4d60beb0f4e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:59.659549 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070b80d-368f-4c6e-b8cb-a4d60beb0f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:59.660026 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070b80d-368f-4c6e-b8cb-a4d60beb0f4e None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:59.660987 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070b80d-368f-4c6e-b8cb-a4d60beb0f4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:59.661602 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070b80d-368f-4c6e-b8cb-a4d60beb0f4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:59.663221 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070b80d-368f-4c6e-b8cb-a4d60beb0f4e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:59.675999 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 306/628] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:59.677148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070b80d-368f-4c6e-b8cb-a4d60beb0f4e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:59.701733 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489644f-284b-46ac-8857-748bf8ec8f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:59.703117 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489644f-284b-46ac-8857-748bf8ec8f96 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:59.703605 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489644f-284b-46ac-8857-748bf8ec8f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:59.704117 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489644f-284b-46ac-8857-748bf8ec8f96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:59.705572 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489644f-284b-46ac-8857-748bf8ec8f96 None admin] RBAC: Adding query filter params (role.id=46d109e3a1bd4f13b0d145cde46c75a9, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=edf9d57de89a4701ba1a5b079d0ad348) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:59.706257 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489644f-284b-46ac-8857-748bf8ec8f96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:59.708558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489644f-284b-46ac-8857-748bf8ec8f96 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:59.723146 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 323/629] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:41:59 2022] GET /identity/v3/role_assignments?user.id=edf9d57de89a4701ba1a5b079d0ad348&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=46d109e3a1bd4f13b0d145cde46c75a9 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:59.723146 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489644f-284b-46ac-8857-748bf8ec8f96 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:59.849002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489644f-284b-46ac-8857-748bf8ec8f96 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:59.868938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070b80d-368f-4c6e-b8cb-a4d60beb0f4e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:59.883410 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96628f21-2ca9-4bc1-81a8-f13232d96d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:59.884148 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96628f21-2ca9-4bc1-81a8-f13232d96d07 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:59.884428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96628f21-2ca9-4bc1-81a8-f13232d96d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:59.884755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96628f21-2ca9-4bc1-81a8-f13232d96d07 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:59.895672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96628f21-2ca9-4bc1-81a8-f13232d96d07 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:59.895672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96628f21-2ca9-4bc1-81a8-f13232d96d07 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:59.915414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-96628f21-2ca9-4bc1-81a8-f13232d96d07 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 06:41:59.915414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:59.915414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:59.915414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:59.915414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:59.915414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:59.915414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:59.915414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:59.915414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:59.915414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:59.915414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:59.915414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:59.915414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:41:59.915414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:41:59.915414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:41:59.915414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:41:59.916683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:59.916683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:59.916683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:41:59.916683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:41:59.916683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:41:59.916683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:41:59.916683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:59.916683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:59.916683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:59.916683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:59.916683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:59.916683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:41:59.916683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:59.916683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:59.916683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:59.916683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:59.916683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:59.916683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:59.917895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:59.917895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:59.917895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:41:59.917895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:41:59.917895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:41:59.917895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:41:59.917895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:41:59.917895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:41:59.917895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 06:41:59.917895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:41:59.917895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 324/630] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:41:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:41:59.919311 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96628f21-2ca9-4bc1-81a8-f13232d96d07 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:59.949548 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28491964-8970-4080-98fc-9a11fe595428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:59.951156 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28491964-8970-4080-98fc-9a11fe595428 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:59.951584 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28491964-8970-4080-98fc-9a11fe595428 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:59.952030 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28491964-8970-4080-98fc-9a11fe595428 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:59.973504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28491964-8970-4080-98fc-9a11fe595428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:41:59.990084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-28491964-8970-4080-98fc-9a11fe595428 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:59.990084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:41:59.990084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:41:59.990084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:41:59.990084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:41:59.990084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:41:59.990084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:41:59.990084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:41:59.990084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:41:59.990084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:41:59.990084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:41:59.990084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:41:59.990084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:41:59.990084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:41:59.990084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:41:59.990084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:41:59.991467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:41:59.991467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:41:59.991467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:41:59.991467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:41:59.991467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:41:59.991467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:41:59.991467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:41:59.991467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:41:59.991467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:41:59.991467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:41:59.991467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:41:59.991467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:41:59.991467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:41:59.991467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:41:59.991467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:41:59.991467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:41:59.992514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:41:59.992514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:41:59.992514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:41:59.992514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:41:59.992514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:41:59.992514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:41:59.992514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:41:59.992514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:41:59.992514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:41:59.992514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:41:59.992514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:41:59.992514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:41:59.994944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 307/631] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:41:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:00.011238 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28491964-8970-4080-98fc-9a11fe595428 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:00.033870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96628f21-2ca9-4bc1-81a8-f13232d96d07 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:00.069777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdc37e-d994-48c8-a9ae-f2c82db4378e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:00.071457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdc37e-d994-48c8-a9ae-f2c82db4378e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:00.071457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdc37e-d994-48c8-a9ae-f2c82db4378e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:00.071691 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdc37e-d994-48c8-a9ae-f2c82db4378e None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:00.072624 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdc37e-d994-48c8-a9ae-f2c82db4378e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:00.073029 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdc37e-d994-48c8-a9ae-f2c82db4378e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:00.074637 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdc37e-d994-48c8-a9ae-f2c82db4378e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:00.094165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 325/632] 10.222.0.77 () {56 vars in 1135 bytes} [Wed May 11 06:41:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:00.099944 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdc37e-d994-48c8-a9ae-f2c82db4378e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:00.137097 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28491964-8970-4080-98fc-9a11fe595428 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:00.173132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411eb16-6ebf-4847-bef1-72f7369a77da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:00.174064 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411eb16-6ebf-4847-bef1-72f7369a77da None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:00.174496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411eb16-6ebf-4847-bef1-72f7369a77da None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:00.174949 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411eb16-6ebf-4847-bef1-72f7369a77da None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:00.175870 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411eb16-6ebf-4847-bef1-72f7369a77da None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:00.176326 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411eb16-6ebf-4847-bef1-72f7369a77da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:00.177939 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411eb16-6ebf-4847-bef1-72f7369a77da None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:00.186695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 308/633] 10.222.0.77 () {56 vars in 1103 bytes} [Wed May 11 06:42:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:00.193532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411eb16-6ebf-4847-bef1-72f7369a77da None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:00.208105 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdc37e-d994-48c8-a9ae-f2c82db4378e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:00.254989 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd7df5-639f-47c6-9eb1-8b2a37b67fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:00.256233 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd7df5-639f-47c6-9eb1-8b2a37b67fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:00.256713 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd7df5-639f-47c6-9eb1-8b2a37b67fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:00.257244 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd7df5-639f-47c6-9eb1-8b2a37b67fd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:00.272096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd7df5-639f-47c6-9eb1-8b2a37b67fd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:00.274828 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd7df5-639f-47c6-9eb1-8b2a37b67fd8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:00.298634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-3cdd7df5-639f-47c6-9eb1-8b2a37b67fd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:00.298634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:00.298634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:00.298634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:00.298634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:00.298634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:00.298634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:00.298634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:00.298634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:00.298634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:00.298634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:00.298634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:00.298634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:00.298634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:00.298634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:00.299705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:00.299705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:00.299705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:00.299705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:00.299705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:00.299705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:00.299705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:00.299705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:00.299705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:00.299705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:00.299705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:00.299705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:00.299705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:00.299705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:00.299705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:00.299705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:00.299705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:00.300685 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:00.300685 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:00.300685 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:00.300685 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:00.305880 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 326/634] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:00.306911 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd7df5-639f-47c6-9eb1-8b2a37b67fd8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:00.326770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411eb16-6ebf-4847-bef1-72f7369a77da None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:00.372537 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8020a7-e8a9-4d1f-a054-8ca54cc67c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:00.373715 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8020a7-e8a9-4d1f-a054-8ca54cc67c08 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:00.374224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8020a7-e8a9-4d1f-a054-8ca54cc67c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:00.374857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8020a7-e8a9-4d1f-a054-8ca54cc67c08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:00.388795 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8020a7-e8a9-4d1f-a054-8ca54cc67c08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:00.390939 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8020a7-e8a9-4d1f-a054-8ca54cc67c08 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:00.409724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd7df5-639f-47c6-9eb1-8b2a37b67fd8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:00.413522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-8c8020a7-e8a9-4d1f-a054-8ca54cc67c08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:00.413522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:00.413522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:00.413522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:00.413522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:00.413522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:00.413522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:00.413522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:00.413522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:00.413522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:00.413522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:00.413522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:00.413522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:00.413522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:00.413522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:00.414417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:00.414417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:00.414417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:00.414417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:00.414417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:00.414417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:00.414417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:00.414417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:00.414417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:00.414417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:00.414417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:00.414417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:00.414417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:00.414417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:00.414417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:00.414417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:00.414417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:00.415356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:00.415356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:00.415356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:00.415356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:00.418007 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 309/635] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:00.423799 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8020a7-e8a9-4d1f-a054-8ca54cc67c08 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:00.451458 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf81f6-5926-4655-ba7e-b24fbbde6871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:00.452153 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf81f6-5926-4655-ba7e-b24fbbde6871 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:00.452508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf81f6-5926-4655-ba7e-b24fbbde6871 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:00.452861 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf81f6-5926-4655-ba7e-b24fbbde6871 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:00.453728 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf81f6-5926-4655-ba7e-b24fbbde6871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:00.454111 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf81f6-5926-4655-ba7e-b24fbbde6871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:00.455715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf81f6-5926-4655-ba7e-b24fbbde6871 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:00.469683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 327/636] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:00.475512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf81f6-5926-4655-ba7e-b24fbbde6871 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:00.549424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8020a7-e8a9-4d1f-a054-8ca54cc67c08 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:00.588344 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b26d45-9167-41b1-aee5-f645e121f980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:00.589313 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b26d45-9167-41b1-aee5-f645e121f980 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:00.589606 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b26d45-9167-41b1-aee5-f645e121f980 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:00.589885 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b26d45-9167-41b1-aee5-f645e121f980 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:00.590886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b26d45-9167-41b1-aee5-f645e121f980 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:00.591228 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b26d45-9167-41b1-aee5-f645e121f980 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:00.593079 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b26d45-9167-41b1-aee5-f645e121f980 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:00.596300 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf81f6-5926-4655-ba7e-b24fbbde6871 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:00.606837 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 310/637] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:00.611994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359a044-632e-4687-abc6-a2a70bfb08db None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:00.611994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359a044-632e-4687-abc6-a2a70bfb08db None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:00.611994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359a044-632e-4687-abc6-a2a70bfb08db None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:00.611994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 311/638] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:00.616505 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359a044-632e-4687-abc6-a2a70bfb08db None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:00.640901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a8d55-ece1-4658-b705-cb310293b2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:00.641624 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a8d55-ece1-4658-b705-cb310293b2cd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:00.641961 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a8d55-ece1-4658-b705-cb310293b2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:00.642236 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a8d55-ece1-4658-b705-cb310293b2cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:00.649243 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a8d55-ece1-4658-b705-cb310293b2cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:00.650825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a8d55-ece1-4658-b705-cb310293b2cd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:00.666129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b19a8d55-ece1-4658-b705-cb310293b2cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:00.666129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:00.666129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:00.666129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:00.666129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:00.666129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:00.666129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:00.666129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:00.666129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:00.666129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:00.666129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:00.666129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:00.666129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:42:00.666129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:42:00.666129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:42:00.667327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:42:00.667327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:00.667327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:00.667327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:00.667327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:00.667327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:00.667327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:00.667327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:00.667327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:00.667327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:00.667327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:00.667327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:00.667327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:00.667327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:00.667327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:00.667327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:00.667327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:00.668400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:42:00.668400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:42:00.668400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:42:00.668400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:42:00.668400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:42:00.668400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:42:00.668400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:00.668400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:00.668400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 328/639] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:00.668999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef73ecb-a056-4a1d-b56a-52847dd9fc14 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:00.669160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef73ecb-a056-4a1d-b56a-52847dd9fc14 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:00.669435 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef73ecb-a056-4a1d-b56a-52847dd9fc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:00.685466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-eef73ecb-a056-4a1d-b56a-52847dd9fc14 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:00.686657 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-eef73ecb-a056-4a1d-b56a-52847dd9fc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:00.725803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359a044-632e-4687-abc6-a2a70bfb08db None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:00.750555 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 329/640] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:42:00.751920 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a3cd0-aa40-4539-8dca-cd0f5c6f6929 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:00.752220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a3cd0-aa40-4539-8dca-cd0f5c6f6929 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:00.752497 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a3cd0-aa40-4539-8dca-cd0f5c6f6929 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:00.753998 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 330/641] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:00.754581 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a3cd0-aa40-4539-8dca-cd0f5c6f6929 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:00.771678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115bbc2-3efe-47de-b6cd-31c3ae198008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:00.773104 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115bbc2-3efe-47de-b6cd-31c3ae198008 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:00.773547 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115bbc2-3efe-47de-b6cd-31c3ae198008 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:00.774057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115bbc2-3efe-47de-b6cd-31c3ae198008 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:00.782123 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115bbc2-3efe-47de-b6cd-31c3ae198008 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:00.783607 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115bbc2-3efe-47de-b6cd-31c3ae198008 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:00.797819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-5115bbc2-3efe-47de-b6cd-31c3ae198008 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 06:42:00.797819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:00.797819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:00.797819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:00.797819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:00.797819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:00.797819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:00.797819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:00.797819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:00.797819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:00.797819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:00.797819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:00.797819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:42:00.797819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:42:00.797819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:42:00.797819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:42:00.799133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:00.799133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:00.799133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:42:00.799133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:00.799133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:42:00.799133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:00.799133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:00.799133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:00.799133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:00.799133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:00.799133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:00.799133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:00.799133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:00.799133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:00.799133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:00.799133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:00.799133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:00.799133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:00.800316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:00.800316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:00.800316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:42:00.800316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:42:00.800316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:42:00.800316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:42:00.800316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:42:00.800316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:42:00.800316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 06:42:00.800316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:00.803864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 312/642] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:42:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:00.805160 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576ddf3-3408-49d6-b65d-b73e53744698 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:00.805440 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576ddf3-3408-49d6-b65d-b73e53744698 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:00.805713 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576ddf3-3408-49d6-b65d-b73e53744698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:00.823801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0576ddf3-3408-49d6-b65d-b73e53744698 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:00.824988 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0576ddf3-3408-49d6-b65d-b73e53744698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:00.857860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a3cd0-aa40-4539-8dca-cd0f5c6f6929 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:00.890525 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 313/643] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:42:00.891646 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576ddf3-3408-49d6-b65d-b73e53744698 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:00.891986 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3eb3d4-f8b8-43a5-840c-38365386d0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:00.892751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3eb3d4-f8b8-43a5-840c-38365386d0cf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:00.893128 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3eb3d4-f8b8-43a5-840c-38365386d0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:00.893498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3eb3d4-f8b8-43a5-840c-38365386d0cf None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:00.894394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3eb3d4-f8b8-43a5-840c-38365386d0cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:00.894790 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3eb3d4-f8b8-43a5-840c-38365386d0cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:00.896435 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3eb3d4-f8b8-43a5-840c-38365386d0cf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:00.911079 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 331/644] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:42:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:00.912831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3eb3d4-f8b8-43a5-840c-38365386d0cf None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:00.993062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576ddf3-3408-49d6-b65d-b73e53744698 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:01.021909 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3eb3d4-f8b8-43a5-840c-38365386d0cf None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:01.024891 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44380586-f6ae-40a2-8a92-de290f22f0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:01.025701 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44380586-f6ae-40a2-8a92-de290f22f0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:01.025980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44380586-f6ae-40a2-8a92-de290f22f0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:01.026254 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44380586-f6ae-40a2-8a92-de290f22f0a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:01.036382 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44380586-f6ae-40a2-8a92-de290f22f0a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:42:01.044014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-44380586-f6ae-40a2-8a92-de290f22f0a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:42:01.044014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:01.044014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:01.044014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:01.044014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:01.044014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:01.044014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:01.044014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:01.044014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:01.044014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:01.044014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:01.044014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:01.044014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:42:01.044014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:42:01.044014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:42:01.044014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:42:01.045114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:42:01.045114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:42:01.045114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:42:01.045114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:42:01.045114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:01.045114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:01.045114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:01.045114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:01.045114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:01.045114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:01.045114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:01.045114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:01.045114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:01.045114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:01.045114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:01.045114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:01.046024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:01.046024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:01.046024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:01.046024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:01.046024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:42:01.046024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:42:01.046024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:42:01.046024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:42:01.046024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:42:01.046024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:42:01.046024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:42:01.046024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:01.047286 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 314/645] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:42:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:01.048121 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44380586-f6ae-40a2-8a92-de290f22f0a0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:01.064747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ade5f-404d-42c7-aa09-faae589b362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:01.065453 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ade5f-404d-42c7-aa09-faae589b362e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:01.065723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ade5f-404d-42c7-aa09-faae589b362e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:01.065997 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ade5f-404d-42c7-aa09-faae589b362e None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:01.066847 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ade5f-404d-42c7-aa09-faae589b362e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:01.067202 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ade5f-404d-42c7-aa09-faae589b362e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:01.068723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ade5f-404d-42c7-aa09-faae589b362e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:01.089530 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 332/646] 10.222.0.77 () {56 vars in 1137 bytes} [Wed May 11 06:42:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:01.090348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ade5f-404d-42c7-aa09-faae589b362e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:01.150037 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44380586-f6ae-40a2-8a92-de290f22f0a0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:01.182252 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54598d-73e9-452c-ae71-9734443613d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:01.183368 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54598d-73e9-452c-ae71-9734443613d1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:01.183657 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54598d-73e9-452c-ae71-9734443613d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:01.183933 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54598d-73e9-452c-ae71-9734443613d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:01.186633 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ade5f-404d-42c7-aa09-faae589b362e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:01.195276 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54598d-73e9-452c-ae71-9734443613d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:42:01.203366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-8c54598d-73e9-452c-ae71-9734443613d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:42:01.203366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:01.203366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:01.203366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:01.203366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:01.203366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:01.203366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:01.203366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:01.203366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:01.203366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:01.203366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:01.203366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:01.203366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:42:01.203366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:42:01.203366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:42:01.203366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:42:01.204317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:42:01.204317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:42:01.204317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:42:01.204317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:42:01.204317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:01.204317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:01.204317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:01.204317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:01.204317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:01.204317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:01.204317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:01.204317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:01.204317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:01.204317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:01.204317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:01.204317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:01.205153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:01.205153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:01.205153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:01.205153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:01.205153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:42:01.205153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:42:01.205153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:42:01.205153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:42:01.205153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:42:01.205153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:42:01.205153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:42:01.205153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:01.205153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 315/647] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:42:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:01.205852 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54598d-73e9-452c-ae71-9734443613d1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:01.225771 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee431ad-b953-4dec-85f8-38d894b0e251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:01.227363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee431ad-b953-4dec-85f8-38d894b0e251 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:01.227815 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee431ad-b953-4dec-85f8-38d894b0e251 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:01.228276 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee431ad-b953-4dec-85f8-38d894b0e251 None admin] PATH_INFO: `/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/f726f58d30734be7abf15400bff89533/roles/46d109e3a1bd4f13b0d145cde46c75a9` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:01.245509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee431ad-b953-4dec-85f8-38d894b0e251 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f573a9de6904664ace6287072a8a7dc, user_id=f726f58d30734be7abf15400bff89533, role_id=46d109e3a1bd4f13b0d145cde46c75a9)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:01.246988 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee431ad-b953-4dec-85f8-38d894b0e251 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:01.260826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 333/648] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:42:01 2022] PUT /identity/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/f726f58d30734be7abf15400bff89533/roles/46d109e3a1bd4f13b0d145cde46c75a9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:42:01.261838 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee431ad-b953-4dec-85f8-38d894b0e251 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:01.331585 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54598d-73e9-452c-ae71-9734443613d1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:01.367107 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cabe6d-cc77-45fc-a2a8-53afe850570d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:01.367805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cabe6d-cc77-45fc-a2a8-53afe850570d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:01.368082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cabe6d-cc77-45fc-a2a8-53afe850570d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:01.368368 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cabe6d-cc77-45fc-a2a8-53afe850570d None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:01.369114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cabe6d-cc77-45fc-a2a8-53afe850570d None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:01.369418 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cabe6d-cc77-45fc-a2a8-53afe850570d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:01.370993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cabe6d-cc77-45fc-a2a8-53afe850570d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:01.381552 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 316/649] 10.222.0.77 () {56 vars in 1103 bytes} [Wed May 11 06:42:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:01.382435 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cabe6d-cc77-45fc-a2a8-53afe850570d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:01.405189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee431ad-b953-4dec-85f8-38d894b0e251 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:01.453511 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab49826-39a2-409e-a932-c61dac2e30b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:01.454584 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab49826-39a2-409e-a932-c61dac2e30b6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:01.455107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab49826-39a2-409e-a932-c61dac2e30b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:01.455612 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab49826-39a2-409e-a932-c61dac2e30b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:01.502300 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cabe6d-cc77-45fc-a2a8-53afe850570d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:01.540572 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab49826-39a2-409e-a932-c61dac2e30b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:01.542282 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab49826-39a2-409e-a932-c61dac2e30b6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:01.544930 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d90c88-1a74-4fc8-b9e5-bac2c49d9825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:01.545879 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d90c88-1a74-4fc8-b9e5-bac2c49d9825 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:01.546362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d90c88-1a74-4fc8-b9e5-bac2c49d9825 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:01.546830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d90c88-1a74-4fc8-b9e5-bac2c49d9825 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:01.547810 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d90c88-1a74-4fc8-b9e5-bac2c49d9825 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:01.548318 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d90c88-1a74-4fc8-b9e5-bac2c49d9825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:01.549899 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d90c88-1a74-4fc8-b9e5-bac2c49d9825 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:01.558887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 317/650] 10.222.0.77 () {56 vars in 1103 bytes} [Wed May 11 06:42:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:01.560044 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d90c88-1a74-4fc8-b9e5-bac2c49d9825 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:01.660408 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d90c88-1a74-4fc8-b9e5-bac2c49d9825 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:01.669096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 334/651] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:42:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:42:01.670081 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab49826-39a2-409e-a932-c61dac2e30b6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:01.697107 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f508ee3-9774-49a4-91e5-a4aebd2cb03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:01.698283 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f508ee3-9774-49a4-91e5-a4aebd2cb03d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:01.698768 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f508ee3-9774-49a4-91e5-a4aebd2cb03d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:01.699269 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f508ee3-9774-49a4-91e5-a4aebd2cb03d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:01.710628 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f508ee3-9774-49a4-91e5-a4aebd2cb03d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:01.712412 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f508ee3-9774-49a4-91e5-a4aebd2cb03d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:01.730513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-5f508ee3-9774-49a4-91e5-a4aebd2cb03d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:01.730513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:01.730513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:01.730513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:01.730513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:01.730513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:01.730513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:01.730513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:01.730513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:01.730513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:01.730513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:01.730513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:01.730513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:01.730513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:01.730513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:01.731516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:01.731516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:01.731516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:01.731516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:01.731516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:01.731516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:01.731516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:01.731516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:01.731516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:01.731516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:01.731516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:01.731516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:01.731516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:01.731516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:01.731516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:01.731516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:01.731516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:01.732458 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:01.732458 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:01.732458 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:01.732458 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:01.734724 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 318/652] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:01.735859 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f508ee3-9774-49a4-91e5-a4aebd2cb03d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:01.792528 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab49826-39a2-409e-a932-c61dac2e30b6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:01.836449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f508ee3-9774-49a4-91e5-a4aebd2cb03d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:01.838404 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacc4c0-56a0-4c92-87b8-0e5596152c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:01.839250 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacc4c0-56a0-4c92-87b8-0e5596152c71 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:01.840288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacc4c0-56a0-4c92-87b8-0e5596152c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:01.840566 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacc4c0-56a0-4c92-87b8-0e5596152c71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:01.852862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adacc4c0-56a0-4c92-87b8-0e5596152c71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:01.854435 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adacc4c0-56a0-4c92-87b8-0e5596152c71 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:01.872348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a8a7c-0cad-4ccd-81ee-b419c3b8e666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:01.873471 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a8a7c-0cad-4ccd-81ee-b419c3b8e666 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:01.873977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a8a7c-0cad-4ccd-81ee-b419c3b8e666 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:01.874459 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a8a7c-0cad-4ccd-81ee-b419c3b8e666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:01.874755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-adacc4c0-56a0-4c92-87b8-0e5596152c71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:01.874755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:01.874755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:01.874755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:01.874755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:01.874755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:01.874755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:01.874755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:01.874755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:01.874755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:01.874755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:01.874755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:01.874755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:01.874755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:01.874755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:01.875679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:01.875679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:01.875679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:01.875679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:01.875679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:01.875679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:01.875679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:01.875679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:01.875679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:01.875679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:01.875679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:01.875679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:01.875679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:01.875679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:01.875679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:01.875679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:01.875679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:01.876636 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:01.876636 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:01.876636 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:01.876636 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:01.880812 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 335/653] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:01.882037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacc4c0-56a0-4c92-87b8-0e5596152c71 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:01.890624 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a8a7c-0cad-4ccd-81ee-b419c3b8e666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:01.892452 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a8a7c-0cad-4ccd-81ee-b419c3b8e666 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:01.909817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-601a8a7c-0cad-4ccd-81ee-b419c3b8e666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:01.909817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:01.909817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:01.909817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:01.909817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:01.909817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:01.909817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:01.909817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:01.909817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:01.909817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:01.909817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:01.909817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:01.909817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:01.909817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:01.909817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:01.910830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:01.910830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:01.910830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:01.910830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:01.910830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:01.910830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:01.910830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:01.910830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:01.910830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:01.910830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:01.910830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:01.910830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:01.910830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:01.910830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:01.910830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:01.910830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:01.910830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:01.912216 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:01.912216 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:01.912216 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:01.912216 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:01.914276 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 319/654] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:01.915448 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a8a7c-0cad-4ccd-81ee-b419c3b8e666 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:01.987613 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacc4c0-56a0-4c92-87b8-0e5596152c71 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:02.016543 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a8a7c-0cad-4ccd-81ee-b419c3b8e666 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:02.020998 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129acbe-09cb-401f-acb6-f19da064100c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:02.021672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129acbe-09cb-401f-acb6-f19da064100c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:02.021947 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129acbe-09cb-401f-acb6-f19da064100c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:02.022242 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129acbe-09cb-401f-acb6-f19da064100c None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:02.022951 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129acbe-09cb-401f-acb6-f19da064100c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:02.023279 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129acbe-09cb-401f-acb6-f19da064100c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:02.024648 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129acbe-09cb-401f-acb6-f19da064100c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:02.036225 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 336/655] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:02.037076 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129acbe-09cb-401f-acb6-f19da064100c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:02.053567 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd792a45-fa28-41e6-9f26-07caa296f507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:02.054629 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd792a45-fa28-41e6-9f26-07caa296f507 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:02.055205 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd792a45-fa28-41e6-9f26-07caa296f507 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:02.055699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd792a45-fa28-41e6-9f26-07caa296f507 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:02.056632 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd792a45-fa28-41e6-9f26-07caa296f507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:02.057139 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd792a45-fa28-41e6-9f26-07caa296f507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:02.058912 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd792a45-fa28-41e6-9f26-07caa296f507 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:02.072233 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 320/656] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:02.073346 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd792a45-fa28-41e6-9f26-07caa296f507 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:02.139031 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129acbe-09cb-401f-acb6-f19da064100c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:02.172440 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b88815-9355-4a31-ab90-fb56c6a8e7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:02.173022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b88815-9355-4a31-ab90-fb56c6a8e7bb None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:02.173299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b88815-9355-4a31-ab90-fb56c6a8e7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:02.173566 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b88815-9355-4a31-ab90-fb56c6a8e7bb None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:02.174283 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b88815-9355-4a31-ab90-fb56c6a8e7bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:02.174582 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b88815-9355-4a31-ab90-fb56c6a8e7bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:02.175992 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b88815-9355-4a31-ab90-fb56c6a8e7bb None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:02.181975 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd792a45-fa28-41e6-9f26-07caa296f507 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:02.188057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 337/657] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:02.188990 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b88815-9355-4a31-ab90-fb56c6a8e7bb None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:02.218010 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d4d01-661d-4f2c-b32f-7d5817e41593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:02.219220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d4d01-661d-4f2c-b32f-7d5817e41593 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:02.219729 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d4d01-661d-4f2c-b32f-7d5817e41593 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:02.220221 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d4d01-661d-4f2c-b32f-7d5817e41593 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:02.229293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d4d01-661d-4f2c-b32f-7d5817e41593 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:02.231790 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d4d01-661d-4f2c-b32f-7d5817e41593 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:02.251293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-024d4d01-661d-4f2c-b32f-7d5817e41593 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 06:42:02.251293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:02.251293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:02.251293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:02.251293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:02.251293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:02.251293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:02.251293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:02.251293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:02.251293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:02.251293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:02.251293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:02.251293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:42:02.251293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:42:02.251293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:42:02.251293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:42:02.252271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:02.252271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:02.252271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:42:02.252271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:02.252271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:42:02.252271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:02.252271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:02.252271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:02.252271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:02.252271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:02.252271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:02.252271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:02.252271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:02.252271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:02.252271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:02.252271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:02.252271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:02.252271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:02.253241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:02.253241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:02.253241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:42:02.253241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:42:02.253241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:42:02.253241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:42:02.253241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:42:02.253241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:42:02.253241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 06:42:02.253241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:02.256726 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 321/658] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:42:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:02.258046 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d4d01-661d-4f2c-b32f-7d5817e41593 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:02.296259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b88815-9355-4a31-ab90-fb56c6a8e7bb None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:02.339741 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f39e3-6d7e-464e-9ab5-d5239f8d320d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:02.340896 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f39e3-6d7e-464e-9ab5-d5239f8d320d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:02.341434 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f39e3-6d7e-464e-9ab5-d5239f8d320d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:02.341917 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f39e3-6d7e-464e-9ab5-d5239f8d320d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:02.351825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f39e3-6d7e-464e-9ab5-d5239f8d320d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:02.353514 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f39e3-6d7e-464e-9ab5-d5239f8d320d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:02.365630 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d4d01-661d-4f2c-b32f-7d5817e41593 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:02.372734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-e68f39e3-6d7e-464e-9ab5-d5239f8d320d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 06:42:02.372734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:02.372734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:02.372734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:02.372734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:02.372734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:02.372734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:02.372734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:02.372734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:02.372734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:02.372734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:02.372734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:02.372734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:42:02.372734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:42:02.372734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:42:02.372734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:42:02.373856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:02.373856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:02.373856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:42:02.373856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:02.373856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:42:02.373856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:02.373856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:02.373856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:02.373856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:02.373856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:02.373856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:02.373856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:02.373856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:02.373856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:02.373856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:02.373856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:02.373856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:02.373856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:02.374833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:02.374833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:02.374833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:42:02.374833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:42:02.374833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:42:02.374833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:42:02.374833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:42:02.374833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:42:02.374833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 06:42:02.374833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:02.377965 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 338/659] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:42:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:02.379145 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f39e3-6d7e-464e-9ab5-d5239f8d320d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:02.417882 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9388d-620c-4ac8-a995-428a59466064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:02.418918 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9388d-620c-4ac8-a995-428a59466064 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:02.419540 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9388d-620c-4ac8-a995-428a59466064 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:02.419659 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9388d-620c-4ac8-a995-428a59466064 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:02.427113 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9388d-620c-4ac8-a995-428a59466064 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:02.428637 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9388d-620c-4ac8-a995-428a59466064 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:02.442669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-e9c9388d-620c-4ac8-a995-428a59466064 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:02.442669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:02.442669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:02.442669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:02.442669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:02.442669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:02.442669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:02.442669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:02.442669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:02.442669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:02.442669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:02.442669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:02.442669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:42:02.442669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:42:02.442669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:42:02.443903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:42:02.443903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:02.443903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:02.443903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:02.443903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:02.443903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:02.443903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:02.443903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:02.443903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:02.443903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:02.443903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:02.443903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:02.443903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:02.443903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:02.443903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:02.443903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:02.443903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:02.445061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:42:02.445061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:42:02.445061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:42:02.445061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:42:02.445061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:42:02.445061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:42:02.445061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:02.445061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:02.447339 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 322/660] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:02.448424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9388d-620c-4ac8-a995-428a59466064 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:02.507961 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f39e3-6d7e-464e-9ab5-d5239f8d320d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:02.542577 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abbb75-0009-4fdc-9be5-1e34c563a84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:02.543296 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abbb75-0009-4fdc-9be5-1e34c563a84a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:02.543578 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abbb75-0009-4fdc-9be5-1e34c563a84a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:02.543853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abbb75-0009-4fdc-9be5-1e34c563a84a None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:02.544699 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abbb75-0009-4fdc-9be5-1e34c563a84a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:02.545007 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abbb75-0009-4fdc-9be5-1e34c563a84a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:02.546452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abbb75-0009-4fdc-9be5-1e34c563a84a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:02.553441 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9388d-620c-4ac8-a995-428a59466064 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:02.568548 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 339/661] 10.222.0.77 () {56 vars in 1139 bytes} [Wed May 11 06:42:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:02.569464 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abbb75-0009-4fdc-9be5-1e34c563a84a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:02.586805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617ba1e-cd09-4bb7-8875-4b077ed76f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:02.587507 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617ba1e-cd09-4bb7-8875-4b077ed76f99 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:02.587785 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617ba1e-cd09-4bb7-8875-4b077ed76f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:02.588060 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617ba1e-cd09-4bb7-8875-4b077ed76f99 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:02.588899 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617ba1e-cd09-4bb7-8875-4b077ed76f99 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:02.589204 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617ba1e-cd09-4bb7-8875-4b077ed76f99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:02.590651 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617ba1e-cd09-4bb7-8875-4b077ed76f99 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:02.607213 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 323/662] 10.222.0.77 () {56 vars in 1137 bytes} [Wed May 11 06:42:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:02.608027 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617ba1e-cd09-4bb7-8875-4b077ed76f99 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:02.669044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abbb75-0009-4fdc-9be5-1e34c563a84a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:02.701521 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c081e-f314-45ba-a17b-1a07b7c7aec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:02.702835 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c081e-f314-45ba-a17b-1a07b7c7aec0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:02.703159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c081e-f314-45ba-a17b-1a07b7c7aec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:02.703433 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c081e-f314-45ba-a17b-1a07b7c7aec0 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:02.704226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c081e-f314-45ba-a17b-1a07b7c7aec0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:02.704534 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c081e-f314-45ba-a17b-1a07b7c7aec0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:02.705852 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617ba1e-cd09-4bb7-8875-4b077ed76f99 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:02.705966 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c081e-f314-45ba-a17b-1a07b7c7aec0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:02.719056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 340/663] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:42:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:02.720512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975cbbf-2385-4c9b-a4d7-cccd54a36b4c None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:02.720796 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975cbbf-2385-4c9b-a4d7-cccd54a36b4c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:02.721067 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975cbbf-2385-4c9b-a4d7-cccd54a36b4c None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:02.726668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 341/664] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:02.726668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975cbbf-2385-4c9b-a4d7-cccd54a36b4c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:02.750527 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ff5a4-1270-4f7c-860d-2b2476488902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:02.751213 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ff5a4-1270-4f7c-860d-2b2476488902 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:02.751491 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ff5a4-1270-4f7c-860d-2b2476488902 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:02.751757 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ff5a4-1270-4f7c-860d-2b2476488902 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:02.816402 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ff5a4-1270-4f7c-860d-2b2476488902 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:02.817943 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ff5a4-1270-4f7c-860d-2b2476488902 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:02.825247 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975cbbf-2385-4c9b-a4d7-cccd54a36b4c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:02.856944 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a50a2d-816f-4225-aa1a-2e4d6cba50ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:02.857857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a50a2d-816f-4225-aa1a-2e4d6cba50ac None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:02.858140 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a50a2d-816f-4225-aa1a-2e4d6cba50ac None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:02.858415 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a50a2d-816f-4225-aa1a-2e4d6cba50ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:02.913213 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 324/665] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:42:02.913213 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ff5a4-1270-4f7c-860d-2b2476488902 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:02.922068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a50a2d-816f-4225-aa1a-2e4d6cba50ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:02.923595 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a50a2d-816f-4225-aa1a-2e4d6cba50ac None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:03.007027 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ff5a4-1270-4f7c-860d-2b2476488902 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:03.023974 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 342/666] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:42:03.023974 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2240af4-0493-44f6-a933-6408bf466157 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:03.023974 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2240af4-0493-44f6-a933-6408bf466157 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:03.023974 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2240af4-0493-44f6-a933-6408bf466157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:03.037038 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d2240af4-0493-44f6-a933-6408bf466157 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:03.038221 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d2240af4-0493-44f6-a933-6408bf466157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:03.047697 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf23f7-6ea8-40f1-a6e8-7cd2265f006f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:03.048356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf23f7-6ea8-40f1-a6e8-7cd2265f006f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:03.048631 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf23f7-6ea8-40f1-a6e8-7cd2265f006f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:03.048899 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf23f7-6ea8-40f1-a6e8-7cd2265f006f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:03.049730 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf23f7-6ea8-40f1-a6e8-7cd2265f006f None admin] RBAC: Adding query filter params (role.id=46d109e3a1bd4f13b0d145cde46c75a9, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=628e4779afa24fb187c4b10a3765af9a) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:03.050036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf23f7-6ea8-40f1-a6e8-7cd2265f006f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:03.051495 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf23f7-6ea8-40f1-a6e8-7cd2265f006f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:03.067368 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 325/667] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:42:02 2022] GET /identity/v3/role_assignments?user.id=628e4779afa24fb187c4b10a3765af9a&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=46d109e3a1bd4f13b0d145cde46c75a9 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:03.067368 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf23f7-6ea8-40f1-a6e8-7cd2265f006f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:03.139446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 343/668] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:42:03.140471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2240af4-0493-44f6-a933-6408bf466157 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:03.187833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf23f7-6ea8-40f1-a6e8-7cd2265f006f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:03.222637 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ce4c0-9fc3-419f-a739-2cfaa66b4da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:03.223477 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ce4c0-9fc3-419f-a739-2cfaa66b4da9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:03.223792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ce4c0-9fc3-419f-a739-2cfaa66b4da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:03.224071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ce4c0-9fc3-419f-a739-2cfaa66b4da9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:03.236244 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ce4c0-9fc3-419f-a739-2cfaa66b4da9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:03.237757 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ce4c0-9fc3-419f-a739-2cfaa66b4da9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:03.256502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-ea0ce4c0-9fc3-419f-a739-2cfaa66b4da9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:03.256502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:03.256502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:03.256502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:03.256502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:03.256502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:03.256502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:03.256502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:03.256502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:03.256502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:03.256502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:03.256502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:03.256502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:03.256502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:03.256502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:03.257544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:03.257544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:03.257544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:03.257544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:03.257544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:03.257544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:03.257544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:03.257544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:03.257544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:03.257544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:03.257544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:03.257544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:03.257544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:03.257544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:03.257544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:03.257544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:03.257544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:03.258449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:03.258449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:03.258449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:03.258449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:03.258449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 326/669] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:03.259211 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2240af4-0493-44f6-a933-6408bf466157 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:03.259315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ce4c0-9fc3-419f-a739-2cfaa66b4da9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:03.303998 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3f275-545a-4337-b4b3-4190578fa1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:03.304966 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3f275-545a-4337-b4b3-4190578fa1ac None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:03.305246 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3f275-545a-4337-b4b3-4190578fa1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:03.305812 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3f275-545a-4337-b4b3-4190578fa1ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:03.318857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3f275-545a-4337-b4b3-4190578fa1ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:03.320626 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3f275-545a-4337-b4b3-4190578fa1ac None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:03.340033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-21d3f275-545a-4337-b4b3-4190578fa1ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:03.340033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:03.340033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:03.340033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:03.340033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:03.340033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:03.340033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:03.340033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:03.340033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:03.340033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:03.340033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:03.340033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:03.340033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:03.340033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:03.340033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:03.341026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:03.341026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:03.341026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:03.341026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:03.341026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:03.341026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:03.341026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:03.341026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:03.341026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:03.341026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:03.341026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:03.341026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:03.341026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:03.341026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:03.341026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:03.341026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:03.341026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:03.343773 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:03.343773 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:03.343773 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:03.343773 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:03.343773 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 344/670] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:03.343773 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3f275-545a-4337-b4b3-4190578fa1ac None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:03.388601 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ce4c0-9fc3-419f-a739-2cfaa66b4da9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:03.432416 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5352ae-76e3-477b-935b-7683fe08d329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:03.433645 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5352ae-76e3-477b-935b-7683fe08d329 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:03.434289 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5352ae-76e3-477b-935b-7683fe08d329 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:03.435004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5352ae-76e3-477b-935b-7683fe08d329 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:03.448598 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5352ae-76e3-477b-935b-7683fe08d329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:42:03.458488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-4b5352ae-76e3-477b-935b-7683fe08d329 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:42:03.458488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:03.458488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:03.458488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:03.458488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:03.458488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:03.458488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:03.458488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:03.458488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:03.458488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:03.458488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:03.458488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:03.458488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:42:03.458488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:42:03.458488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:42:03.458488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:42:03.459496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:42:03.459496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:42:03.459496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:42:03.459496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:42:03.459496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:03.459496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:03.459496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:03.459496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:03.459496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:03.459496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:03.459496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:03.459496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:03.459496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:03.459496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:03.459496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:03.459496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:03.460379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:03.460379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:03.460379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:03.460379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:03.460379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:42:03.460379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:42:03.460379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:42:03.460379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:42:03.460379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:42:03.460379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:42:03.460379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:42:03.460379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:03.461535 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 327/671] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:42:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:03.471001 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5352ae-76e3-477b-935b-7683fe08d329 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:03.476552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3f275-545a-4337-b4b3-4190578fa1ac None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:03.520204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3064b-045f-44fe-86e0-d530058aa49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:03.520798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3064b-045f-44fe-86e0-d530058aa49e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:03.521074 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3064b-045f-44fe-86e0-d530058aa49e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:03.521341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3064b-045f-44fe-86e0-d530058aa49e None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:03.522071 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3064b-045f-44fe-86e0-d530058aa49e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:03.522374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3064b-045f-44fe-86e0-d530058aa49e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:03.523783 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3064b-045f-44fe-86e0-d530058aa49e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:03.535772 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 345/672] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:03.536483 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3064b-045f-44fe-86e0-d530058aa49e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:03.588949 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5352ae-76e3-477b-935b-7683fe08d329 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:03.625411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b48f5c-32a3-4834-aabc-1fee220a3eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:03.626203 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b48f5c-32a3-4834-aabc-1fee220a3eaa None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:03.626487 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b48f5c-32a3-4834-aabc-1fee220a3eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:03.626760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b48f5c-32a3-4834-aabc-1fee220a3eaa None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:03.627513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b48f5c-32a3-4834-aabc-1fee220a3eaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:03.627817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b48f5c-32a3-4834-aabc-1fee220a3eaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:03.629182 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b48f5c-32a3-4834-aabc-1fee220a3eaa None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:03.634640 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3064b-045f-44fe-86e0-d530058aa49e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:03.644888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 328/673] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:03.644888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b48f5c-32a3-4834-aabc-1fee220a3eaa None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:03.671877 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0d542-ff00-410d-9ff6-0a36d1432a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:03.672583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0d542-ff00-410d-9ff6-0a36d1432a53 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:03.672901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0d542-ff00-410d-9ff6-0a36d1432a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:03.673178 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0d542-ff00-410d-9ff6-0a36d1432a53 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:03.673924 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0d542-ff00-410d-9ff6-0a36d1432a53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:03.674226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0d542-ff00-410d-9ff6-0a36d1432a53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:03.675637 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0d542-ff00-410d-9ff6-0a36d1432a53 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:03.688277 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 346/674] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:42:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:03.688277 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26ed0b-e2e7-43a0-9fcd-3960db88f96f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:03.688277 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26ed0b-e2e7-43a0-9fcd-3960db88f96f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:03.688277 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26ed0b-e2e7-43a0-9fcd-3960db88f96f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:03.688277 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 347/675] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:03.688277 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26ed0b-e2e7-43a0-9fcd-3960db88f96f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:03.747725 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b48f5c-32a3-4834-aabc-1fee220a3eaa None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:03.780417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c38fb-f0e3-4805-a4f9-ccdfa23547f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:03.781149 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c38fb-f0e3-4805-a4f9-ccdfa23547f1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:03.781427 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c38fb-f0e3-4805-a4f9-ccdfa23547f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:03.781702 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c38fb-f0e3-4805-a4f9-ccdfa23547f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:03.787180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26ed0b-e2e7-43a0-9fcd-3960db88f96f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:03.788795 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c38fb-f0e3-4805-a4f9-ccdfa23547f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:03.790254 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c38fb-f0e3-4805-a4f9-ccdfa23547f1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:03.804106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-593c38fb-f0e3-4805-a4f9-ccdfa23547f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:03.804106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:03.804106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:03.804106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:03.804106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:03.804106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:03.804106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:03.804106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:03.804106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:03.804106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:03.804106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:03.804106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:03.804106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:42:03.804106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:42:03.804106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:42:03.805065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:42:03.805065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:03.805065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:03.805065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:03.805065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:03.805065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:03.805065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:03.805065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:03.805065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:03.805065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:03.805065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:03.805065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:03.805065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:03.805065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:03.805065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:03.805065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:03.805065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:03.805948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:42:03.805948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:42:03.805948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:42:03.805948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:42:03.805948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:42:03.805948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:42:03.805948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:03.805948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:03.810132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 329/676] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:03.810976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c38fb-f0e3-4805-a4f9-ccdfa23547f1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:03.821148 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101aac71-5feb-4e48-b074-67d0c9ac56e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:03.821943 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aac71-5feb-4e48-b074-67d0c9ac56e7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:03.822226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aac71-5feb-4e48-b074-67d0c9ac56e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:03.822484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aac71-5feb-4e48-b074-67d0c9ac56e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:03.829007 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101aac71-5feb-4e48-b074-67d0c9ac56e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:03.830450 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101aac71-5feb-4e48-b074-67d0c9ac56e7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:03.845213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-101aac71-5feb-4e48-b074-67d0c9ac56e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:03.845213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:03.845213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:03.845213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:03.845213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:03.845213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:03.845213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:03.845213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:03.845213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:03.845213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:03.845213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:03.845213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:03.845213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:42:03.845213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:42:03.845213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:42:03.846272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:42:03.846272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:03.846272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:03.846272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:03.846272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:03.846272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:03.846272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:03.846272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:03.846272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:03.846272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:03.846272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:03.846272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:03.846272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:03.846272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:03.846272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:03.846272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:03.846272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:03.847416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:42:03.847416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:42:03.847416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:42:03.847416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:42:03.847416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:42:03.847416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:42:03.847416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:03.847416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:03.851324 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 348/677] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:03.852583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386f238-2ea8-4c4b-89d9-e004829aab64 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:03.852874 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386f238-2ea8-4c4b-89d9-e004829aab64 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:03.853151 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386f238-2ea8-4c4b-89d9-e004829aab64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:03.871410 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6386f238-2ea8-4c4b-89d9-e004829aab64 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:03.873210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6386f238-2ea8-4c4b-89d9-e004829aab64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:03.911545 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c38fb-f0e3-4805-a4f9-ccdfa23547f1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:03.943020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 349/678] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:42:03.943020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386f238-2ea8-4c4b-89d9-e004829aab64 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:03.956268 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5bd8d-eb57-4e4e-8a88-773b105c50ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:03.957279 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5bd8d-eb57-4e4e-8a88-773b105c50ee None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:03.957558 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5bd8d-eb57-4e4e-8a88-773b105c50ee None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:03.957883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5bd8d-eb57-4e4e-8a88-773b105c50ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:03.970128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5bd8d-eb57-4e4e-8a88-773b105c50ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:03.971616 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5bd8d-eb57-4e4e-8a88-773b105c50ee None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:03.988178 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-a2c5bd8d-eb57-4e4e-8a88-773b105c50ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:03.988178 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:03.988178 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:03.988178 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:03.988178 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:03.988178 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:03.988178 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:03.988178 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:03.988178 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:03.988178 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:03.988178 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:03.988178 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:03.988178 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:03.988178 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:03.988178 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:03.989120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:03.989120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:03.989120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:03.989120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:03.989120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:03.989120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:03.989120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:03.989120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:03.989120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:03.989120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:03.989120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:03.989120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:03.989120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:03.989120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:03.989120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:03.989120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:03.989120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:03.990175 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:03.990175 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:03.990175 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:03.990175 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:03.990175 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 330/679] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:03.990459 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5bd8d-eb57-4e4e-8a88-773b105c50ee None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:04.042330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386f238-2ea8-4c4b-89d9-e004829aab64 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:04.075154 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097b4ba-9f01-4d5e-9703-f4c5bde8f811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:04.075825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097b4ba-9f01-4d5e-9703-f4c5bde8f811 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:04.076109 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097b4ba-9f01-4d5e-9703-f4c5bde8f811 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:04.076383 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097b4ba-9f01-4d5e-9703-f4c5bde8f811 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:04.077187 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097b4ba-9f01-4d5e-9703-f4c5bde8f811 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:04.077495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097b4ba-9f01-4d5e-9703-f4c5bde8f811 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:04.078945 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097b4ba-9f01-4d5e-9703-f4c5bde8f811 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:04.089275 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5bd8d-eb57-4e4e-8a88-773b105c50ee None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:04.091284 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 350/680] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:42:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:04.092953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097b4ba-9f01-4d5e-9703-f4c5bde8f811 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:04.121678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a53cd-18a6-4626-822b-1d978da9dcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:04.122335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a53cd-18a6-4626-822b-1d978da9dcd0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:04.122613 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a53cd-18a6-4626-822b-1d978da9dcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:04.122885 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a53cd-18a6-4626-822b-1d978da9dcd0 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:04.123696 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a53cd-18a6-4626-822b-1d978da9dcd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:04.124001 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a53cd-18a6-4626-822b-1d978da9dcd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:04.125432 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a53cd-18a6-4626-822b-1d978da9dcd0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:04.141549 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 331/681] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:42:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:04.141549 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a53cd-18a6-4626-822b-1d978da9dcd0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:04.190536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097b4ba-9f01-4d5e-9703-f4c5bde8f811 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:04.222148 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f82939-b288-4377-b2f0-85ea79a9acb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:04.222945 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f82939-b288-4377-b2f0-85ea79a9acb9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:04.223269 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f82939-b288-4377-b2f0-85ea79a9acb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:04.223542 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f82939-b288-4377-b2f0-85ea79a9acb9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:04.233584 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f82939-b288-4377-b2f0-85ea79a9acb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:42:04.235936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a53cd-18a6-4626-822b-1d978da9dcd0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:04.241337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f5f82939-b288-4377-b2f0-85ea79a9acb9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:42:04.241337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:04.241337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:04.241337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:04.241337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:04.241337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:04.241337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:04.241337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:04.241337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:04.241337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:04.241337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:04.241337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:04.241337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:42:04.241337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:42:04.241337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:42:04.241337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:42:04.242270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:42:04.242270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:42:04.242270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:42:04.242270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:42:04.242270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:04.242270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:04.242270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:04.242270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:04.242270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:04.242270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:04.242270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:04.242270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:04.242270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:04.242270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:04.242270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:04.242270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:04.243160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:04.243160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:04.243160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:04.243160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:04.243160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:42:04.243160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:42:04.243160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:42:04.243160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:42:04.243160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:42:04.243160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:42:04.243160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:42:04.243160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:04.247264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 351/682] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:42:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:04.248274 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f82939-b288-4377-b2f0-85ea79a9acb9 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:04.272971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e18553-7cfb-4fb5-a394-41b52f971db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:04.273860 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e18553-7cfb-4fb5-a394-41b52f971db4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:04.274140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e18553-7cfb-4fb5-a394-41b52f971db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:04.274413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e18553-7cfb-4fb5-a394-41b52f971db4 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:04.275166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e18553-7cfb-4fb5-a394-41b52f971db4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:04.275469 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e18553-7cfb-4fb5-a394-41b52f971db4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:04.276837 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e18553-7cfb-4fb5-a394-41b52f971db4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:04.287802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 332/683] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:04.288681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e18553-7cfb-4fb5-a394-41b52f971db4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:04.351652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f82939-b288-4377-b2f0-85ea79a9acb9 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:04.384027 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007d61d-90e3-4985-a9bd-18e266c61011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:04.384687 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007d61d-90e3-4985-a9bd-18e266c61011 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:04.384966 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007d61d-90e3-4985-a9bd-18e266c61011 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:04.385245 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007d61d-90e3-4985-a9bd-18e266c61011 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:04.386088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007d61d-90e3-4985-a9bd-18e266c61011 None admin] RBAC: Adding query filter params (role.id=46d109e3a1bd4f13b0d145cde46c75a9, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=3c92f4b777a644ad8055f15b1a8bd0be) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:04.386409 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007d61d-90e3-4985-a9bd-18e266c61011 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:04.387877 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007d61d-90e3-4985-a9bd-18e266c61011 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:04.390080 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e18553-7cfb-4fb5-a394-41b52f971db4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:04.399204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 352/684] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:42:04 2022] GET /identity/v3/role_assignments?user.id=3c92f4b777a644ad8055f15b1a8bd0be&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=46d109e3a1bd4f13b0d145cde46c75a9 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:04.399204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007d61d-90e3-4985-a9bd-18e266c61011 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:04.442776 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222c7d1-98fc-425e-a8e7-da6c1a50110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:04.443770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222c7d1-98fc-425e-a8e7-da6c1a50110e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:04.444049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222c7d1-98fc-425e-a8e7-da6c1a50110e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:04.444320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222c7d1-98fc-425e-a8e7-da6c1a50110e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:04.445343 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222c7d1-98fc-425e-a8e7-da6c1a50110e None admin] RBAC: Adding query filter params (role.id=46d109e3a1bd4f13b0d145cde46c75a9, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=281c923b01a143dbb79d8c0ea04f55b6) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:04.446504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222c7d1-98fc-425e-a8e7-da6c1a50110e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:04.448421 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222c7d1-98fc-425e-a8e7-da6c1a50110e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:04.456835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 333/685] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:42:04 2022] GET /identity/v3/role_assignments?user.id=281c923b01a143dbb79d8c0ea04f55b6&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=46d109e3a1bd4f13b0d145cde46c75a9 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:04.457784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222c7d1-98fc-425e-a8e7-da6c1a50110e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:04.523261 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007d61d-90e3-4985-a9bd-18e266c61011 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:04.579460 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde400a-e91d-4022-bce1-e8f481d2defc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:04.580093 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde400a-e91d-4022-bce1-e8f481d2defc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:04.580374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde400a-e91d-4022-bce1-e8f481d2defc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:04.580650 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde400a-e91d-4022-bce1-e8f481d2defc None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:04.581433 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde400a-e91d-4022-bce1-e8f481d2defc None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:04.581743 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde400a-e91d-4022-bce1-e8f481d2defc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:04.583267 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde400a-e91d-4022-bce1-e8f481d2defc None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:04.590603 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222c7d1-98fc-425e-a8e7-da6c1a50110e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:04.609361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 353/686] 10.222.0.77 () {56 vars in 1103 bytes} [Wed May 11 06:42:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:04.629845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde400a-e91d-4022-bce1-e8f481d2defc None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:04.655426 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d9752-987d-4409-9d6e-0562678b1021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:04.656258 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d9752-987d-4409-9d6e-0562678b1021 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:04.656538 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d9752-987d-4409-9d6e-0562678b1021 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:04.656816 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d9752-987d-4409-9d6e-0562678b1021 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:04.670701 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d9752-987d-4409-9d6e-0562678b1021 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:04.672318 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d9752-987d-4409-9d6e-0562678b1021 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:04.692615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-326d9752-987d-4409-9d6e-0562678b1021 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 06:42:04.692615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:04.692615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:04.692615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:04.692615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:04.692615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:04.692615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:04.692615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:04.692615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:04.692615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:04.692615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:04.692615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:04.692615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:42:04.692615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:42:04.692615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:42:04.692615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:42:04.694796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:04.694796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:04.694796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:42:04.694796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:04.694796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:42:04.694796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:04.694796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:04.694796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:04.694796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:04.694796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:04.694796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:04.694796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:04.694796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:04.694796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:04.694796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:04.694796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:04.694796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:04.694796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:04.697398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:04.697398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:04.697398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:42:04.697398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:42:04.697398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:42:04.697398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:42:04.697398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:42:04.697398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:42:04.697398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 06:42:04.697398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:04.697398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 334/687] 10.222.0.77 () {56 vars in 1093 bytes} [Wed May 11 06:42:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:04.701792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d9752-987d-4409-9d6e-0562678b1021 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:04.765270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde400a-e91d-4022-bce1-e8f481d2defc None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:04.799941 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27084186-a507-46c7-8a57-48441abfafbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:04.802801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27084186-a507-46c7-8a57-48441abfafbe None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:04.803323 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27084186-a507-46c7-8a57-48441abfafbe None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:04.803797 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27084186-a507-46c7-8a57-48441abfafbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:04.815795 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27084186-a507-46c7-8a57-48441abfafbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:04.817248 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27084186-a507-46c7-8a57-48441abfafbe None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:04.823299 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d9752-987d-4409-9d6e-0562678b1021 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:04.835867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-27084186-a507-46c7-8a57-48441abfafbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:04.835867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:04.835867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:04.835867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:04.835867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:04.835867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:04.835867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:04.835867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:04.835867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:04.835867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:04.835867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:04.835867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:04.835867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:04.835867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:04.835867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:04.836777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:04.836777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:04.836777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:04.836777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:04.836777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:04.836777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:04.836777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:04.836777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:04.836777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:04.836777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:04.836777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:04.836777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:04.836777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:04.836777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:04.836777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:04.836777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:04.836777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:04.837689 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:04.837689 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:04.837689 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:04.837689 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:04.839697 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 354/688] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:04.846354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27084186-a507-46c7-8a57-48441abfafbe None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:04.869892 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f9018-d76e-4a50-8bab-c344cdf68083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:04.870567 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f9018-d76e-4a50-8bab-c344cdf68083 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:04.870843 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f9018-d76e-4a50-8bab-c344cdf68083 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:04.871142 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f9018-d76e-4a50-8bab-c344cdf68083 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:04.871987 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f9018-d76e-4a50-8bab-c344cdf68083 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:04.872291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f9018-d76e-4a50-8bab-c344cdf68083 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:04.873742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f9018-d76e-4a50-8bab-c344cdf68083 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:04.907345 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 335/689] 10.222.0.77 () {56 vars in 1133 bytes} [Wed May 11 06:42:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:04.913907 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f9018-d76e-4a50-8bab-c344cdf68083 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:05.002939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27084186-a507-46c7-8a57-48441abfafbe None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:05.061995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd7b15-479f-4fe8-b747-15de2ff6470a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:05.062667 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd7b15-479f-4fe8-b747-15de2ff6470a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:05.062942 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd7b15-479f-4fe8-b747-15de2ff6470a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:05.063236 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd7b15-479f-4fe8-b747-15de2ff6470a None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:05.063960 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd7b15-479f-4fe8-b747-15de2ff6470a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:05.064257 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd7b15-479f-4fe8-b747-15de2ff6470a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:05.065638 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd7b15-479f-4fe8-b747-15de2ff6470a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:05.083781 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f9018-d76e-4a50-8bab-c344cdf68083 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:05.088330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 355/690] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:05.093824 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd7b15-479f-4fe8-b747-15de2ff6470a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:05.130158 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cc938-37de-45c6-a857-3f58b1efc10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:05.130811 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cc938-37de-45c6-a857-3f58b1efc10f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:05.131120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cc938-37de-45c6-a857-3f58b1efc10f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:05.131394 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cc938-37de-45c6-a857-3f58b1efc10f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:05.225226 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cc938-37de-45c6-a857-3f58b1efc10f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:05.226708 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cc938-37de-45c6-a857-3f58b1efc10f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:05.261424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd7b15-479f-4fe8-b747-15de2ff6470a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:05.305499 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdcf46-c116-4660-9cf2-615c85221554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:05.306331 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdcf46-c116-4660-9cf2-615c85221554 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:05.306611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdcf46-c116-4660-9cf2-615c85221554 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:05.306891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdcf46-c116-4660-9cf2-615c85221554 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:05.325864 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdcf46-c116-4660-9cf2-615c85221554 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:05.327402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdcf46-c116-4660-9cf2-615c85221554 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:05.361203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-3dcdcf46-c116-4660-9cf2-615c85221554 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 06:42:05.361203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:05.361203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:05.361203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:05.361203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:05.361203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:05.361203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:05.361203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:05.361203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:05.361203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:05.361203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:05.361203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:05.361203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:42:05.361203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:42:05.361203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:42:05.361203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:42:05.362204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:05.362204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:05.362204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:42:05.362204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:05.362204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:42:05.362204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:05.362204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:05.362204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:05.362204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:05.362204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:05.362204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:05.362204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:05.362204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:05.362204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:05.362204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:05.362204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:05.362204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:05.362204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:05.363205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:05.363205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:05.363205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:42:05.363205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:42:05.363205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:42:05.363205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:42:05.363205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:42:05.363205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:42:05.363205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 06:42:05.363205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:05.363205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 356/691] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:42:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:05.370003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdcf46-c116-4660-9cf2-615c85221554 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:05.405712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 336/692] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:42:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 06:42:05.411293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cc938-37de-45c6-a857-3f58b1efc10f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:05.477681 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdcf46-c116-4660-9cf2-615c85221554 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:05.516572 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48079ad-eb72-40c0-a76d-6929d7952917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:05.517259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48079ad-eb72-40c0-a76d-6929d7952917 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:05.517535 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48079ad-eb72-40c0-a76d-6929d7952917 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:05.517803 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48079ad-eb72-40c0-a76d-6929d7952917 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:05.518646 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48079ad-eb72-40c0-a76d-6929d7952917 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:05.518996 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48079ad-eb72-40c0-a76d-6929d7952917 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:05.520792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48079ad-eb72-40c0-a76d-6929d7952917 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:05.540974 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 357/693] 10.222.0.77 () {56 vars in 1135 bytes} [Wed May 11 06:42:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:05.543057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242a1c0-5367-43c6-b53b-a72f6c96b383 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:05.543351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242a1c0-5367-43c6-b53b-a72f6c96b383 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:05.543622 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242a1c0-5367-43c6-b53b-a72f6c96b383 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:05.545618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 358/694] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:05.547130 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242a1c0-5367-43c6-b53b-a72f6c96b383 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:05.585180 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cc938-37de-45c6-a857-3f58b1efc10f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:05.618209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a13536-8b5c-46ac-90cb-c176b963fc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:05.618952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a13536-8b5c-46ac-90cb-c176b963fc1d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:05.619225 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a13536-8b5c-46ac-90cb-c176b963fc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:05.619499 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a13536-8b5c-46ac-90cb-c176b963fc1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:05.629540 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a13536-8b5c-46ac-90cb-c176b963fc1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:05.631160 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a13536-8b5c-46ac-90cb-c176b963fc1d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:05.651096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-27a13536-8b5c-46ac-90cb-c176b963fc1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:05.651096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:05.651096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:05.651096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:05.651096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:05.651096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:05.651096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:05.651096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:05.651096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:05.651096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:05.651096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:05.651096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:05.651096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:05.651096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:05.651096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:05.652024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:05.652024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:05.652024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:05.652024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:05.652024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:05.652024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:05.652024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:05.652024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:05.652024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:05.652024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:05.652024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:05.652024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:05.652024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:05.652024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:05.652024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:05.652024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:05.652024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:05.652952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:05.652952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:05.652952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:05.652952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:05.652952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 337/695] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:05.656204 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f05d36-d130-4faa-9480-6d2e143ff6b1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:05.656204 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f05d36-d130-4faa-9480-6d2e143ff6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:05.656204 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f05d36-d130-4faa-9480-6d2e143ff6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:05.664091 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242a1c0-5367-43c6-b53b-a72f6c96b383 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:05.670453 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f0f05d36-d130-4faa-9480-6d2e143ff6b1 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:05.671791 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f0f05d36-d130-4faa-9480-6d2e143ff6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:05.704117 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae335d7-75cc-4742-8da7-90e66bb026df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:05.704850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae335d7-75cc-4742-8da7-90e66bb026df None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:05.705090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae335d7-75cc-4742-8da7-90e66bb026df None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:05.705363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae335d7-75cc-4742-8da7-90e66bb026df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:05.745749 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 338/696] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:42:05.746657 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f05d36-d130-4faa-9480-6d2e143ff6b1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:05.793467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae335d7-75cc-4742-8da7-90e66bb026df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:05.795012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae335d7-75cc-4742-8da7-90e66bb026df None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:05.845222 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f05d36-d130-4faa-9480-6d2e143ff6b1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:05.879668 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa723269-adae-4dca-872e-b25b6575ba2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:05.880262 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa723269-adae-4dca-872e-b25b6575ba2d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:05.880539 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa723269-adae-4dca-872e-b25b6575ba2d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:05.881225 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa723269-adae-4dca-872e-b25b6575ba2d None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:05.882244 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa723269-adae-4dca-872e-b25b6575ba2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:05.882551 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa723269-adae-4dca-872e-b25b6575ba2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:05.884435 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa723269-adae-4dca-872e-b25b6575ba2d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:05.893294 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 359/697] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:42:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:42:05.894209 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae335d7-75cc-4742-8da7-90e66bb026df None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:05.898844 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 339/698] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:05.899712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa723269-adae-4dca-872e-b25b6575ba2d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:06.004229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae335d7-75cc-4742-8da7-90e66bb026df None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:06.014446 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa723269-adae-4dca-872e-b25b6575ba2d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:06.045968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb0bd1-87ee-4deb-9a4d-49717eb543f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:06.046836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb0bd1-87ee-4deb-9a4d-49717eb543f2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:06.047209 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb0bd1-87ee-4deb-9a4d-49717eb543f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:06.047559 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb0bd1-87ee-4deb-9a4d-49717eb543f2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:06.048278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb0bd1-87ee-4deb-9a4d-49717eb543f2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:06.049044 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b1a1-d51e-4e5b-b8d1-64f8e09bd5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:06.049784 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb0bd1-87ee-4deb-9a4d-49717eb543f2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:06.050244 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b1a1-d51e-4e5b-b8d1-64f8e09bd5ee None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:06.050584 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b1a1-d51e-4e5b-b8d1-64f8e09bd5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:06.050922 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b1a1-d51e-4e5b-b8d1-64f8e09bd5ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:06.061656 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3b1a1-d51e-4e5b-b8d1-64f8e09bd5ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:06.063274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3b1a1-d51e-4e5b-b8d1-64f8e09bd5ee None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:06.067009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-82eb0bd1-87ee-4deb-9a4d-49717eb543f2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 06:42:06.067009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:06.067009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:06.067009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:06.067009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:06.067009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:06.067009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:06.067009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:06.067009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 06:42:06.067009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:06.067009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:06.067009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:06.067009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:06.067009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:06.067009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:06.067009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:06.068002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:06.068002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:06.068002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:06.068002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:06.068002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:06.068002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:06.068002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:06.068002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:06.068002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:06.068002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:06.068002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:06.068002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:06.068002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:06.068002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:06.068002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:06.068002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:06.068853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:06.068853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:06.068853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:06.068853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:06.068853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:06.068853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:06.068853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:06.068853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:06.068853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:06.068853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:06.068853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:06.068853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:06.068853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:06.068853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 06:42:06.068853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:06.077019 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 360/699] 10.222.0.77 () {56 vars in 1129 bytes} [Wed May 11 06:42:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:06.077836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb0bd1-87ee-4deb-9a4d-49717eb543f2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:06.086881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-dec3b1a1-d51e-4e5b-b8d1-64f8e09bd5ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:06.086881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:06.086881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:06.086881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:06.086881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:06.086881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:06.086881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:06.086881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:06.086881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:06.086881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:06.086881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:06.086881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:06.086881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:06.086881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:06.086881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:06.087945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:06.087945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:06.087945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:06.087945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:06.087945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:06.087945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:06.087945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:06.087945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:06.087945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:06.087945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:06.087945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:06.087945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:06.087945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:06.087945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:06.087945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:06.087945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:06.087945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:06.088837 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:06.088837 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:06.088837 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:06.088837 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:06.092780 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 340/700] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:06.093708 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b1a1-d51e-4e5b-b8d1-64f8e09bd5ee None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:06.185231 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb0bd1-87ee-4deb-9a4d-49717eb543f2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:06.190139 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b1a1-d51e-4e5b-b8d1-64f8e09bd5ee None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:06.218431 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bec2a-97c7-4797-b6ed-0866fc15f1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:06.219590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bec2a-97c7-4797-b6ed-0866fc15f1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:06.220071 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bec2a-97c7-4797-b6ed-0866fc15f1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:06.220537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bec2a-97c7-4797-b6ed-0866fc15f1b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:06.223710 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f4708-b59c-4b07-9ede-d324ed2e60c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:06.224296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f4708-b59c-4b07-9ede-d324ed2e60c2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:06.224573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f4708-b59c-4b07-9ede-d324ed2e60c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:06.224846 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f4708-b59c-4b07-9ede-d324ed2e60c2 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:06.225544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f4708-b59c-4b07-9ede-d324ed2e60c2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:06.225846 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f4708-b59c-4b07-9ede-d324ed2e60c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:06.227240 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f4708-b59c-4b07-9ede-d324ed2e60c2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:06.229207 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bec2a-97c7-4797-b6ed-0866fc15f1b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:06.230858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bec2a-97c7-4797-b6ed-0866fc15f1b6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:06.236101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 341/701] 10.222.0.77 () {56 vars in 1124 bytes} [Wed May 11 06:42:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:06.236101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f4708-b59c-4b07-9ede-d324ed2e60c2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:06.250330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-7a2bec2a-97c7-4797-b6ed-0866fc15f1b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:06.250330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:06.250330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:06.250330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:06.250330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:06.250330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:06.250330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:06.250330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:06.250330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:06.250330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:06.250330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:06.250330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:06.250330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:42:06.250330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:42:06.250330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:42:06.251258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:42:06.251258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:06.251258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:06.251258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:06.251258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:06.251258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:06.251258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:06.251258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:06.251258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:06.251258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:06.251258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:06.251258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:06.251258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:06.251258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:06.251258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:06.251258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:06.251258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:06.252167 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:42:06.252167 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:42:06.252167 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:42:06.252167 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:42:06.252167 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:42:06.252167 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:42:06.252167 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:06.252167 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:06.254633 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 361/702] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:06.255728 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bec2a-97c7-4797-b6ed-0866fc15f1b6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:06.335263 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f4708-b59c-4b07-9ede-d324ed2e60c2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:06.353406 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bec2a-97c7-4797-b6ed-0866fc15f1b6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:06.368806 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac652631-8e23-4db2-80ea-03eb3e29d4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:06.369514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac652631-8e23-4db2-80ea-03eb3e29d4cf None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:06.369749 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac652631-8e23-4db2-80ea-03eb3e29d4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:06.370026 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac652631-8e23-4db2-80ea-03eb3e29d4cf None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:06.370750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac652631-8e23-4db2-80ea-03eb3e29d4cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:06.371095 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac652631-8e23-4db2-80ea-03eb3e29d4cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:06.372642 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac652631-8e23-4db2-80ea-03eb3e29d4cf None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:06.389026 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 342/703] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:06.389517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c5efa-7d60-472b-a01a-5948dd1f29c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:06.389922 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac652631-8e23-4db2-80ea-03eb3e29d4cf None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:06.390654 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c5efa-7d60-472b-a01a-5948dd1f29c3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:06.391192 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c5efa-7d60-472b-a01a-5948dd1f29c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:06.391682 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c5efa-7d60-472b-a01a-5948dd1f29c3 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:06.392588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c5efa-7d60-472b-a01a-5948dd1f29c3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:06.393105 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c5efa-7d60-472b-a01a-5948dd1f29c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:06.394689 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c5efa-7d60-472b-a01a-5948dd1f29c3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:06.407103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 362/704] 10.222.0.77 () {56 vars in 1124 bytes} [Wed May 11 06:42:06 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:06.408444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c5efa-7d60-472b-a01a-5948dd1f29c3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:06.521263 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac652631-8e23-4db2-80ea-03eb3e29d4cf None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:06.538268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c5efa-7d60-472b-a01a-5948dd1f29c3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:06.573914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38acc9-5c7b-4bf9-8e93-0c3e0189d6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:06.575188 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38acc9-5c7b-4bf9-8e93-0c3e0189d6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:06.575801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38acc9-5c7b-4bf9-8e93-0c3e0189d6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:06.576357 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38acc9-5c7b-4bf9-8e93-0c3e0189d6e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:06.578632 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358565b-fa19-420b-ab96-8c3e58f704ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:06.579336 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358565b-fa19-420b-ab96-8c3e58f704ea None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:06.579613 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358565b-fa19-420b-ab96-8c3e58f704ea None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:06.579884 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358565b-fa19-420b-ab96-8c3e58f704ea None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:06.580843 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358565b-fa19-420b-ab96-8c3e58f704ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:06.581049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358565b-fa19-420b-ab96-8c3e58f704ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:06.582480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358565b-fa19-420b-ab96-8c3e58f704ea None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:06.585889 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38acc9-5c7b-4bf9-8e93-0c3e0189d6e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:06.587613 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38acc9-5c7b-4bf9-8e93-0c3e0189d6e6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:06.603155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-4b38acc9-5c7b-4bf9-8e93-0c3e0189d6e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:06.603155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:06.603155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:06.603155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:06.603155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:06.603155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:06.603155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:06.603155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:06.603155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:06.603155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:06.603155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:06.603155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:06.603155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:42:06.603155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:42:06.603155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:42:06.604143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:42:06.604143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:06.604143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:06.604143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:06.604143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:06.604143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:06.604143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:06.604143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:06.604143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:06.604143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:06.604143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:06.604143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:06.604143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:06.604143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:06.604143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:06.604143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:06.604143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:06.605048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:42:06.605048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:42:06.605048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:42:06.605048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:42:06.605048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:42:06.605048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:42:06.605048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:06.605048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:06.606829 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 343/705] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:42:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:06.607849 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 363/706] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:06.612586 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358565b-fa19-420b-ab96-8c3e58f704ea None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:06.613229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38acc9-5c7b-4bf9-8e93-0c3e0189d6e6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:06.719364 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38acc9-5c7b-4bf9-8e93-0c3e0189d6e6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:06.760698 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba82d4-a417-4dff-b410-c6c2a1ae0cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:06.761921 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba82d4-a417-4dff-b410-c6c2a1ae0cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:06.762878 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba82d4-a417-4dff-b410-c6c2a1ae0cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:06.763402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba82d4-a417-4dff-b410-c6c2a1ae0cf4 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:06.764645 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba82d4-a417-4dff-b410-c6c2a1ae0cf4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:06.765316 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba82d4-a417-4dff-b410-c6c2a1ae0cf4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:06.767833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba82d4-a417-4dff-b410-c6c2a1ae0cf4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:06.788778 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 364/707] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:42:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:06.794663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba82d4-a417-4dff-b410-c6c2a1ae0cf4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:06.812550 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358565b-fa19-420b-ab96-8c3e58f704ea None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:06.879802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca61414-52a5-4d96-a7bf-0b7fe8353d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:06.880507 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca61414-52a5-4d96-a7bf-0b7fe8353d51 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:06.880790 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca61414-52a5-4d96-a7bf-0b7fe8353d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:06.881063 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca61414-52a5-4d96-a7bf-0b7fe8353d51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:06.881932 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca61414-52a5-4d96-a7bf-0b7fe8353d51 None admin] RBAC: Adding query filter params (role.id=5debd8ad07a74bedbf2efd53b11cd7cd, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=edf9d57de89a4701ba1a5b079d0ad348) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:06.882234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca61414-52a5-4d96-a7bf-0b7fe8353d51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:06.883737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca61414-52a5-4d96-a7bf-0b7fe8353d51 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:06.901494 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 344/708] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:42:06 2022] GET /identity/v3/role_assignments?user.id=edf9d57de89a4701ba1a5b079d0ad348&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=5debd8ad07a74bedbf2efd53b11cd7cd => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:06.903053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba82d4-a417-4dff-b410-c6c2a1ae0cf4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:06.940638 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9223e4-2309-4126-9ce4-9260cbdef985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:06.941763 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9223e4-2309-4126-9ce4-9260cbdef985 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:06.942245 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9223e4-2309-4126-9ce4-9260cbdef985 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:06.942768 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9223e4-2309-4126-9ce4-9260cbdef985 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:06.943871 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9223e4-2309-4126-9ce4-9260cbdef985 None admin] RBAC: Adding query filter params (role.id=46d109e3a1bd4f13b0d145cde46c75a9, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=f726f58d30734be7abf15400bff89533) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:06.944403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9223e4-2309-4126-9ce4-9260cbdef985 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:06.946486 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9223e4-2309-4126-9ce4-9260cbdef985 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:06.954020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 365/709] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:42:06 2022] GET /identity/v3/role_assignments?user.id=f726f58d30734be7abf15400bff89533&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=46d109e3a1bd4f13b0d145cde46c75a9 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:07.037409 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f15d8-3aa8-4985-afac-55aca50855de None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:07.037788 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f15d8-3aa8-4985-afac-55aca50855de None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:07.037951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f15d8-3aa8-4985-afac-55aca50855de None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:07.039819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 345/710] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:07.046037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112ac46-3bb5-4111-b6f1-74c34d75cbac None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:07.046354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112ac46-3bb5-4111-b6f1-74c34d75cbac None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:07.046586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112ac46-3bb5-4111-b6f1-74c34d75cbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:07.073387 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b112ac46-3bb5-4111-b6f1-74c34d75cbac None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:07.074617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b112ac46-3bb5-4111-b6f1-74c34d75cbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:07.118644 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56e7b9-76a2-45c2-bdf7-7a3193266a87 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:07.119036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56e7b9-76a2-45c2-bdf7-7a3193266a87 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:07.119221 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56e7b9-76a2-45c2-bdf7-7a3193266a87 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:07.120794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 346/711] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:42:07.126767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bb881-80fe-4784-ac15-23c96b84810b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:07.127431 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bb881-80fe-4784-ac15-23c96b84810b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:07.127907 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bb881-80fe-4784-ac15-23c96b84810b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:07.159960 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5e3bb881-80fe-4784-ac15-23c96b84810b None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:07.164406 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5e3bb881-80fe-4784-ac15-23c96b84810b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:07.166355 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 366/712] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:42:07.194126 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112ac46-3bb5-4111-b6f1-74c34d75cbac None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:07.282913 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 347/713] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:42:07.307933 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bb881-80fe-4784-ac15-23c96b84810b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:07.325864 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112ac46-3bb5-4111-b6f1-74c34d75cbac None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:07.373579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bcc9a-7615-45a9-af95-28fe410551ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:07.374394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bcc9a-7615-45a9-af95-28fe410551ca None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:07.374676 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bcc9a-7615-45a9-af95-28fe410551ca None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:07.374950 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bcc9a-7615-45a9-af95-28fe410551ca None admin] PATH_INFO: `/v3/services/network` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:07.375723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bcc9a-7615-45a9-af95-28fe410551ca None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:07.377114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bcc9a-7615-45a9-af95-28fe410551ca None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:07.390517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-597bcc9a-7615-45a9-af95-28fe410551ca None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 06:42:07.390517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:07.390517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:07.390517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:07.390517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:07.390517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:07.390517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:07.390517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:07.390517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 06:42:07.390517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:07.390517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:07.390517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:07.390517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:07.390517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:07.390517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:07.390517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:07.390517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:07.391580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:07.391580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:07.391580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:07.391580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:07.391580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:07.391580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:07.391580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:07.391580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:07.391580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:07.391580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:07.391580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:07.391580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:07.391580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:07.391580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:07.391580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:07.391580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:07.392418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:07.392418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:07.392418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:07.392418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:07.392418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:07.392418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:07.392418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:07.392418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:07.392418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:07.392418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:07.392418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:07.392418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:07.392418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 06:42:07.392418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:07.393683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 367/714] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:07 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:07.400580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bcc9a-7615-45a9-af95-28fe410551ca None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:07.435041 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bb881-80fe-4784-ac15-23c96b84810b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:07.477197 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe1856-a167-4e9d-8421-598105b5326c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:07.477851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe1856-a167-4e9d-8421-598105b5326c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:07.478146 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe1856-a167-4e9d-8421-598105b5326c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:07.478407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe1856-a167-4e9d-8421-598105b5326c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:07.492448 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe1856-a167-4e9d-8421-598105b5326c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:07.493755 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe1856-a167-4e9d-8421-598105b5326c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:07.513216 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bcc9a-7615-45a9-af95-28fe410551ca None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:07.515703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-eafe1856-a167-4e9d-8421-598105b5326c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:07.515703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:07.515703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:07.515703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:07.515703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:07.515703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:07.515703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:07.515703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:07.515703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:07.515703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:07.515703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:07.515703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:07.515703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:07.515703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:07.515703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:07.516627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:07.516627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:07.516627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:07.516627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:07.516627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:07.516627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:07.516627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:07.516627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:07.516627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:07.516627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:07.516627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:07.516627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:07.516627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:07.516627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:07.516627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:07.516627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:07.516627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:07.517551 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:07.517551 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:07.517551 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:07.517551 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:07.520631 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 348/715] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:07.524276 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe1856-a167-4e9d-8421-598105b5326c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:07.556777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836da3b-60cd-4225-acb1-85e5010de399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:07.557376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836da3b-60cd-4225-acb1-85e5010de399 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:07.557656 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836da3b-60cd-4225-acb1-85e5010de399 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:07.557935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836da3b-60cd-4225-acb1-85e5010de399 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:07.558651 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836da3b-60cd-4225-acb1-85e5010de399 None admin] RBAC: Adding query filter params (name=network) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:07.558998 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836da3b-60cd-4225-acb1-85e5010de399 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:07.560370 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836da3b-60cd-4225-acb1-85e5010de399 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:07.567307 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 368/716] 10.222.0.77 () {56 vars in 1112 bytes} [Wed May 11 06:42:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:07.573177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836da3b-60cd-4225-acb1-85e5010de399 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:07.650775 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe1856-a167-4e9d-8421-598105b5326c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:07.689509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836da3b-60cd-4225-acb1-85e5010de399 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:07.708302 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34325ae6-98c0-4cd1-885e-2c59a91c55c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:07.709035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34325ae6-98c0-4cd1-885e-2c59a91c55c2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:07.709313 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34325ae6-98c0-4cd1-885e-2c59a91c55c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:07.709583 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34325ae6-98c0-4cd1-885e-2c59a91c55c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:07.710315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34325ae6-98c0-4cd1-885e-2c59a91c55c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:07.710674 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34325ae6-98c0-4cd1-885e-2c59a91c55c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:07.712082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34325ae6-98c0-4cd1-885e-2c59a91c55c2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:07.736712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 349/717] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:07.742288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34325ae6-98c0-4cd1-885e-2c59a91c55c2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:07.758267 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3721f1-7bac-4a3e-8d89-aa68006119f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:07.759019 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3721f1-7bac-4a3e-8d89-aa68006119f8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:07.759304 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3721f1-7bac-4a3e-8d89-aa68006119f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:07.759579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3721f1-7bac-4a3e-8d89-aa68006119f8 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:07.760296 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3721f1-7bac-4a3e-8d89-aa68006119f8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:07.760697 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3721f1-7bac-4a3e-8d89-aa68006119f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:07.762262 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3721f1-7bac-4a3e-8d89-aa68006119f8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:07.770873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 369/718] 10.222.0.77 () {56 vars in 1112 bytes} [Wed May 11 06:42:07 2022] GET /identity/v3/services?type=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:07.877527 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34325ae6-98c0-4cd1-885e-2c59a91c55c2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:07.924368 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03683e-8088-4d75-9585-b7804f75c718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:07.925062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03683e-8088-4d75-9585-b7804f75c718 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:07.925345 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03683e-8088-4d75-9585-b7804f75c718 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:07.925616 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03683e-8088-4d75-9585-b7804f75c718 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:07.926347 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03683e-8088-4d75-9585-b7804f75c718 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:07.927881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03683e-8088-4d75-9585-b7804f75c718 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:07.966059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 350/719] 10.222.0.77 () {60 vars in 1132 bytes} [Wed May 11 06:42:07 2022] POST /identity/v3/users => generated 254 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:42:09.345101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a177b-550f-4154-a42d-96236f138de6 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:09.345654 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a177b-550f-4154-a42d-96236f138de6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:09.345654 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a177b-550f-4154-a42d-96236f138de6 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:09.347311 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 370/720] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:09.353010 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993e0b8-43dd-4309-b396-8ecbfa8a2036 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:09.354012 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993e0b8-43dd-4309-b396-8ecbfa8a2036 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:09.354491 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993e0b8-43dd-4309-b396-8ecbfa8a2036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:09.377582 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3993e0b8-43dd-4309-b396-8ecbfa8a2036 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:09.378718 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a131dd-96b3-45fe-8d3b-37cc668752d9 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:09.378877 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3993e0b8-43dd-4309-b396-8ecbfa8a2036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:09.379411 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a131dd-96b3-45fe-8d3b-37cc668752d9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:09.379957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a131dd-96b3-45fe-8d3b-37cc668752d9 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:09.387048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 371/721] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:09.396717 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add36a1d-cee1-473b-b871-ab488159cdd6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:09.397291 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add36a1d-cee1-473b-b871-ab488159cdd6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:09.397790 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add36a1d-cee1-473b-b871-ab488159cdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:09.432020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-add36a1d-cee1-473b-b871-ab488159cdd6 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:09.433219 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-add36a1d-cee1-473b-b871-ab488159cdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:09.450629 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 351/722] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:42:09.481050 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993e0b8-43dd-4309-b396-8ecbfa8a2036 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:09.561671 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 372/723] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 11 06:42:09.594968 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993e0b8-43dd-4309-b396-8ecbfa8a2036 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:09.626320 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add36a1d-cee1-473b-b871-ab488159cdd6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:09.634374 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f153cf-dcdd-43bb-84b2-1d5a6756370f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:09.635077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f153cf-dcdd-43bb-84b2-1d5a6756370f None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:09.635355 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f153cf-dcdd-43bb-84b2-1d5a6756370f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:09.635627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f153cf-dcdd-43bb-84b2-1d5a6756370f None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:09.636345 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f153cf-dcdd-43bb-84b2-1d5a6756370f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:09.638153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f153cf-dcdd-43bb-84b2-1d5a6756370f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:09.659161 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 352/724] 10.222.0.77 () {60 vars in 1141 bytes} [Wed May 11 06:42:09 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:42:09.752486 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add36a1d-cee1-473b-b871-ab488159cdd6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:09.795247 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b8e7f-fbbb-446e-87d4-a7d8dbb9bfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:09.796183 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b8e7f-fbbb-446e-87d4-a7d8dbb9bfec None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:09.796511 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b8e7f-fbbb-446e-87d4-a7d8dbb9bfec None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:09.796783 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b8e7f-fbbb-446e-87d4-a7d8dbb9bfec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:09.810187 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b8e7f-fbbb-446e-87d4-a7d8dbb9bfec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:42:09.816448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-492b8e7f-fbbb-446e-87d4-a7d8dbb9bfec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:42:09.816448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:09.816448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:09.816448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:09.816448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:09.816448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:09.816448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:09.816448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:09.816448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:09.816448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:09.816448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:09.816448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:09.816448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:42:09.816448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:42:09.816448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:42:09.816448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:42:09.818724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:42:09.818724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:42:09.818724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:42:09.818724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:42:09.818724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:09.818724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:09.818724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:09.818724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:09.818724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:09.818724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:09.818724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:09.818724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:09.818724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:09.818724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:09.818724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:09.818724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:09.821112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:09.821112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:09.821112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:09.821112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:09.821112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:42:09.821112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:42:09.821112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:42:09.821112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:42:09.821112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:42:09.821112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:42:09.821112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:42:09.821112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:09.821112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 373/725] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:42:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:09.828787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f153cf-dcdd-43bb-84b2-1d5a6756370f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:09.935591 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f153cf-dcdd-43bb-84b2-1d5a6756370f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:09.972655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819d4fc-6d40-473e-a612-3b274cf1f712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:09.973364 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819d4fc-6d40-473e-a612-3b274cf1f712 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:09.973684 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819d4fc-6d40-473e-a612-3b274cf1f712 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:09.973954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819d4fc-6d40-473e-a612-3b274cf1f712 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:09.974718 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819d4fc-6d40-473e-a612-3b274cf1f712 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:09.975139 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819d4fc-6d40-473e-a612-3b274cf1f712 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:09.976581 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819d4fc-6d40-473e-a612-3b274cf1f712 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:09.986895 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 353/726] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:42:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:09.992825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b8e7f-fbbb-446e-87d4-a7d8dbb9bfec None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:10.095738 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b8e7f-fbbb-446e-87d4-a7d8dbb9bfec None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:10.128972 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178f801-c757-45f8-8db1-02613546bd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:10.129841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178f801-c757-45f8-8db1-02613546bd85 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:10.130115 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178f801-c757-45f8-8db1-02613546bd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:10.130382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178f801-c757-45f8-8db1-02613546bd85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:10.140953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178f801-c757-45f8-8db1-02613546bd85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:10.142407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178f801-c757-45f8-8db1-02613546bd85 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:10.159399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-6178f801-c757-45f8-8db1-02613546bd85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:10.159399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:10.159399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:10.159399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:10.159399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:10.159399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:10.159399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:10.159399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:10.159399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:10.159399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:10.159399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:10.159399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:10.159399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:10.159399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:10.159399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:10.161529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:10.161529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:10.161529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:10.161529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:10.161529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:10.161529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:10.161529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:10.161529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:10.161529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:10.161529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:10.161529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:10.161529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:10.161529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:10.161529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:10.161529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:10.161529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:10.161529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:10.163273 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:10.163273 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:10.163273 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:10.163273 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:10.163273 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 374/727] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:10.169199 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819d4fc-6d40-473e-a612-3b274cf1f712 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:10.196637 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705f8d4-a7f4-48df-a8ec-8fd841d5d58b None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:10.196956 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705f8d4-a7f4-48df-a8ec-8fd841d5d58b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:10.197178 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705f8d4-a7f4-48df-a8ec-8fd841d5d58b None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:10.199518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 375/728] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:42:10.209682 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9367f-cbc3-47ff-be5e-f8c6957e5409 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:10.209964 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9367f-cbc3-47ff-be5e-f8c6957e5409 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:10.210221 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9367f-cbc3-47ff-be5e-f8c6957e5409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:10.227730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b1c9367f-cbc3-47ff-be5e-f8c6957e5409 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:10.228907 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b1c9367f-cbc3-47ff-be5e-f8c6957e5409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:10.276811 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819d4fc-6d40-473e-a612-3b274cf1f712 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:10.299713 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 376/729] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:10 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:42:10.328860 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e8be3-b599-4e38-9428-ed22d84c7c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:10.329545 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e8be3-b599-4e38-9428-ed22d84c7c1e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:10.329824 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e8be3-b599-4e38-9428-ed22d84c7c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:10.330097 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e8be3-b599-4e38-9428-ed22d84c7c1e None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:10.330830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e8be3-b599-4e38-9428-ed22d84c7c1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:10.331176 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e8be3-b599-4e38-9428-ed22d84c7c1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:10.332934 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e8be3-b599-4e38-9428-ed22d84c7c1e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:10.336059 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9367f-cbc3-47ff-be5e-f8c6957e5409 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:10.368548 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 354/730] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:10.374367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e8be3-b599-4e38-9428-ed22d84c7c1e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:10.507200 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9367f-cbc3-47ff-be5e-f8c6957e5409 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:10.535173 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e8be3-b599-4e38-9428-ed22d84c7c1e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:10.543105 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a1857-5168-4ad5-90ae-3f594d901dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:10.543929 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a1857-5168-4ad5-90ae-3f594d901dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:10.544191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a1857-5168-4ad5-90ae-3f594d901dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:10.544466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a1857-5168-4ad5-90ae-3f594d901dc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:10.554793 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a1857-5168-4ad5-90ae-3f594d901dc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:42:10.562329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-8e3a1857-5168-4ad5-90ae-3f594d901dc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:42:10.562329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:10.562329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:10.562329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:10.562329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:10.562329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:10.562329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:10.562329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:10.562329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:10.562329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:10.562329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:10.562329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:10.562329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:42:10.562329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:42:10.562329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:42:10.562329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:42:10.564446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:42:10.564446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:42:10.564446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:42:10.564446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:42:10.564446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:10.564446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:10.564446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:10.564446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:10.564446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:10.564446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:10.564446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:10.564446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:10.564446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:10.564446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:10.564446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:10.564446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:10.566471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:10.566471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:10.566471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:10.566471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:10.566471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:42:10.566471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:42:10.566471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:42:10.566471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:42:10.566471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:42:10.566471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:42:10.566471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:42:10.566471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:10.566471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 377/731] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:42:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:10.566471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7503f-d708-4de5-ae59-71b047e60f60 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:10.567838 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7503f-d708-4de5-ae59-71b047e60f60 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:10.567838 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7503f-d708-4de5-ae59-71b047e60f60 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:10.567838 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 378/732] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:10.573578 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7503f-d708-4de5-ae59-71b047e60f60 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:10.576033 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfbd6e-a39b-4e3e-9e20-6109c87ae457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:10.583028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfbd6e-a39b-4e3e-9e20-6109c87ae457 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:10.583028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfbd6e-a39b-4e3e-9e20-6109c87ae457 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:10.583028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfbd6e-a39b-4e3e-9e20-6109c87ae457 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:10.584759 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfbd6e-a39b-4e3e-9e20-6109c87ae457 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:10.586211 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfbd6e-a39b-4e3e-9e20-6109c87ae457 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:10.600732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-95cfbd6e-a39b-4e3e-9e20-6109c87ae457 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 06:42:10.600732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:10.600732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:10.600732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:10.600732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:10.600732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:10.600732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:10.600732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:10.600732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:10.600732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:10.600732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:10.600732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:10.600732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:42:10.600732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:42:10.600732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:42:10.600732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:42:10.601734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:10.601734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:10.601734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:42:10.601734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:10.601734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:42:10.601734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:10.601734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:10.601734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:10.601734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:10.601734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:10.601734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:10.601734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:10.601734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:10.601734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:10.601734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:10.601734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:10.601734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:10.601734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:10.602717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:10.602717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:10.602717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:42:10.602717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:42:10.602717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:42:10.602717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:42:10.602717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:42:10.602717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:42:10.602717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 06:42:10.602717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:10.606521 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 355/733] 10.222.0.77 () {56 vars in 1093 bytes} [Wed May 11 06:42:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:10.607867 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299cb30-f453-43c0-8b75-25b13d20da50 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:10.608159 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299cb30-f453-43c0-8b75-25b13d20da50 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:10.608435 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299cb30-f453-43c0-8b75-25b13d20da50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:10.625681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8299cb30-f453-43c0-8b75-25b13d20da50 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:10.627002 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8299cb30-f453-43c0-8b75-25b13d20da50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:10.682282 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7503f-d708-4de5-ae59-71b047e60f60 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:10.693912 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 356/734] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:10 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:42:10.695177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299cb30-f453-43c0-8b75-25b13d20da50 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:10.742188 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43bb77-2e3c-4cfd-a714-fddb42f504c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:10.743136 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43bb77-2e3c-4cfd-a714-fddb42f504c5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:10.743512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43bb77-2e3c-4cfd-a714-fddb42f504c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:10.743874 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43bb77-2e3c-4cfd-a714-fddb42f504c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:10.744735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43bb77-2e3c-4cfd-a714-fddb42f504c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:10.745140 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43bb77-2e3c-4cfd-a714-fddb42f504c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:10.746626 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43bb77-2e3c-4cfd-a714-fddb42f504c5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:10.760392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 379/735] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:42:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:10.761412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43bb77-2e3c-4cfd-a714-fddb42f504c5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:10.799377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299cb30-f453-43c0-8b75-25b13d20da50 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:10.833965 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff10ac2-5306-4c6d-ba33-86e819e1d278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:10.834938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff10ac2-5306-4c6d-ba33-86e819e1d278 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:10.835402 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff10ac2-5306-4c6d-ba33-86e819e1d278 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:10.835815 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff10ac2-5306-4c6d-ba33-86e819e1d278 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:10.836800 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff10ac2-5306-4c6d-ba33-86e819e1d278 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:10.837252 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff10ac2-5306-4c6d-ba33-86e819e1d278 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:10.838923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff10ac2-5306-4c6d-ba33-86e819e1d278 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:10.857157 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 357/736] 10.222.0.77 () {56 vars in 1133 bytes} [Wed May 11 06:42:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:10.858401 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff10ac2-5306-4c6d-ba33-86e819e1d278 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:10.866064 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43bb77-2e3c-4cfd-a714-fddb42f504c5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:10.900732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d7482-dde4-4bae-aeb9-a22d76a4c8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:10.901724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d7482-dde4-4bae-aeb9-a22d76a4c8e2 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:10.902162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d7482-dde4-4bae-aeb9-a22d76a4c8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:10.902444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d7482-dde4-4bae-aeb9-a22d76a4c8e2 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:10.903201 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d7482-dde4-4bae-aeb9-a22d76a4c8e2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:10.904591 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d7482-dde4-4bae-aeb9-a22d76a4c8e2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:10.927029 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 380/737] 10.222.0.77 () {60 vars in 1141 bytes} [Wed May 11 06:42:10 2022] POST /identity/v3/services => generated 240 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:42:10.927029 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d7482-dde4-4bae-aeb9-a22d76a4c8e2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:10.979118 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff10ac2-5306-4c6d-ba33-86e819e1d278 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:11.038250 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bea0f0-334f-4d43-b7eb-b2ac6c131e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:11.039104 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bea0f0-334f-4d43-b7eb-b2ac6c131e2e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:11.039391 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bea0f0-334f-4d43-b7eb-b2ac6c131e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:11.039851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bea0f0-334f-4d43-b7eb-b2ac6c131e2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:11.042475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d7482-dde4-4bae-aeb9-a22d76a4c8e2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:11.051004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bea0f0-334f-4d43-b7eb-b2ac6c131e2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:11.053060 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bea0f0-334f-4d43-b7eb-b2ac6c131e2e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:11.071865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-50bea0f0-334f-4d43-b7eb-b2ac6c131e2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:11.071865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:11.071865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:11.071865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:11.071865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:11.071865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:11.071865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:11.071865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:11.071865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:11.071865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:11.071865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:11.071865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:11.071865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:11.071865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:11.071865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:11.073057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:11.073057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:11.073057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:11.073057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:11.073057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:11.073057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:11.073057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:11.073057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:11.073057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:11.073057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:11.073057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:11.073057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:11.073057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:11.073057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:11.073057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:11.073057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:11.073057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:11.074190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:11.074190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:11.074190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:11.074190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:11.080415 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 358/738] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:11.082096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2e182-cf13-4e2c-82fa-d862fffeff4c None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:11.082804 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2e182-cf13-4e2c-82fa-d862fffeff4c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:11.083286 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2e182-cf13-4e2c-82fa-d862fffeff4c None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:11.085077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 359/739] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:11.085903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2e182-cf13-4e2c-82fa-d862fffeff4c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:11.088425 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb30056-f1d6-4cfe-a535-f11e73684c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:11.090771 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb30056-f1d6-4cfe-a535-f11e73684c69 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:11.091256 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb30056-f1d6-4cfe-a535-f11e73684c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:11.091672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb30056-f1d6-4cfe-a535-f11e73684c69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:11.106412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb30056-f1d6-4cfe-a535-f11e73684c69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:11.108215 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb30056-f1d6-4cfe-a535-f11e73684c69 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:11.130451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ffb30056-f1d6-4cfe-a535-f11e73684c69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:11.130451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:11.130451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:11.130451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:11.130451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:11.130451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:11.130451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:11.130451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:11.130451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:11.130451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:11.130451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:11.130451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:11.130451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:11.130451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:11.130451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:11.131484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:11.131484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:11.131484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:11.131484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:11.131484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:11.131484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:11.131484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:11.131484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:11.131484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:11.131484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:11.131484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:11.131484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:11.131484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:11.131484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:11.131484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:11.131484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:11.131484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:11.132447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:11.132447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:11.132447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:11.132447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:11.134185 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 381/740] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:11.135584 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820dd15-0ba9-4f0e-ae37-3dbb672be965 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:11.136069 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820dd15-0ba9-4f0e-ae37-3dbb672be965 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:11.136513 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820dd15-0ba9-4f0e-ae37-3dbb672be965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:11.154120 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3820dd15-0ba9-4f0e-ae37-3dbb672be965 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:11.155594 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3820dd15-0ba9-4f0e-ae37-3dbb672be965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:11.206773 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2e182-cf13-4e2c-82fa-d862fffeff4c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:11.230600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 382/741] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:11.231817 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820dd15-0ba9-4f0e-ae37-3dbb672be965 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:11.269078 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0c718-f404-4c60-ae47-8a9879d122c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:11.270121 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0c718-f404-4c60-ae47-8a9879d122c8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:11.270669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0c718-f404-4c60-ae47-8a9879d122c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:11.271201 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0c718-f404-4c60-ae47-8a9879d122c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:11.272150 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0c718-f404-4c60-ae47-8a9879d122c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:11.272666 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0c718-f404-4c60-ae47-8a9879d122c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:11.274280 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0c718-f404-4c60-ae47-8a9879d122c8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:11.288214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 360/742] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:11.289514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0c718-f404-4c60-ae47-8a9879d122c8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:11.358009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820dd15-0ba9-4f0e-ae37-3dbb672be965 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:11.392038 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6301a-5132-4a2f-9a7c-d3cc72d0891f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:11.392718 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6301a-5132-4a2f-9a7c-d3cc72d0891f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:11.393002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6301a-5132-4a2f-9a7c-d3cc72d0891f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:11.393276 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6301a-5132-4a2f-9a7c-d3cc72d0891f None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:11.394006 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6301a-5132-4a2f-9a7c-d3cc72d0891f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:11.394312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6301a-5132-4a2f-9a7c-d3cc72d0891f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:11.395822 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6301a-5132-4a2f-9a7c-d3cc72d0891f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:11.399917 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0c718-f404-4c60-ae47-8a9879d122c8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:11.407359 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 383/743] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:11.408254 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6301a-5132-4a2f-9a7c-d3cc72d0891f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:11.441013 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b0eec-bbe3-4c3a-853f-ec27e15ab4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:11.442353 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b0eec-bbe3-4c3a-853f-ec27e15ab4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:11.443384 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b0eec-bbe3-4c3a-853f-ec27e15ab4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:11.443667 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b0eec-bbe3-4c3a-853f-ec27e15ab4f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:11.459916 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b0eec-bbe3-4c3a-853f-ec27e15ab4f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:42:11.470395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-6a0b0eec-bbe3-4c3a-853f-ec27e15ab4f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:42:11.470395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:11.470395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:11.470395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:11.470395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:11.470395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:11.470395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:11.470395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:11.470395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:11.470395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:11.470395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:11.470395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:11.470395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:42:11.470395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:42:11.470395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:42:11.470395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:42:11.471372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:42:11.471372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:42:11.471372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:42:11.471372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:42:11.471372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:11.471372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:11.471372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:11.471372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:11.471372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:11.471372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:11.471372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:11.471372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:11.471372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:11.471372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:11.471372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:11.471372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:11.472206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:11.472206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:11.472206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:11.472206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:11.472206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:42:11.472206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:42:11.472206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:42:11.472206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:42:11.472206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:42:11.472206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:42:11.472206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:42:11.472206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:11.475030 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 361/744] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:42:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:11.476059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b0eec-bbe3-4c3a-853f-ec27e15ab4f5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:11.521835 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6301a-5132-4a2f-9a7c-d3cc72d0891f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:11.562004 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55e387-a96e-48b3-b930-6504072f508a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:11.562869 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55e387-a96e-48b3-b930-6504072f508a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:11.563173 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55e387-a96e-48b3-b930-6504072f508a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:11.563491 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55e387-a96e-48b3-b930-6504072f508a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:11.571447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55e387-a96e-48b3-b930-6504072f508a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:11.572896 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55e387-a96e-48b3-b930-6504072f508a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:11.586904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5e55e387-a96e-48b3-b930-6504072f508a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 06:42:11.586904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:11.586904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:11.586904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:11.586904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:11.586904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:11.586904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:11.586904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:11.586904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:11.586904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:11.586904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:11.586904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:11.586904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:42:11.586904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:42:11.586904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:42:11.586904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:42:11.587905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:11.587905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:11.587905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:42:11.587905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:11.587905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:42:11.587905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:11.587905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:11.587905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:11.587905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:11.587905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:11.587905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:11.587905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:11.587905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:11.587905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:11.587905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:11.587905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:11.587905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:11.587905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:11.589015 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:11.589015 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:11.589015 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:42:11.589015 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:42:11.589015 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:42:11.589015 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:42:11.589015 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:42:11.589015 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:42:11.589015 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 06:42:11.589015 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:11.589015 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 384/745] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:42:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:11.590180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55e387-a96e-48b3-b930-6504072f508a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:11.606730 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b0eec-bbe3-4c3a-853f-ec27e15ab4f5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:11.643524 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51218b6-2020-4f2b-8920-45061c5dcf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:11.644330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51218b6-2020-4f2b-8920-45061c5dcf8a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:11.644608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51218b6-2020-4f2b-8920-45061c5dcf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:11.644880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51218b6-2020-4f2b-8920-45061c5dcf8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:11.651637 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51218b6-2020-4f2b-8920-45061c5dcf8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:11.653088 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51218b6-2020-4f2b-8920-45061c5dcf8a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:11.669174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-f51218b6-2020-4f2b-8920-45061c5dcf8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:11.669174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:11.669174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:11.669174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:11.669174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:11.669174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:11.669174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:11.669174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:11.669174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:11.669174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:11.669174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:11.669174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:11.669174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:42:11.669174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:42:11.669174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:42:11.670127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:42:11.670127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:11.670127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:11.670127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:11.670127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:11.670127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:11.670127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:11.670127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:11.670127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:11.670127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:11.670127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:11.670127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:11.670127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:11.670127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:11.670127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:11.670127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:11.670127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:11.671102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:42:11.671102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:42:11.671102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:42:11.671102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:42:11.671102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:42:11.671102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:42:11.671102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:11.671102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:11.671102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 362/746] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:11.671604 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51218b6-2020-4f2b-8920-45061c5dcf8a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:11.703976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55e387-a96e-48b3-b930-6504072f508a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:11.746502 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a9e2e-6924-4395-bb1a-4d015152b364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:11.747600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a9e2e-6924-4395-bb1a-4d015152b364 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:11.748085 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a9e2e-6924-4395-bb1a-4d015152b364 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:11.748537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a9e2e-6924-4395-bb1a-4d015152b364 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:11.749822 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a9e2e-6924-4395-bb1a-4d015152b364 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:11.750601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a9e2e-6924-4395-bb1a-4d015152b364 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:11.752185 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a9e2e-6924-4395-bb1a-4d015152b364 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:11.763697 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 385/747] 10.222.0.77 () {56 vars in 1103 bytes} [Wed May 11 06:42:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:11.764793 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a9e2e-6924-4395-bb1a-4d015152b364 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:11.778598 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51218b6-2020-4f2b-8920-45061c5dcf8a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:11.926218 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a9e2e-6924-4395-bb1a-4d015152b364 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:11.945966 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ea876-b94c-4c97-81b4-853319aa447d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:11.946645 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ea876-b94c-4c97-81b4-853319aa447d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:11.946928 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ea876-b94c-4c97-81b4-853319aa447d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:11.947220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ea876-b94c-4c97-81b4-853319aa447d None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:11.948056 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ea876-b94c-4c97-81b4-853319aa447d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:11.948362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ea876-b94c-4c97-81b4-853319aa447d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:11.949810 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ea876-b94c-4c97-81b4-853319aa447d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:11.983714 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff824d3-d8f0-4c22-aff6-092456d1eedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:11.984439 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff824d3-d8f0-4c22-aff6-092456d1eedc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:11.984715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff824d3-d8f0-4c22-aff6-092456d1eedc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:11.985033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff824d3-d8f0-4c22-aff6-092456d1eedc None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:11.985836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff824d3-d8f0-4c22-aff6-092456d1eedc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:11.986144 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff824d3-d8f0-4c22-aff6-092456d1eedc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:11.987174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 363/748] 10.222.0.77 () {56 vars in 1135 bytes} [Wed May 11 06:42:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:11.988057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ea876-b94c-4c97-81b4-853319aa447d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:11.989742 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff824d3-d8f0-4c22-aff6-092456d1eedc None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:12.013084 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 386/749] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:42:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:12.013751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff824d3-d8f0-4c22-aff6-092456d1eedc None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:12.165682 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ea876-b94c-4c97-81b4-853319aa447d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:12.195096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff824d3-d8f0-4c22-aff6-092456d1eedc None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:12.215758 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10223ef-67de-41ee-8147-ad0e4b76d25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:12.216543 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10223ef-67de-41ee-8147-ad0e4b76d25c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:12.216825 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10223ef-67de-41ee-8147-ad0e4b76d25c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:12.217098 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10223ef-67de-41ee-8147-ad0e4b76d25c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:12.235923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10223ef-67de-41ee-8147-ad0e4b76d25c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:12.238073 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10223ef-67de-41ee-8147-ad0e4b76d25c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:12.241027 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abb48b-7de1-4878-9db5-c8b123ce356d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:12.242105 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abb48b-7de1-4878-9db5-c8b123ce356d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:12.243303 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abb48b-7de1-4878-9db5-c8b123ce356d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:12.244900 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abb48b-7de1-4878-9db5-c8b123ce356d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:12.276456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-d10223ef-67de-41ee-8147-ad0e4b76d25c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:12.276456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:12.276456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:12.276456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:12.276456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:12.276456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:12.276456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:12.276456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:12.276456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:12.276456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:12.276456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:12.276456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:12.276456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:12.276456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:12.276456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:12.277430 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:12.277430 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:12.277430 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:12.277430 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:12.277430 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:12.277430 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:12.277430 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:12.277430 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:12.277430 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:12.277430 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:12.277430 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:12.277430 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:12.277430 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:12.277430 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:12.277430 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:12.277430 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:12.277430 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:12.278347 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:12.278347 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:12.278347 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:12.278347 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:12.283851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 364/750] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:12.287270 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10223ef-67de-41ee-8147-ad0e4b76d25c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:12.376387 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abb48b-7de1-4878-9db5-c8b123ce356d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:12.377874 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abb48b-7de1-4878-9db5-c8b123ce356d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:12.443452 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10223ef-67de-41ee-8147-ad0e4b76d25c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:12.475401 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04637307-c9c8-4802-b665-6a13f5f48d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:12.482893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04637307-c9c8-4802-b665-6a13f5f48d3f None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:12.482893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04637307-c9c8-4802-b665-6a13f5f48d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:12.482893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04637307-c9c8-4802-b665-6a13f5f48d3f None admin] PATH_INFO: `/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/edf9d57de89a4701ba1a5b079d0ad348/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:12.482893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04637307-c9c8-4802-b665-6a13f5f48d3f None admin] RBAC: Authorizing `identity:create_grant(project_id=0f573a9de6904664ace6287072a8a7dc, user_id=edf9d57de89a4701ba1a5b079d0ad348, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:12.482893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04637307-c9c8-4802-b665-6a13f5f48d3f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:12.495213 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 365/751] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:42:12 2022] PUT /identity/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/edf9d57de89a4701ba1a5b079d0ad348/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:42:12.495777 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04637307-c9c8-4802-b665-6a13f5f48d3f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:12.517777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 387/752] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:42:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:42:12.519335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bb44e-78b0-46c4-b2cb-fd7aa2526386 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:12.519801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bb44e-78b0-46c4-b2cb-fd7aa2526386 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:12.519996 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bb44e-78b0-46c4-b2cb-fd7aa2526386 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:12.521534 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 388/753] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:12.526561 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bb44e-78b0-46c4-b2cb-fd7aa2526386 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:12.620477 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04637307-c9c8-4802-b665-6a13f5f48d3f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:12.658339 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a622ac0-c6d7-410b-a754-874d08cd4d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:12.659075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a622ac0-c6d7-410b-a754-874d08cd4d90 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:12.659361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a622ac0-c6d7-410b-a754-874d08cd4d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:12.659637 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a622ac0-c6d7-410b-a754-874d08cd4d90 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:12.660382 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a622ac0-c6d7-410b-a754-874d08cd4d90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:12.660689 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a622ac0-c6d7-410b-a754-874d08cd4d90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:12.661373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bb44e-78b0-46c4-b2cb-fd7aa2526386 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:12.662200 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a622ac0-c6d7-410b-a754-874d08cd4d90 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:12.679413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 366/754] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:12.680902 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15030c-1535-417b-9722-bfe8a44c61c4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:12.681188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15030c-1535-417b-9722-bfe8a44c61c4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:12.681461 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15030c-1535-417b-9722-bfe8a44c61c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:12.702251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-de15030c-1535-417b-9722-bfe8a44c61c4 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:12.703553 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-de15030c-1535-417b-9722-bfe8a44c61c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:12.709109 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29c125-f437-4324-a1fa-49b0029f7cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:12.709455 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29c125-f437-4324-a1fa-49b0029f7cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:12.709824 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29c125-f437-4324-a1fa-49b0029f7cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:12.710165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29c125-f437-4324-a1fa-49b0029f7cd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:12.723099 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29c125-f437-4324-a1fa-49b0029f7cd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:12.724894 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29c125-f437-4324-a1fa-49b0029f7cd0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:12.744361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-7f29c125-f437-4324-a1fa-49b0029f7cd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:12.744361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:12.744361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:12.744361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:12.744361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:12.744361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:12.744361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:12.744361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:12.744361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:12.744361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:12.744361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:12.744361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:12.744361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:12.744361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:12.744361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:12.745374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:12.745374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:12.745374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:12.745374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:12.745374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:12.745374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:12.745374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:12.745374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:12.745374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:12.745374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:12.745374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:12.745374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:12.745374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:12.745374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:12.745374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:12.745374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:12.745374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:12.746836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:12.746836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:12.746836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:12.746836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:12.746836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 389/755] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:12.746836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29c125-f437-4324-a1fa-49b0029f7cd0 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:12.794632 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 367/756] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:12.795533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15030c-1535-417b-9722-bfe8a44c61c4 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:12.851467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29c125-f437-4324-a1fa-49b0029f7cd0 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:12.886985 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd8ded-f10a-4789-9479-c8834f0bf86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:12.888007 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd8ded-f10a-4789-9479-c8834f0bf86e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:12.888290 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd8ded-f10a-4789-9479-c8834f0bf86e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:12.888565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd8ded-f10a-4789-9479-c8834f0bf86e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:12.893564 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15030c-1535-417b-9722-bfe8a44c61c4 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:12.896109 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd8ded-f10a-4789-9479-c8834f0bf86e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:12.897697 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd8ded-f10a-4789-9479-c8834f0bf86e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:12.914328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c2fd8ded-f10a-4789-9479-c8834f0bf86e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:42:12.914328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:12.914328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:12.914328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:12.914328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:12.914328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:12.914328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:12.914328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:12.914328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:12.914328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:12.914328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:12.914328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:12.914328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:42:12.914328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:42:12.914328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:42:12.914328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:42:12.916801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:12.916801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:12.916801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:42:12.916801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:12.916801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:42:12.916801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:12.916801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:12.916801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:12.916801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:12.916801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:12.916801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:12.916801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:12.916801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:12.916801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:12.916801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:12.916801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:12.916801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:12.916801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:12.919104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:12.919104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:12.919104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:42:12.919104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:42:12.919104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:42:12.919104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:42:12.919104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:42:12.919104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:42:12.919104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:42:12.919104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:12.919104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 390/757] 10.222.0.77 () {56 vars in 1117 bytes} [Wed May 11 06:42:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:12.919104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd8ded-f10a-4789-9479-c8834f0bf86e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:12.927930 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aef74c-5255-4481-b8b9-a17f51c3ff9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:12.928201 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aef74c-5255-4481-b8b9-a17f51c3ff9c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:12.928482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aef74c-5255-4481-b8b9-a17f51c3ff9c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:12.928758 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aef74c-5255-4481-b8b9-a17f51c3ff9c None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:12.929484 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aef74c-5255-4481-b8b9-a17f51c3ff9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:12.929788 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aef74c-5255-4481-b8b9-a17f51c3ff9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:12.931181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aef74c-5255-4481-b8b9-a17f51c3ff9c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:12.942821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 368/758] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:12.948427 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aef74c-5255-4481-b8b9-a17f51c3ff9c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:13.016786 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd8ded-f10a-4789-9479-c8834f0bf86e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:13.044058 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aef74c-5255-4481-b8b9-a17f51c3ff9c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:13.054195 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699bba7-b649-4cc7-86b8-aca04d8785a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:13.055038 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699bba7-b649-4cc7-86b8-aca04d8785a2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:13.055318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699bba7-b649-4cc7-86b8-aca04d8785a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:13.055585 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699bba7-b649-4cc7-86b8-aca04d8785a2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:13.056239 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699bba7-b649-4cc7-86b8-aca04d8785a2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:13.057619 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699bba7-b649-4cc7-86b8-aca04d8785a2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:13.070275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-4699bba7-b649-4cc7-86b8-aca04d8785a2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 06:42:13.070275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:13.070275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:13.070275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:13.070275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:13.070275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:13.070275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:13.070275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:13.070275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 06:42:13.070275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:13.070275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:13.070275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:13.070275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:13.070275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:13.070275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:13.070275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:13.073181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:13.073181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:13.073181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:13.073181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:13.073181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:13.073181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:13.073181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:13.073181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:13.073181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:13.073181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:13.073181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:13.073181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:13.073181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:13.073181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:13.073181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:13.073181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:13.075205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:13.075205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:13.075205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:13.075205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:13.075205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:13.075205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:13.075205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:13.075205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:13.075205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:13.075205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:13.075205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:13.075205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:13.075205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:13.075205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 06:42:13.075205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:13.075205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 391/759] 10.222.0.77 () {56 vars in 1129 bytes} [Wed May 11 06:42:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:13.083238 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699bba7-b649-4cc7-86b8-aca04d8785a2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:13.083401 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e476b7f-ed3a-412d-9047-0f171097388b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:13.083401 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e476b7f-ed3a-412d-9047-0f171097388b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:13.083401 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e476b7f-ed3a-412d-9047-0f171097388b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:13.083401 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e476b7f-ed3a-412d-9047-0f171097388b None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:13.083992 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e476b7f-ed3a-412d-9047-0f171097388b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:13.083992 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e476b7f-ed3a-412d-9047-0f171097388b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:13.083992 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e476b7f-ed3a-412d-9047-0f171097388b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:13.102928 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 369/760] 10.222.0.77 () {56 vars in 1149 bytes} [Wed May 11 06:42:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:13.103978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e476b7f-ed3a-412d-9047-0f171097388b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:13.178286 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699bba7-b649-4cc7-86b8-aca04d8785a2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:13.203377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e476b7f-ed3a-412d-9047-0f171097388b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:13.211760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c037e-8539-4e1a-afc5-b4764d80bf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:13.212565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c037e-8539-4e1a-afc5-b4764d80bf95 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:13.212841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c037e-8539-4e1a-afc5-b4764d80bf95 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:13.213108 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c037e-8539-4e1a-afc5-b4764d80bf95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:13.219840 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c037e-8539-4e1a-afc5-b4764d80bf95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:13.221312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c037e-8539-4e1a-afc5-b4764d80bf95 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:13.236467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-852c037e-8539-4e1a-afc5-b4764d80bf95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:13.236467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:13.236467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:13.236467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:13.236467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:13.236467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:13.236467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:13.236467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:13.236467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:13.236467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:13.236467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:13.236467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:13.236467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:42:13.236467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:42:13.236467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:42:13.238653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:42:13.238653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:13.238653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:13.238653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:13.238653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:13.238653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:13.238653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:13.238653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:13.238653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:13.238653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:13.238653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:13.238653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:13.238653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:13.238653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:13.238653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:13.238653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:13.238653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:13.240981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:42:13.240981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:42:13.240981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:42:13.240981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:42:13.240981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:42:13.240981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:42:13.240981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:13.240981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:13.242028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8792a-7f5f-4bb1-812e-9d1c613d8bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:13.242195 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 392/761] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:13.242363 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8792a-7f5f-4bb1-812e-9d1c613d8bea None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:13.242363 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8792a-7f5f-4bb1-812e-9d1c613d8bea None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:13.242363 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8792a-7f5f-4bb1-812e-9d1c613d8bea None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:13.242782 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c037e-8539-4e1a-afc5-b4764d80bf95 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:13.251013 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8792a-7f5f-4bb1-812e-9d1c613d8bea None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:13.251013 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8792a-7f5f-4bb1-812e-9d1c613d8bea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:13.251013 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8792a-7f5f-4bb1-812e-9d1c613d8bea None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:13.251639 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 370/762] 10.222.0.77 () {56 vars in 1124 bytes} [Wed May 11 06:42:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:13.252012 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8792a-7f5f-4bb1-812e-9d1c613d8bea None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:13.354257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8792a-7f5f-4bb1-812e-9d1c613d8bea None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:13.390823 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811f024-224d-4ac6-939d-60411a80aba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:13.391559 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811f024-224d-4ac6-939d-60411a80aba6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:13.391821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811f024-224d-4ac6-939d-60411a80aba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:13.392115 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811f024-224d-4ac6-939d-60411a80aba6 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:13.392911 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811f024-224d-4ac6-939d-60411a80aba6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:13.393216 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811f024-224d-4ac6-939d-60411a80aba6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:13.394656 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811f024-224d-4ac6-939d-60411a80aba6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:13.411856 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 371/763] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:42:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:13.411856 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811f024-224d-4ac6-939d-60411a80aba6 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:13.469575 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c037e-8539-4e1a-afc5-b4764d80bf95 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:13.502861 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9044f-0779-4291-92e0-993966b699c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:13.503548 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9044f-0779-4291-92e0-993966b699c6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:13.503829 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9044f-0779-4291-92e0-993966b699c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:13.504101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9044f-0779-4291-92e0-993966b699c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:13.511870 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811f024-224d-4ac6-939d-60411a80aba6 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:13.550388 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce397d8-dc76-4dc4-a4ee-db49ede66fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:13.551105 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce397d8-dc76-4dc4-a4ee-db49ede66fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:13.551281 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce397d8-dc76-4dc4-a4ee-db49ede66fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:13.551598 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce397d8-dc76-4dc4-a4ee-db49ede66fb2 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:13.552349 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce397d8-dc76-4dc4-a4ee-db49ede66fb2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:13.552660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce397d8-dc76-4dc4-a4ee-db49ede66fb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:13.554049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce397d8-dc76-4dc4-a4ee-db49ede66fb2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:13.560237 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 372/764] 10.222.0.77 () {56 vars in 1124 bytes} [Wed May 11 06:42:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:13.562526 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1117d0-5dad-49b4-a692-bdebc726d696 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:13.563053 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1117d0-5dad-49b4-a692-bdebc726d696 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:13.563705 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1117d0-5dad-49b4-a692-bdebc726d696 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:13.565382 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 373/765] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:13.566106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1117d0-5dad-49b4-a692-bdebc726d696 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:13.575907 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9044f-0779-4291-92e0-993966b699c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:13.577371 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9044f-0779-4291-92e0-993966b699c6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:13.666897 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1117d0-5dad-49b4-a692-bdebc726d696 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:13.672580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 393/766] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:42:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:42:13.672580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9044f-0779-4291-92e0-993966b699c6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:13.704107 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99159896-1008-41d8-9703-2eab179ec775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:13.704778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99159896-1008-41d8-9703-2eab179ec775 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:13.705056 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99159896-1008-41d8-9703-2eab179ec775 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:13.705328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99159896-1008-41d8-9703-2eab179ec775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:13.706179 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99159896-1008-41d8-9703-2eab179ec775 None admin] RBAC: Adding query filter params (role.id=5debd8ad07a74bedbf2efd53b11cd7cd, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=f726f58d30734be7abf15400bff89533) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:13.706486 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99159896-1008-41d8-9703-2eab179ec775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:13.708069 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99159896-1008-41d8-9703-2eab179ec775 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:13.723154 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 374/767] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:42:13 2022] GET /identity/v3/role_assignments?user.id=f726f58d30734be7abf15400bff89533&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=5debd8ad07a74bedbf2efd53b11cd7cd => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:13.723154 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94ec16-f106-45a9-8fcf-aa452646acb5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:13.723154 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94ec16-f106-45a9-8fcf-aa452646acb5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:13.723154 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94ec16-f106-45a9-8fcf-aa452646acb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:13.738796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7e94ec16-f106-45a9-8fcf-aa452646acb5 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:13.740122 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7e94ec16-f106-45a9-8fcf-aa452646acb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:13.785836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9044f-0779-4291-92e0-993966b699c6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:13.824910 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c637c09-c4a7-45c1-b39c-0941695ee44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:13.825510 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c637c09-c4a7-45c1-b39c-0941695ee44b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:13.825790 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c637c09-c4a7-45c1-b39c-0941695ee44b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:13.826058 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c637c09-c4a7-45c1-b39c-0941695ee44b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:13.826869 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c637c09-c4a7-45c1-b39c-0941695ee44b None admin] RBAC: Adding query filter params (interface=public, service_id=6f300ce095b349309d3e31c5a35125f0, region_id=RegionOne) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:13.827205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c637c09-c4a7-45c1-b39c-0941695ee44b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:13.828609 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c637c09-c4a7-45c1-b39c-0941695ee44b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:13.829621 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 375/768] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:13.830517 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94ec16-f106-45a9-8fcf-aa452646acb5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:13.850629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 394/769] 10.222.0.77 () {56 vars in 1251 bytes} [Wed May 11 06:42:13 2022] GET /identity/v3/endpoints?service_id=6f300ce095b349309d3e31c5a35125f0&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:13.856187 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c637c09-c4a7-45c1-b39c-0941695ee44b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:13.945926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94ec16-f106-45a9-8fcf-aa452646acb5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:13.979813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c637c09-c4a7-45c1-b39c-0941695ee44b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:13.983049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6ae83-8ad2-4c6f-9e8c-3c135713d16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:13.984109 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6ae83-8ad2-4c6f-9e8c-3c135713d16e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:13.984603 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6ae83-8ad2-4c6f-9e8c-3c135713d16e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:13.985079 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6ae83-8ad2-4c6f-9e8c-3c135713d16e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:13.997914 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6ae83-8ad2-4c6f-9e8c-3c135713d16e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:13.999881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6ae83-8ad2-4c6f-9e8c-3c135713d16e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:14.015971 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7806500-625f-4924-b634-eeda777c8a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:14.016769 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7806500-625f-4924-b634-eeda777c8a5d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:14.017154 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7806500-625f-4924-b634-eeda777c8a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:14.017538 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7806500-625f-4924-b634-eeda777c8a5d None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:14.018328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7806500-625f-4924-b634-eeda777c8a5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:14.019841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7806500-625f-4924-b634-eeda777c8a5d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:14.022377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-fff6ae83-8ad2-4c6f-9e8c-3c135713d16e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:14.022377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:14.022377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:14.022377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:14.022377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:14.022377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:14.022377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:14.022377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:14.022377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:14.022377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:14.022377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:14.022377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:14.022377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:14.022377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:14.022377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:14.023474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:14.023474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:14.023474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:14.023474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:14.023474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:14.023474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:14.023474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:14.023474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:14.023474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:14.023474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:14.023474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:14.023474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:14.023474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:14.023474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:14.023474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:14.023474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:14.023474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:14.024638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:14.024638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:14.024638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:14.024638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:14.026819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 376/770] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:14.034437 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 395/771] 10.222.0.77 () {56 vars in 1087 bytes} [Wed May 11 06:42:13 2022] GET /identity/v3/services => generated 772 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:14.034437 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7806500-625f-4924-b634-eeda777c8a5d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:14.035001 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6ae83-8ad2-4c6f-9e8c-3c135713d16e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:14.217815 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7806500-625f-4924-b634-eeda777c8a5d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:14.228540 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6ae83-8ad2-4c6f-9e8c-3c135713d16e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:14.271416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2ee97-20ad-4339-ac1d-1ea1a63b8489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:14.272387 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2ee97-20ad-4339-ac1d-1ea1a63b8489 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:14.272835 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2ee97-20ad-4339-ac1d-1ea1a63b8489 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:14.273253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2ee97-20ad-4339-ac1d-1ea1a63b8489 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:14.274128 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2ee97-20ad-4339-ac1d-1ea1a63b8489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:14.274595 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2ee97-20ad-4339-ac1d-1ea1a63b8489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:14.276613 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2ee97-20ad-4339-ac1d-1ea1a63b8489 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:14.286018 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cf00f-694f-40fa-bc39-ab28f57139f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:14.286341 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cf00f-694f-40fa-bc39-ab28f57139f2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:14.286714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cf00f-694f-40fa-bc39-ab28f57139f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:14.287144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cf00f-694f-40fa-bc39-ab28f57139f2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:14.287909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cf00f-694f-40fa-bc39-ab28f57139f2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:14.289401 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cf00f-694f-40fa-bc39-ab28f57139f2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:14.303808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-263cf00f-694f-40fa-bc39-ab28f57139f2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 06:42:14.303808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:14.303808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:14.303808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:14.303808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:14.303808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:14.303808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:14.303808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:14.303808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 06:42:14.303808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:14.303808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:14.303808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:14.303808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:14.303808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:14.303808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:14.303808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:14.303808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:14.304962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:14.304962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:14.304962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:14.304962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:14.304962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:14.304962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:14.304962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:14.304962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:14.304962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:14.304962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:14.304962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:14.304962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:14.304962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:14.304962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:14.304962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:14.304962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:14.306127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:14.306127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:14.306127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:14.306127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:14.306127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:14.306127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:14.306127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:14.306127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:14.306127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:14.306127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:14.306127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:14.306127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:14.306127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 06:42:14.306127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:14.306127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 377/772] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:14 2022] GET /identity/v3/services/network => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:14.310605 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 396/773] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:14.313536 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cf00f-694f-40fa-bc39-ab28f57139f2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:14.317257 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2ee97-20ad-4339-ac1d-1ea1a63b8489 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:14.433268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2ee97-20ad-4339-ac1d-1ea1a63b8489 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:14.437079 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cf00f-694f-40fa-bc39-ab28f57139f2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:14.466651 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b225cf3-76f6-4154-9031-a1758cf2c23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:14.467545 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b225cf3-76f6-4154-9031-a1758cf2c23b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:14.467875 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b225cf3-76f6-4154-9031-a1758cf2c23b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:14.468089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b225cf3-76f6-4154-9031-a1758cf2c23b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:14.475885 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b225cf3-76f6-4154-9031-a1758cf2c23b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:14.477951 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b225cf3-76f6-4154-9031-a1758cf2c23b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:14.492647 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef188565-355a-41a6-a810-104514f568f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:14.493002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-9b225cf3-76f6-4154-9031-a1758cf2c23b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:14.493002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:14.493002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:14.493002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:14.493002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:14.493002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:14.493002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:14.493002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:14.493002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:14.493002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:14.493002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:14.493002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:14.493002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:42:14.493002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:42:14.493002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:42:14.493884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:42:14.493884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:14.493884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:14.493884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:14.493884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:14.493884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:14.493884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:14.493884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:14.493884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:14.493884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:14.493884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:14.493884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:14.493884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:14.493884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:14.493884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:14.493884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:14.493884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:14.495112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:42:14.495112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:42:14.495112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:42:14.495112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:42:14.495112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:42:14.495112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:42:14.495112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:14.495112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:14.495786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef188565-355a-41a6-a810-104514f568f3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:14.495786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef188565-355a-41a6-a810-104514f568f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:14.495786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef188565-355a-41a6-a810-104514f568f3 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:14.495994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 397/774] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:14.496072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef188565-355a-41a6-a810-104514f568f3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:14.496072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef188565-355a-41a6-a810-104514f568f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:14.496315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef188565-355a-41a6-a810-104514f568f3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:14.501686 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b225cf3-76f6-4154-9031-a1758cf2c23b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:14.502040 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 378/775] 10.222.0.77 () {56 vars in 1112 bytes} [Wed May 11 06:42:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:14.508640 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef188565-355a-41a6-a810-104514f568f3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:14.662009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b225cf3-76f6-4154-9031-a1758cf2c23b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:14.684162 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef188565-355a-41a6-a810-104514f568f3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:14.729039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ee9d3-e574-4f2f-99e8-db35b15747b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:14.729679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ee9d3-e574-4f2f-99e8-db35b15747b0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:14.729956 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ee9d3-e574-4f2f-99e8-db35b15747b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:14.730224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ee9d3-e574-4f2f-99e8-db35b15747b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:14.731042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ee9d3-e574-4f2f-99e8-db35b15747b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:14.731348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ee9d3-e574-4f2f-99e8-db35b15747b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:14.732780 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ee9d3-e574-4f2f-99e8-db35b15747b0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:14.745877 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4d04f-b267-496f-a9e0-f22605c5d6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:14.746545 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4d04f-b267-496f-a9e0-f22605c5d6b9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:14.746821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4d04f-b267-496f-a9e0-f22605c5d6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:14.747119 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4d04f-b267-496f-a9e0-f22605c5d6b9 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:14.747831 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4d04f-b267-496f-a9e0-f22605c5d6b9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:14.748133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4d04f-b267-496f-a9e0-f22605c5d6b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:14.749489 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4d04f-b267-496f-a9e0-f22605c5d6b9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:14.756772 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 398/776] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:42:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:14.758561 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 379/777] 10.222.0.77 () {56 vars in 1112 bytes} [Wed May 11 06:42:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:14.762460 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ee9d3-e574-4f2f-99e8-db35b15747b0 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:14.763839 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4d04f-b267-496f-a9e0-f22605c5d6b9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:14.903605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4d04f-b267-496f-a9e0-f22605c5d6b9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:14.904394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ee9d3-e574-4f2f-99e8-db35b15747b0 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:14.938361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211dfb9-fb9c-45f2-a5de-8ad8601e5368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:14.939061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211dfb9-fb9c-45f2-a5de-8ad8601e5368 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:14.939235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fcfc7-7899-4c9e-b43f-3ce8a5e391c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:14.939407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211dfb9-fb9c-45f2-a5de-8ad8601e5368 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:14.939580 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211dfb9-fb9c-45f2-a5de-8ad8601e5368 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:14.939852 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fcfc7-7899-4c9e-b43f-3ce8a5e391c9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:14.940128 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fcfc7-7899-4c9e-b43f-3ce8a5e391c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:14.940387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211dfb9-fb9c-45f2-a5de-8ad8601e5368 None admin] RBAC: Adding query filter params (interface=public, service_id=4ce865025f3f48d693bfd4c95b104886, region_id=RegionOne) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:14.940558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fcfc7-7899-4c9e-b43f-3ce8a5e391c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:14.940718 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211dfb9-fb9c-45f2-a5de-8ad8601e5368 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:14.941219 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fcfc7-7899-4c9e-b43f-3ce8a5e391c9 None admin] RBAC: Adding query filter params (role.id=46d109e3a1bd4f13b0d145cde46c75a9, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=99cbf80fc74c4183a6eed3e97f7196f9) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:14.941523 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fcfc7-7899-4c9e-b43f-3ce8a5e391c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:14.942330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211dfb9-fb9c-45f2-a5de-8ad8601e5368 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:14.943062 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fcfc7-7899-4c9e-b43f-3ce8a5e391c9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:14.949610 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 399/778] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:42:14 2022] GET /identity/v3/role_assignments?user.id=99cbf80fc74c4183a6eed3e97f7196f9&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=46d109e3a1bd4f13b0d145cde46c75a9 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:14.950500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 380/779] 10.222.0.77 () {56 vars in 1251 bytes} [Wed May 11 06:42:14 2022] GET /identity/v3/endpoints?service_id=4ce865025f3f48d693bfd4c95b104886&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:14.950851 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc63b50-6ff1-402b-b727-d9db2f78b33e None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:14.955268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc63b50-6ff1-402b-b727-d9db2f78b33e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:14.955603 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc63b50-6ff1-402b-b727-d9db2f78b33e None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:14.957070 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 400/780] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:14.958123 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211dfb9-fb9c-45f2-a5de-8ad8601e5368 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:14.964198 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71010559-436f-4b09-91ea-9a72aaf3c8fb None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:14.964520 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71010559-436f-4b09-91ea-9a72aaf3c8fb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:14.966991 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71010559-436f-4b09-91ea-9a72aaf3c8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:15.008163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-71010559-436f-4b09-91ea-9a72aaf3c8fb None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:15.009326 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-71010559-436f-4b09-91ea-9a72aaf3c8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:15.069680 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211dfb9-fb9c-45f2-a5de-8ad8601e5368 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:15.105403 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce130547-8ce3-4dd0-a15c-cc93148d1ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:15.106102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce130547-8ce3-4dd0-a15c-cc93148d1ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:15.106385 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce130547-8ce3-4dd0-a15c-cc93148d1ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:15.106658 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce130547-8ce3-4dd0-a15c-cc93148d1ae5 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:15.107395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce130547-8ce3-4dd0-a15c-cc93148d1ae5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:15.108822 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce130547-8ce3-4dd0-a15c-cc93148d1ae5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:15.115154 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 381/781] 10.222.0.77 () {56 vars in 1087 bytes} [Wed May 11 06:42:14 2022] GET /identity/v3/services => generated 772 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:15.178869 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 401/782] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:15.202179 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce130547-8ce3-4dd0-a15c-cc93148d1ae5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:15.340621 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce130547-8ce3-4dd0-a15c-cc93148d1ae5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:15.378735 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9668a-ce48-4d47-9652-0fc1d86e9d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:15.379580 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9668a-ce48-4d47-9652-0fc1d86e9d36 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:15.379982 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9668a-ce48-4d47-9652-0fc1d86e9d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:15.380265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9668a-ce48-4d47-9652-0fc1d86e9d36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:15.390686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9668a-ce48-4d47-9652-0fc1d86e9d36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:42:15.398315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-baa9668a-ce48-4d47-9652-0fc1d86e9d36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:42:15.398315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:15.398315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:15.398315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:15.398315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:15.398315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:15.398315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:15.398315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:15.398315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:15.398315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:15.398315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:15.398315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:15.398315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:42:15.398315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:42:15.398315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:42:15.398315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:42:15.399298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:42:15.399298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:42:15.399298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:42:15.399298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:42:15.399298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:15.399298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:15.399298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:15.399298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:15.399298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:15.399298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:15.399298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:15.399298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:15.399298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:15.399298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:15.399298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:15.399298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:15.400568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:15.400568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:15.400568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:15.400568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:15.400568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:42:15.400568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:42:15.400568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:42:15.400568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:42:15.400568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:42:15.400568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:42:15.400568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:42:15.400568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:15.400568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 382/783] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:42:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:15.405805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71010559-436f-4b09-91ea-9a72aaf3c8fb None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:15.506766 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71010559-436f-4b09-91ea-9a72aaf3c8fb None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:15.544716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93230f39-0792-4ff0-bbd2-21ce370b5151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:15.545402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93230f39-0792-4ff0-bbd2-21ce370b5151 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:15.545680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93230f39-0792-4ff0-bbd2-21ce370b5151 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:15.545953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93230f39-0792-4ff0-bbd2-21ce370b5151 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:15.546725 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93230f39-0792-4ff0-bbd2-21ce370b5151 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:15.547069 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93230f39-0792-4ff0-bbd2-21ce370b5151 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:15.548460 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93230f39-0792-4ff0-bbd2-21ce370b5151 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:15.557540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 402/784] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:42:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:15.563170 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9668a-ce48-4d47-9652-0fc1d86e9d36 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:15.667722 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9668a-ce48-4d47-9652-0fc1d86e9d36 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:15.706484 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf1469-885a-4b63-a334-fc6eeba44eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:15.708189 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf1469-885a-4b63-a334-fc6eeba44eee None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:15.708687 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf1469-885a-4b63-a334-fc6eeba44eee None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:15.709168 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf1469-885a-4b63-a334-fc6eeba44eee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:15.725941 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf1469-885a-4b63-a334-fc6eeba44eee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:15.727785 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf1469-885a-4b63-a334-fc6eeba44eee None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:15.752208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-d4bf1469-885a-4b63-a334-fc6eeba44eee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:15.752208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:15.752208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:15.752208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:15.752208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:15.752208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:15.752208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:15.752208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:15.752208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:15.752208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:15.752208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:15.752208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:15.752208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:15.752208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:15.752208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:15.753187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:15.753187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:15.753187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:15.753187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:15.753187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:15.753187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:15.753187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:15.753187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:15.753187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:15.753187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:15.753187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:15.753187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:15.753187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:15.753187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:15.753187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:15.753187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:15.753187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:15.754097 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:15.754097 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:15.754097 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:15.754097 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:15.756134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 383/785] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:15.761873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93230f39-0792-4ff0-bbd2-21ce370b5151 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:15.914462 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93230f39-0792-4ff0-bbd2-21ce370b5151 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:15.957440 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5493ca-f664-4e62-ae9b-cfc90a34ebd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:15.958167 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5493ca-f664-4e62-ae9b-cfc90a34ebd4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:15.958450 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5493ca-f664-4e62-ae9b-cfc90a34ebd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:15.958725 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5493ca-f664-4e62-ae9b-cfc90a34ebd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:15.959480 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5493ca-f664-4e62-ae9b-cfc90a34ebd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:15.959789 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5493ca-f664-4e62-ae9b-cfc90a34ebd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:15.961176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5493ca-f664-4e62-ae9b-cfc90a34ebd4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:15.977510 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 403/786] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:15.983071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf1469-885a-4b63-a334-fc6eeba44eee None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:16.092930 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf1469-885a-4b63-a334-fc6eeba44eee None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:16.134605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820300ab-7f72-4110-b4ae-c0612d6320f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:16.135852 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820300ab-7f72-4110-b4ae-c0612d6320f2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:16.136336 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820300ab-7f72-4110-b4ae-c0612d6320f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:16.136809 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820300ab-7f72-4110-b4ae-c0612d6320f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:16.145549 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820300ab-7f72-4110-b4ae-c0612d6320f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:16.147337 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820300ab-7f72-4110-b4ae-c0612d6320f2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:16.164954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-820300ab-7f72-4110-b4ae-c0612d6320f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 06:42:16.164954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:16.164954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:16.164954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:16.164954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:16.164954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:16.164954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:16.164954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:16.164954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:16.164954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:16.164954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:16.164954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:16.164954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:42:16.164954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:42:16.164954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:42:16.164954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:42:16.165915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:16.165915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:16.165915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:42:16.165915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:16.165915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:42:16.165915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:16.165915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:16.165915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:16.165915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:16.165915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:16.165915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:16.165915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:16.165915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:16.165915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:16.165915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:16.165915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:16.165915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:16.165915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:16.166888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:16.166888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:16.166888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:42:16.166888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:42:16.166888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:42:16.166888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:42:16.166888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:42:16.166888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:42:16.166888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 06:42:16.166888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:16.173701 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 384/787] 10.222.0.77 () {56 vars in 1093 bytes} [Wed May 11 06:42:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:16.179167 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5493ca-f664-4e62-ae9b-cfc90a34ebd4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:16.303411 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5493ca-f664-4e62-ae9b-cfc90a34ebd4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:16.336875 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fab8ce-e884-41ef-bb0e-a7a12b4c85f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:16.337558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fab8ce-e884-41ef-bb0e-a7a12b4c85f9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:16.337840 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fab8ce-e884-41ef-bb0e-a7a12b4c85f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:16.338113 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fab8ce-e884-41ef-bb0e-a7a12b4c85f9 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:16.338953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fab8ce-e884-41ef-bb0e-a7a12b4c85f9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:16.339276 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fab8ce-e884-41ef-bb0e-a7a12b4c85f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:16.340704 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fab8ce-e884-41ef-bb0e-a7a12b4c85f9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:16.358294 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 404/788] 10.222.0.77 () {56 vars in 1133 bytes} [Wed May 11 06:42:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:16.363553 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820300ab-7f72-4110-b4ae-c0612d6320f2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:16.381430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd286fa-725b-41a2-bc8a-0e6e2024e164 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:16.381764 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd286fa-725b-41a2-bc8a-0e6e2024e164 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:16.381980 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd286fa-725b-41a2-bc8a-0e6e2024e164 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:16.383651 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 405/789] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:16.388648 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5612043-ad52-4e91-8ceb-ab6786b47afc None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:16.388931 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5612043-ad52-4e91-8ceb-ab6786b47afc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:16.389205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5612043-ad52-4e91-8ceb-ab6786b47afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:16.413684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e5612043-ad52-4e91-8ceb-ab6786b47afc None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:16.414872 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e5612043-ad52-4e91-8ceb-ab6786b47afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:16.472764 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820300ab-7f72-4110-b4ae-c0612d6320f2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:16.519676 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2f74d-8231-49e6-a0bc-e31d3d4843ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:16.519891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 406/790] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:42:16.520530 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2f74d-8231-49e6-a0bc-e31d3d4843ac None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:16.520813 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2f74d-8231-49e6-a0bc-e31d3d4843ac None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:16.521146 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2f74d-8231-49e6-a0bc-e31d3d4843ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:16.541949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5612043-ad52-4e91-8ceb-ab6786b47afc None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:16.632696 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2f74d-8231-49e6-a0bc-e31d3d4843ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:16.634538 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2f74d-8231-49e6-a0bc-e31d3d4843ac None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:16.641351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5612043-ad52-4e91-8ceb-ab6786b47afc None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:16.705599 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53007d-7de1-4e83-8445-fd4cb027ed21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:16.706811 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53007d-7de1-4e83-8445-fd4cb027ed21 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:16.707314 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53007d-7de1-4e83-8445-fd4cb027ed21 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:16.707858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53007d-7de1-4e83-8445-fd4cb027ed21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:16.726743 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53007d-7de1-4e83-8445-fd4cb027ed21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:42:16.746794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-7a53007d-7de1-4e83-8445-fd4cb027ed21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:42:16.746794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:16.746794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:16.746794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:16.746794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:16.746794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:16.746794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:16.746794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:16.746794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:16.746794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:16.746794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:16.746794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:16.746794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:42:16.746794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:42:16.746794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:42:16.746794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:42:16.747868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:42:16.747868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:42:16.747868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:42:16.747868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:42:16.747868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:16.747868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:16.747868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:16.747868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:16.747868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:16.747868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:16.747868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:16.747868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:16.747868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:16.747868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:16.747868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:16.747868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:16.748745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:16.748745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:16.748745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:16.748745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:16.748745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:42:16.748745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:42:16.748745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:42:16.748745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:42:16.748745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:42:16.748745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:42:16.748745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:42:16.748745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:16.751936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 407/791] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:42:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:16.757758 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53007d-7de1-4e83-8445-fd4cb027ed21 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:16.811980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 385/792] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:42:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:42:16.817629 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2f74d-8231-49e6-a0bc-e31d3d4843ac None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:16.950626 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2f74d-8231-49e6-a0bc-e31d3d4843ac None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:16.955416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53007d-7de1-4e83-8445-fd4cb027ed21 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:16.987823 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791ed17-003a-4d96-9ba0-36c1a1224997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:16.988583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791ed17-003a-4d96-9ba0-36c1a1224997 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:16.988987 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791ed17-003a-4d96-9ba0-36c1a1224997 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:16.989362 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791ed17-003a-4d96-9ba0-36c1a1224997 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:16.990246 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791ed17-003a-4d96-9ba0-36c1a1224997 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:16.990696 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791ed17-003a-4d96-9ba0-36c1a1224997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:16.992156 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eed87b-6b20-4757-b5fb-e98c1c3f8782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:16.992288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791ed17-003a-4d96-9ba0-36c1a1224997 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:16.993221 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eed87b-6b20-4757-b5fb-e98c1c3f8782 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:16.993808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eed87b-6b20-4757-b5fb-e98c1c3f8782 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:16.994224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eed87b-6b20-4757-b5fb-e98c1c3f8782 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:17.001178 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 408/793] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:42:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:17.002562 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8e6a8-57bd-443b-8914-8dbbcc57012e None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:17.002946 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8e6a8-57bd-443b-8914-8dbbcc57012e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:17.003353 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8e6a8-57bd-443b-8914-8dbbcc57012e None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:17.004981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 409/794] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:17.006273 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8e6a8-57bd-443b-8914-8dbbcc57012e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:17.007069 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eed87b-6b20-4757-b5fb-e98c1c3f8782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:17.008681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eed87b-6b20-4757-b5fb-e98c1c3f8782 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:17.035307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-01eed87b-6b20-4757-b5fb-e98c1c3f8782 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:17.035307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:17.035307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:17.035307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:17.035307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:17.035307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:17.035307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:17.035307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:17.035307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:17.035307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:17.035307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:17.035307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:17.035307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:17.035307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:17.035307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:17.036515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:17.036515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:17.036515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:17.036515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:17.036515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:17.036515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:17.036515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:17.036515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:17.036515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:17.036515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:17.036515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:17.036515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:17.036515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:17.036515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:17.036515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:17.036515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:17.036515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:17.037630 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:17.037630 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:17.037630 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:17.037630 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:17.040026 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 386/795] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:17.041670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fc0bc-294c-407f-b8b1-d9cecbb7ff93 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:17.042128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fc0bc-294c-407f-b8b1-d9cecbb7ff93 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:17.042530 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fc0bc-294c-407f-b8b1-d9cecbb7ff93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:17.062982 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a92fc0bc-294c-407f-b8b1-d9cecbb7ff93 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:17.064804 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a92fc0bc-294c-407f-b8b1-d9cecbb7ff93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:17.122202 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8e6a8-57bd-443b-8914-8dbbcc57012e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:17.136449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 387/796] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:17.137532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fc0bc-294c-407f-b8b1-d9cecbb7ff93 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:17.156838 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c9ff0-507d-477c-b0af-c4d9c28a6fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:17.157858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c9ff0-507d-477c-b0af-c4d9c28a6fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:17.158274 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c9ff0-507d-477c-b0af-c4d9c28a6fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:17.158659 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c9ff0-507d-477c-b0af-c4d9c28a6fd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:17.169978 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c9ff0-507d-477c-b0af-c4d9c28a6fd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:17.171648 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c9ff0-507d-477c-b0af-c4d9c28a6fd8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:17.189730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-3d2c9ff0-507d-477c-b0af-c4d9c28a6fd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:17.189730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:17.189730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:17.189730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:17.189730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:17.189730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:17.189730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:17.189730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:17.189730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:17.189730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:17.189730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:17.189730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:17.189730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:17.189730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:17.189730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:17.190901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:17.190901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:17.190901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:17.190901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:17.190901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:17.190901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:17.190901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:17.190901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:17.190901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:17.190901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:17.190901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:17.190901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:17.190901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:17.190901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:17.190901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:17.190901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:17.190901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:17.192103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:17.192103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:17.192103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:17.192103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:17.193610 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 410/797] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:17.194584 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c9ff0-507d-477c-b0af-c4d9c28a6fd8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:17.248099 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fc0bc-294c-407f-b8b1-d9cecbb7ff93 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:17.281276 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348c2e7-26e5-44da-b253-b414d12b14e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:17.282198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348c2e7-26e5-44da-b253-b414d12b14e7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:17.282624 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348c2e7-26e5-44da-b253-b414d12b14e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:17.283216 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348c2e7-26e5-44da-b253-b414d12b14e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:17.284175 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348c2e7-26e5-44da-b253-b414d12b14e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:17.284697 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348c2e7-26e5-44da-b253-b414d12b14e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:17.286384 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348c2e7-26e5-44da-b253-b414d12b14e7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:17.294775 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c9ff0-507d-477c-b0af-c4d9c28a6fd8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:17.299026 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 388/798] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:17.300129 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348c2e7-26e5-44da-b253-b414d12b14e7 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:17.333924 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082ee58-2e0d-4b6f-a918-5ce064cffa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:17.334766 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082ee58-2e0d-4b6f-a918-5ce064cffa7e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:17.335079 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082ee58-2e0d-4b6f-a918-5ce064cffa7e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:17.335356 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082ee58-2e0d-4b6f-a918-5ce064cffa7e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:17.336023 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082ee58-2e0d-4b6f-a918-5ce064cffa7e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:17.337405 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082ee58-2e0d-4b6f-a918-5ce064cffa7e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:17.350088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-8082ee58-2e0d-4b6f-a918-5ce064cffa7e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 06:42:17.350088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:17.350088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:17.350088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:17.350088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:17.350088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:17.350088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:17.350088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:17.350088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 06:42:17.350088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:17.350088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:17.350088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:17.350088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:17.350088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:17.350088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:17.350088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:17.351161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:17.351161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:17.351161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:17.351161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:17.351161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:17.351161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:17.351161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:17.351161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:17.351161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:17.351161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:17.351161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:17.351161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:17.351161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:17.351161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:17.351161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:17.351161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:17.353068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:17.353068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:17.353068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:17.353068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:17.353068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:17.353068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:17.353068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:17.353068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:17.353068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:17.353068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:17.353068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:17.353068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:17.353068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:17.353068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 06:42:17.353068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:17.353068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 411/799] 10.222.0.77 () {56 vars in 1129 bytes} [Wed May 11 06:42:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:17.353924 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082ee58-2e0d-4b6f-a918-5ce064cffa7e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:17.404910 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348c2e7-26e5-44da-b253-b414d12b14e7 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:17.439939 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d7199-7bc9-44ad-9ed1-1b1aff9fecb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:17.440608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d7199-7bc9-44ad-9ed1-1b1aff9fecb0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:17.440887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d7199-7bc9-44ad-9ed1-1b1aff9fecb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:17.441163 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d7199-7bc9-44ad-9ed1-1b1aff9fecb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:17.442126 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d7199-7bc9-44ad-9ed1-1b1aff9fecb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:17.442446 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d7199-7bc9-44ad-9ed1-1b1aff9fecb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:17.443858 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d7199-7bc9-44ad-9ed1-1b1aff9fecb0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:17.456205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082ee58-2e0d-4b6f-a918-5ce064cffa7e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:17.456564 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 389/800] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:17.457234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d7199-7bc9-44ad-9ed1-1b1aff9fecb0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:17.491807 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd9b06-3426-41ab-9215-0e52e957a720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:17.492683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd9b06-3426-41ab-9215-0e52e957a720 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:17.492973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd9b06-3426-41ab-9215-0e52e957a720 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:17.493252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd9b06-3426-41ab-9215-0e52e957a720 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:17.500842 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd9b06-3426-41ab-9215-0e52e957a720 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:17.502253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd9b06-3426-41ab-9215-0e52e957a720 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:17.516925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-63dd9b06-3426-41ab-9215-0e52e957a720 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:17.516925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:17.516925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:17.516925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:17.516925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:17.516925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:17.516925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:17.516925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:17.516925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:17.516925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:17.516925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:17.516925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:17.516925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:42:17.516925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:42:17.516925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:42:17.519141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:42:17.519141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:17.519141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:17.519141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:17.519141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:17.519141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:17.519141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:17.519141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:17.519141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:17.519141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:17.519141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:17.519141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:17.519141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:17.519141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:17.519141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:17.519141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:17.519141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:17.521533 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:42:17.521533 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:42:17.521533 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:42:17.521533 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:42:17.521533 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:42:17.521533 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:42:17.521533 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:17.521533 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:17.530997 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 412/801] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:17.530997 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd9b06-3426-41ab-9215-0e52e957a720 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:17.553786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d7199-7bc9-44ad-9ed1-1b1aff9fecb0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:17.595152 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7feb6c1-1b28-4b17-84ec-b05da06d4097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:17.596634 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feb6c1-1b28-4b17-84ec-b05da06d4097 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:17.597139 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feb6c1-1b28-4b17-84ec-b05da06d4097 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:17.598284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feb6c1-1b28-4b17-84ec-b05da06d4097 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:17.599058 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7feb6c1-1b28-4b17-84ec-b05da06d4097 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:17.599585 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7feb6c1-1b28-4b17-84ec-b05da06d4097 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:17.601220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7feb6c1-1b28-4b17-84ec-b05da06d4097 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:17.606115 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 390/802] 10.222.0.77 () {56 vars in 1124 bytes} [Wed May 11 06:42:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:17.606970 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7feb6c1-1b28-4b17-84ec-b05da06d4097 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:17.628426 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd9b06-3426-41ab-9215-0e52e957a720 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:17.660591 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1fcb3-5256-43bd-b3ef-bde96f5c0879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:17.661461 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1fcb3-5256-43bd-b3ef-bde96f5c0879 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:17.661743 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1fcb3-5256-43bd-b3ef-bde96f5c0879 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:17.662010 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1fcb3-5256-43bd-b3ef-bde96f5c0879 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:17.669241 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1fcb3-5256-43bd-b3ef-bde96f5c0879 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:17.670687 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1fcb3-5256-43bd-b3ef-bde96f5c0879 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:17.686504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-9ba1fcb3-5256-43bd-b3ef-bde96f5c0879 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 06:42:17.686504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:17.686504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:17.686504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:17.686504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:17.686504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:17.686504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:17.686504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:17.686504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:17.686504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:17.686504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:17.686504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:17.686504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:42:17.686504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:42:17.686504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:42:17.686504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:42:17.687601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:17.687601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:17.687601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:42:17.687601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:17.687601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:42:17.687601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:17.687601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:17.687601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:17.687601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:17.687601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:17.687601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:17.687601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:17.687601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:17.687601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:17.687601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:17.687601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:17.687601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:17.687601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:17.688562 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:17.688562 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:17.688562 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:42:17.688562 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:42:17.688562 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:42:17.688562 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:42:17.688562 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:42:17.688562 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:42:17.688562 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 06:42:17.688562 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:17.695221 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 413/803] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:42:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:17.695221 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b553863-3be5-4266-954e-f5eda96468dc None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:17.695221 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b553863-3be5-4266-954e-f5eda96468dc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:17.695221 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b553863-3be5-4266-954e-f5eda96468dc None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:17.695221 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 414/804] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:17.696036 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b553863-3be5-4266-954e-f5eda96468dc None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:17.714795 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7feb6c1-1b28-4b17-84ec-b05da06d4097 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:17.749727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff9559-10cf-4de9-902a-91a1090311b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:17.750391 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff9559-10cf-4de9-902a-91a1090311b0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:17.750671 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff9559-10cf-4de9-902a-91a1090311b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:17.751023 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff9559-10cf-4de9-902a-91a1090311b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:17.751759 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff9559-10cf-4de9-902a-91a1090311b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:17.752065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff9559-10cf-4de9-902a-91a1090311b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:17.753508 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff9559-10cf-4de9-902a-91a1090311b0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:17.764982 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 391/805] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:42:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:17.765590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff9559-10cf-4de9-902a-91a1090311b0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:17.804407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b553863-3be5-4266-954e-f5eda96468dc None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:17.839960 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e73ec-2d51-4983-af61-1a48b8f027a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:17.840625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e73ec-2d51-4983-af61-1a48b8f027a7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:17.840905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e73ec-2d51-4983-af61-1a48b8f027a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:17.841195 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e73ec-2d51-4983-af61-1a48b8f027a7 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:17.841981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e73ec-2d51-4983-af61-1a48b8f027a7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:17.842287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e73ec-2d51-4983-af61-1a48b8f027a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:17.843700 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e73ec-2d51-4983-af61-1a48b8f027a7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:17.848451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 415/806] 10.222.0.77 () {56 vars in 1124 bytes} [Wed May 11 06:42:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:17.849626 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751c7c0-aea0-48af-a15d-4481f3664533 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:17.849912 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751c7c0-aea0-48af-a15d-4481f3664533 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:17.850186 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751c7c0-aea0-48af-a15d-4481f3664533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:17.863331 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff9559-10cf-4de9-902a-91a1090311b0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:17.866093 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7751c7c0-aea0-48af-a15d-4481f3664533 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:17.867297 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7751c7c0-aea0-48af-a15d-4481f3664533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:17.894571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36d239-7fa9-4de4-afaf-7ce760b2ee5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:17.895310 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36d239-7fa9-4de4-afaf-7ce760b2ee5e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:17.895624 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36d239-7fa9-4de4-afaf-7ce760b2ee5e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:17.895894 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36d239-7fa9-4de4-afaf-7ce760b2ee5e None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:17.896729 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36d239-7fa9-4de4-afaf-7ce760b2ee5e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:17.897040 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36d239-7fa9-4de4-afaf-7ce760b2ee5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:17.898476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36d239-7fa9-4de4-afaf-7ce760b2ee5e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:17.915045 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 392/807] 10.222.0.77 () {56 vars in 1135 bytes} [Wed May 11 06:42:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:17.915828 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36d239-7fa9-4de4-afaf-7ce760b2ee5e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:17.929219 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 416/808] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:17.930004 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751c7c0-aea0-48af-a15d-4481f3664533 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:18.009155 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36d239-7fa9-4de4-afaf-7ce760b2ee5e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:18.025702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751c7c0-aea0-48af-a15d-4481f3664533 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:18.042277 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ff957-3591-4221-a3ef-d4db51386e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:18.042934 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ff957-3591-4221-a3ef-d4db51386e81 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:18.043244 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ff957-3591-4221-a3ef-d4db51386e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:18.043512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ff957-3591-4221-a3ef-d4db51386e81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:18.044344 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ff957-3591-4221-a3ef-d4db51386e81 None admin] RBAC: Adding query filter params (role.id=5debd8ad07a74bedbf2efd53b11cd7cd, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=edf9d57de89a4701ba1a5b079d0ad348) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:18.044648 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ff957-3591-4221-a3ef-d4db51386e81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:18.046077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ff957-3591-4221-a3ef-d4db51386e81 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:18.052100 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 393/809] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:42:17 2022] GET /identity/v3/role_assignments?user.id=edf9d57de89a4701ba1a5b079d0ad348&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=5debd8ad07a74bedbf2efd53b11cd7cd => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:18.053278 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470f729-c973-4d09-b3c3-1da1584da04f None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:18.053561 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470f729-c973-4d09-b3c3-1da1584da04f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:18.053827 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470f729-c973-4d09-b3c3-1da1584da04f None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:18.055037 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 394/810] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:18.055731 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470f729-c973-4d09-b3c3-1da1584da04f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:18.068873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fabb4-2756-4ab4-b0bc-a3fb84e5bea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:18.069567 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fabb4-2756-4ab4-b0bc-a3fb84e5bea2 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:18.069833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fabb4-2756-4ab4-b0bc-a3fb84e5bea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:18.070114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fabb4-2756-4ab4-b0bc-a3fb84e5bea2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:18.071250 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fabb4-2756-4ab4-b0bc-a3fb84e5bea2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:18.072676 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fabb4-2756-4ab4-b0bc-a3fb84e5bea2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:18.096087 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 417/811] 10.222.0.77 () {60 vars in 1144 bytes} [Wed May 11 06:42:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:42:18.104192 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fabb4-2756-4ab4-b0bc-a3fb84e5bea2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:18.186355 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470f729-c973-4d09-b3c3-1da1584da04f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:18.220878 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fabb4-2756-4ab4-b0bc-a3fb84e5bea2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:18.226001 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2046b3-56ad-4b14-b78a-87260b2005c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:18.227279 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2046b3-56ad-4b14-b78a-87260b2005c8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:18.227740 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2046b3-56ad-4b14-b78a-87260b2005c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:18.228184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2046b3-56ad-4b14-b78a-87260b2005c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:18.240241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2046b3-56ad-4b14-b78a-87260b2005c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:18.242340 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2046b3-56ad-4b14-b78a-87260b2005c8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:18.263209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-7b2046b3-56ad-4b14-b78a-87260b2005c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:18.263209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:18.263209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:18.263209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:18.263209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:18.263209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:18.263209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:18.263209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:18.263209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:18.263209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:18.263209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:18.263209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:18.263209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:18.263209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:18.263209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:18.264320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:18.264320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:18.264320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:18.264320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:18.264320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:18.264320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:18.264320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:18.264320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:18.264320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:18.264320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:18.264320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:18.264320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:18.264320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:18.264320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:18.264320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:18.264320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:18.264320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:18.265407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:18.265407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:18.265407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:18.265407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:18.265681 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d9801-bbf1-4dcb-99c3-26d6150a788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:18.265681 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d9801-bbf1-4dcb-99c3-26d6150a788a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:18.265681 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d9801-bbf1-4dcb-99c3-26d6150a788a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:18.265681 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d9801-bbf1-4dcb-99c3-26d6150a788a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:18.272330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 395/812] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:18.273882 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9f6cd-47e6-455c-8381-e5b8e735038b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:18.274106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9f6cd-47e6-455c-8381-e5b8e735038b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:18.275009 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9f6cd-47e6-455c-8381-e5b8e735038b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:18.288769 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d9801-bbf1-4dcb-99c3-26d6150a788a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:42:18.293602 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-bab9f6cd-47e6-455c-8381-e5b8e735038b None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:18.294856 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bab9f6cd-47e6-455c-8381-e5b8e735038b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:18.298310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5d4d9801-bbf1-4dcb-99c3-26d6150a788a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:42:18.298310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:18.298310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:18.298310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:18.298310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:18.298310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:18.298310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:18.298310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:18.298310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:18.298310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:18.298310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:18.298310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:18.298310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:42:18.298310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:42:18.298310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:42:18.298310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:42:18.299317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:42:18.299317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:42:18.299317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:42:18.299317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:42:18.299317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:18.299317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:18.299317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:18.299317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:18.299317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:18.299317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:18.299317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:18.299317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:18.299317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:18.299317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:18.299317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:18.299317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:18.301735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:18.301735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:18.301735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:18.301735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:18.301735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:42:18.301735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:42:18.301735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:42:18.301735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:42:18.301735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:42:18.301735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:42:18.301735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:42:18.301735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:18.301735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 418/813] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:42:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:18.301735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d9801-bbf1-4dcb-99c3-26d6150a788a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:18.392935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 396/814] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:18.393803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9f6cd-47e6-455c-8381-e5b8e735038b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:18.427257 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d9801-bbf1-4dcb-99c3-26d6150a788a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:18.470777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558eed45-6d4f-441d-ae75-e3a25844f820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:18.471482 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558eed45-6d4f-441d-ae75-e3a25844f820 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:18.471760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558eed45-6d4f-441d-ae75-e3a25844f820 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:18.472037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558eed45-6d4f-441d-ae75-e3a25844f820 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:18.472762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558eed45-6d4f-441d-ae75-e3a25844f820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:18.473066 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558eed45-6d4f-441d-ae75-e3a25844f820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:18.474553 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558eed45-6d4f-441d-ae75-e3a25844f820 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:18.486546 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 419/815] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:18.492502 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558eed45-6d4f-441d-ae75-e3a25844f820 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:18.493015 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9f6cd-47e6-455c-8381-e5b8e735038b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:18.534517 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310ed74-5f86-4a17-ba38-2a0ee5b84383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:18.535156 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310ed74-5f86-4a17-ba38-2a0ee5b84383 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:18.535441 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310ed74-5f86-4a17-ba38-2a0ee5b84383 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:18.535706 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310ed74-5f86-4a17-ba38-2a0ee5b84383 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:18.536518 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310ed74-5f86-4a17-ba38-2a0ee5b84383 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:18.536817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310ed74-5f86-4a17-ba38-2a0ee5b84383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:18.538246 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310ed74-5f86-4a17-ba38-2a0ee5b84383 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:18.551035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 397/816] 10.222.0.77 () {56 vars in 1103 bytes} [Wed May 11 06:42:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:18.552187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310ed74-5f86-4a17-ba38-2a0ee5b84383 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:18.611871 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558eed45-6d4f-441d-ae75-e3a25844f820 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:18.646871 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097975f-6292-43ff-a041-ff7069125a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:18.648046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097975f-6292-43ff-a041-ff7069125a83 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:18.648801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097975f-6292-43ff-a041-ff7069125a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:18.649290 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097975f-6292-43ff-a041-ff7069125a83 None admin] PATH_INFO: `/v3/services/network` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:18.650158 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097975f-6292-43ff-a041-ff7069125a83 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:18.651776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097975f-6292-43ff-a041-ff7069125a83 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:18.664526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-0097975f-6292-43ff-a041-ff7069125a83 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 06:42:18.664526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:18.664526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:18.664526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:18.664526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:18.664526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:18.664526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:18.664526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:18.664526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 06:42:18.664526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:18.664526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:18.664526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:18.664526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:18.664526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:18.664526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:18.664526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:18.664526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:18.665583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:18.665583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:18.665583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:18.665583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:18.665583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:18.665583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:18.665583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:18.665583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:18.665583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:18.665583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:18.665583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:18.665583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:18.665583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:18.665583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:18.665583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:18.665583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:18.666447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:18.666447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:18.666447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:18.666447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:18.666447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:18.666447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:18.666447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:18.666447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:18.666447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:18.666447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:18.666447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:18.666447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:18.666447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 06:42:18.666447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:18.667222 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310ed74-5f86-4a17-ba38-2a0ee5b84383 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:18.669460 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 420/817] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:18 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:18.670481 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097975f-6292-43ff-a041-ff7069125a83 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:18.706068 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f377a-9d28-4646-8da4-9413639adcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:18.706878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f377a-9d28-4646-8da4-9413639adcf5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:18.707336 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f377a-9d28-4646-8da4-9413639adcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:18.707613 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f377a-9d28-4646-8da4-9413639adcf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:18.717087 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f377a-9d28-4646-8da4-9413639adcf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:18.718552 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f377a-9d28-4646-8da4-9413639adcf5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:18.737568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-d94f377a-9d28-4646-8da4-9413639adcf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:18.737568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:18.737568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:18.737568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:18.737568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:18.737568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:18.737568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:18.737568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:18.737568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:18.737568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:18.737568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:18.737568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:18.737568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:42:18.737568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:42:18.737568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:42:18.738532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:42:18.738532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:18.738532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:18.738532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:18.738532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:18.738532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:18.738532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:18.738532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:18.738532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:18.738532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:18.738532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:18.738532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:18.738532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:18.738532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:18.738532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:18.738532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:18.738532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:18.739600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:42:18.739600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:42:18.739600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:42:18.739600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:42:18.739600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:42:18.739600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:42:18.739600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:18.739600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:18.739600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 398/818] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:18.744152 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f377a-9d28-4646-8da4-9413639adcf5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:18.796309 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097975f-6292-43ff-a041-ff7069125a83 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:18.830013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e7f51-f186-4365-9c09-5c6a0050f2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:18.830762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e7f51-f186-4365-9c09-5c6a0050f2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:18.831070 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e7f51-f186-4365-9c09-5c6a0050f2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:18.831349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e7f51-f186-4365-9c09-5c6a0050f2d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:18.842246 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f377a-9d28-4646-8da4-9413639adcf5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:18.842426 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e7f51-f186-4365-9c09-5c6a0050f2d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:18.843971 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e7f51-f186-4365-9c09-5c6a0050f2d8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:18.861702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-806e7f51-f186-4365-9c09-5c6a0050f2d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:18.861702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:18.861702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:18.861702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:18.861702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:18.861702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:18.861702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:18.861702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:18.861702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:18.861702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:18.861702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:18.861702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:18.861702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:18.861702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:18.861702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:18.862862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:18.862862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:18.862862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:18.862862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:18.862862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:18.862862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:18.862862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:18.862862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:18.862862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:18.862862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:18.862862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:18.862862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:18.862862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:18.862862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:18.862862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:18.862862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:18.862862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:18.864138 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:18.864138 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:18.864138 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:18.864138 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:18.867691 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 421/819] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:18.868538 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e7f51-f186-4365-9c09-5c6a0050f2d8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:18.879668 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc3ca0-5893-4831-8cf2-0c8e13822439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:18.880930 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3ca0-5893-4831-8cf2-0c8e13822439 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:18.881363 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3ca0-5893-4831-8cf2-0c8e13822439 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:18.881779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3ca0-5893-4831-8cf2-0c8e13822439 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:18.882629 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc3ca0-5893-4831-8cf2-0c8e13822439 None admin] RBAC: Adding query filter params (name=network) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:18.883107 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc3ca0-5893-4831-8cf2-0c8e13822439 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:18.884611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc3ca0-5893-4831-8cf2-0c8e13822439 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:18.894195 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 399/820] 10.222.0.77 () {56 vars in 1112 bytes} [Wed May 11 06:42:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:18.895396 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc3ca0-5893-4831-8cf2-0c8e13822439 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:18.968833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e7f51-f186-4365-9c09-5c6a0050f2d8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:18.992541 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc3ca0-5893-4831-8cf2-0c8e13822439 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:19.002606 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275898bb-5896-4f11-82dd-226f19926383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:19.003320 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275898bb-5896-4f11-82dd-226f19926383 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:19.003603 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275898bb-5896-4f11-82dd-226f19926383 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:19.003878 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275898bb-5896-4f11-82dd-226f19926383 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:19.004737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275898bb-5896-4f11-82dd-226f19926383 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:19.005179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275898bb-5896-4f11-82dd-226f19926383 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:19.006913 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275898bb-5896-4f11-82dd-226f19926383 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:19.024885 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 422/821] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:42:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:19.026070 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275898bb-5896-4f11-82dd-226f19926383 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:19.030345 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d16cc7-4824-4ce7-bf5e-f90946027dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:19.031290 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d16cc7-4824-4ce7-bf5e-f90946027dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:19.031727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d16cc7-4824-4ce7-bf5e-f90946027dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:19.032213 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d16cc7-4824-4ce7-bf5e-f90946027dd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:19.033077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d16cc7-4824-4ce7-bf5e-f90946027dd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:19.033561 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d16cc7-4824-4ce7-bf5e-f90946027dd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:19.035175 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d16cc7-4824-4ce7-bf5e-f90946027dd1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:19.047663 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 400/822] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:19.048687 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d16cc7-4824-4ce7-bf5e-f90946027dd1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:19.130488 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275898bb-5896-4f11-82dd-226f19926383 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:19.143352 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d16cc7-4824-4ce7-bf5e-f90946027dd1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:19.166552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc21a6-ae8e-45ce-aa02-3d0932422389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:19.167267 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc21a6-ae8e-45ce-aa02-3d0932422389 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:19.167539 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc21a6-ae8e-45ce-aa02-3d0932422389 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:19.167839 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc21a6-ae8e-45ce-aa02-3d0932422389 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:19.168514 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc21a6-ae8e-45ce-aa02-3d0932422389 None admin] RBAC: Adding query filter params (type=network) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:19.168818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc21a6-ae8e-45ce-aa02-3d0932422389 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:19.170190 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc21a6-ae8e-45ce-aa02-3d0932422389 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:19.180326 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 423/823] 10.222.0.77 () {56 vars in 1112 bytes} [Wed May 11 06:42:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:19.180326 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc21a6-ae8e-45ce-aa02-3d0932422389 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:19.183420 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884442e8-e714-4bee-b083-949491261c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:19.184637 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884442e8-e714-4bee-b083-949491261c9a None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:19.185077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884442e8-e714-4bee-b083-949491261c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:19.185487 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884442e8-e714-4bee-b083-949491261c9a None admin] PATH_INFO: `/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/f726f58d30734be7abf15400bff89533/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:19.187648 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884442e8-e714-4bee-b083-949491261c9a None admin] RBAC: Authorizing `identity:create_grant(project_id=0f573a9de6904664ace6287072a8a7dc, user_id=f726f58d30734be7abf15400bff89533, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:19.189263 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884442e8-e714-4bee-b083-949491261c9a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:19.206220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 401/824] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:42:19 2022] PUT /identity/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/f726f58d30734be7abf15400bff89533/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:42:19.207447 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884442e8-e714-4bee-b083-949491261c9a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:19.319644 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884442e8-e714-4bee-b083-949491261c9a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:19.348489 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc21a6-ae8e-45ce-aa02-3d0932422389 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:19.365694 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e345d72-f71b-4980-a337-e3bf65361a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:19.366755 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e345d72-f71b-4980-a337-e3bf65361a68 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:19.367205 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e345d72-f71b-4980-a337-e3bf65361a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:19.367619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e345d72-f71b-4980-a337-e3bf65361a68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:19.370828 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e345d72-f71b-4980-a337-e3bf65361a68 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:19.372531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e345d72-f71b-4980-a337-e3bf65361a68 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:19.406265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 402/825] 10.222.0.77 () {60 vars in 1144 bytes} [Wed May 11 06:42:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:42:19.438166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a945b-b902-4ee9-9f1a-f18c2dd7b609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:19.439398 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a945b-b902-4ee9-9f1a-f18c2dd7b609 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:19.439876 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a945b-b902-4ee9-9f1a-f18c2dd7b609 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:19.440338 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a945b-b902-4ee9-9f1a-f18c2dd7b609 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:19.453847 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a945b-b902-4ee9-9f1a-f18c2dd7b609 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:19.455746 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a945b-b902-4ee9-9f1a-f18c2dd7b609 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:19.483770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-847a945b-b902-4ee9-9f1a-f18c2dd7b609 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:42:19.483770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:19.483770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:19.483770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:19.483770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:19.483770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:19.483770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:19.483770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:19.483770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:19.483770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:19.483770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:19.483770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:19.483770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:42:19.483770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:42:19.483770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:42:19.483770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:42:19.485017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:19.485017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:19.485017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:42:19.485017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:19.485017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:42:19.485017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:19.485017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:19.485017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:19.485017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:19.485017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:19.485017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:19.485017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:19.485017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:19.485017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:19.485017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:19.485017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:19.485017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:19.485017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:19.486235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:19.486235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:19.486235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:42:19.486235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:42:19.486235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:42:19.486235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:42:19.486235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:42:19.486235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:42:19.486235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:42:19.486235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:19.488589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 424/826] 10.222.0.77 () {56 vars in 1117 bytes} [Wed May 11 06:42:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:19.495352 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e345d72-f71b-4980-a337-e3bf65361a68 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:19.619016 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e345d72-f71b-4980-a337-e3bf65361a68 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:19.660935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e732c72-ff5e-4c15-b80c-f40700967eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:19.661902 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e732c72-ff5e-4c15-b80c-f40700967eeb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:19.662353 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e732c72-ff5e-4c15-b80c-f40700967eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:19.662768 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e732c72-ff5e-4c15-b80c-f40700967eeb None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:19.663896 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e732c72-ff5e-4c15-b80c-f40700967eeb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:19.664347 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e732c72-ff5e-4c15-b80c-f40700967eeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:19.665937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e732c72-ff5e-4c15-b80c-f40700967eeb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:19.692910 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 403/827] 10.222.0.77 () {56 vars in 1149 bytes} [Wed May 11 06:42:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:19.698999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a945b-b902-4ee9-9f1a-f18c2dd7b609 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:19.796901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a945b-b902-4ee9-9f1a-f18c2dd7b609 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:19.829778 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7854eb-8da7-40be-9549-24cca2191026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:19.830827 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7854eb-8da7-40be-9549-24cca2191026 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:19.831289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7854eb-8da7-40be-9549-24cca2191026 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:19.831700 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7854eb-8da7-40be-9549-24cca2191026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:19.842748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7854eb-8da7-40be-9549-24cca2191026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:19.844552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7854eb-8da7-40be-9549-24cca2191026 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:19.862268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-be7854eb-8da7-40be-9549-24cca2191026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:19.862268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:19.862268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:19.862268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:19.862268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:19.862268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:19.862268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:19.862268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:19.862268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:19.862268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:19.862268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:19.862268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:19.862268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:19.862268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:19.862268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:19.863420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:19.863420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:19.863420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:19.863420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:19.863420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:19.863420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:19.863420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:19.863420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:19.863420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:19.863420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:19.863420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:19.863420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:19.863420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:19.863420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:19.863420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:19.863420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:19.863420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:19.864514 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:19.864514 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:19.864514 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:19.864514 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:19.866310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 425/828] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:19.871890 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e732c72-ff5e-4c15-b80c-f40700967eeb None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:19.979760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e732c72-ff5e-4c15-b80c-f40700967eeb None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:20.020691 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56bb9f-0c54-4de4-b0d7-922eed361820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:20.021677 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56bb9f-0c54-4de4-b0d7-922eed361820 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:20.022128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56bb9f-0c54-4de4-b0d7-922eed361820 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:20.022591 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56bb9f-0c54-4de4-b0d7-922eed361820 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:20.023570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56bb9f-0c54-4de4-b0d7-922eed361820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:20.024072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56bb9f-0c54-4de4-b0d7-922eed361820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:20.025693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56bb9f-0c54-4de4-b0d7-922eed361820 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:20.038011 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 404/829] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:20.043458 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7854eb-8da7-40be-9549-24cca2191026 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:20.148818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7854eb-8da7-40be-9549-24cca2191026 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:20.182087 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edaf49-9a34-46d4-a512-ab512079a0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:20.182944 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edaf49-9a34-46d4-a512-ab512079a0fd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:20.183254 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edaf49-9a34-46d4-a512-ab512079a0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:20.183624 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edaf49-9a34-46d4-a512-ab512079a0fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:20.190289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edaf49-9a34-46d4-a512-ab512079a0fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:20.191771 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edaf49-9a34-46d4-a512-ab512079a0fd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:20.206042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f0edaf49-9a34-46d4-a512-ab512079a0fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:20.206042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:20.206042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:20.206042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:20.206042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:20.206042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:20.206042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:20.206042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:20.206042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:20.206042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:20.206042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:20.206042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:20.206042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:42:20.206042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:42:20.206042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:42:20.207003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:42:20.207003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:20.207003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:20.207003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:20.207003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:20.207003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:20.207003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:20.207003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:20.207003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:20.207003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:20.207003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:20.207003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:20.207003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:20.207003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:20.207003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:20.207003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:20.207003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:20.208025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:42:20.208025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:42:20.208025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:42:20.208025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:42:20.208025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:42:20.208025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:42:20.208025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:20.208025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:20.208025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 426/830] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:20.212999 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56bb9f-0c54-4de4-b0d7-922eed361820 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:20.315804 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56bb9f-0c54-4de4-b0d7-922eed361820 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:20.352619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fdd3f2-2304-48d1-b295-877895af7832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:20.353697 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fdd3f2-2304-48d1-b295-877895af7832 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:20.354170 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fdd3f2-2304-48d1-b295-877895af7832 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:20.354663 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fdd3f2-2304-48d1-b295-877895af7832 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:20.355698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fdd3f2-2304-48d1-b295-877895af7832 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:20.356272 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fdd3f2-2304-48d1-b295-877895af7832 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:20.357945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fdd3f2-2304-48d1-b295-877895af7832 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:20.372972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 405/831] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:42:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:20.378764 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edaf49-9a34-46d4-a512-ab512079a0fd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:20.472818 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31a9fa-b197-4882-9e8a-b5792edd4f1e None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:20.473185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31a9fa-b197-4882-9e8a-b5792edd4f1e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:20.473593 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31a9fa-b197-4882-9e8a-b5792edd4f1e None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:20.476397 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 406/832] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:20.480329 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d529ad-5803-4237-bac9-44ace119c60f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:20.480741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d529ad-5803-4237-bac9-44ace119c60f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:20.481161 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d529ad-5803-4237-bac9-44ace119c60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:20.483392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edaf49-9a34-46d4-a512-ab512079a0fd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:20.498677 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-78d529ad-5803-4237-bac9-44ace119c60f None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:20.500256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-78d529ad-5803-4237-bac9-44ace119c60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:20.517704 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6d9dc-6b21-4771-9747-8549e84767c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:20.518864 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6d9dc-6b21-4771-9747-8549e84767c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:20.519308 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6d9dc-6b21-4771-9747-8549e84767c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:20.519709 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6d9dc-6b21-4771-9747-8549e84767c1 None admin] PATH_INFO: `/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/99cbf80fc74c4183a6eed3e97f7196f9/roles/46d109e3a1bd4f13b0d145cde46c75a9` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:20.534165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6d9dc-6b21-4771-9747-8549e84767c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f573a9de6904664ace6287072a8a7dc, user_id=99cbf80fc74c4183a6eed3e97f7196f9, role_id=46d109e3a1bd4f13b0d145cde46c75a9)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:20.535848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6d9dc-6b21-4771-9747-8549e84767c1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:20.551663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 427/833] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:42:20 2022] PUT /identity/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/99cbf80fc74c4183a6eed3e97f7196f9/roles/46d109e3a1bd4f13b0d145cde46c75a9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:42:20.553267 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3466e17-1abd-4f7e-8f27-e8fd47520a19 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:20.553700 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3466e17-1abd-4f7e-8f27-e8fd47520a19 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:20.553978 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3466e17-1abd-4f7e-8f27-e8fd47520a19 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:20.555582 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 428/834] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:20.565016 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8375a9-5d3c-47c3-a21d-df743ca94705 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:20.565394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8375a9-5d3c-47c3-a21d-df743ca94705 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:20.565578 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8375a9-5d3c-47c3-a21d-df743ca94705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:20.587363 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 407/835] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:42:20.587566 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8f8375a9-5d3c-47c3-a21d-df743ca94705 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:20.587819 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8f8375a9-5d3c-47c3-a21d-df743ca94705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:20.609223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d529ad-5803-4237-bac9-44ace119c60f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:20.667985 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 429/836] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:42:20.690623 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8375a9-5d3c-47c3-a21d-df743ca94705 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:20.721167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d529ad-5803-4237-bac9-44ace119c60f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:20.761876 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e33216-c38d-4924-b28b-b5940342098c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:20.762630 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e33216-c38d-4924-b28b-b5940342098c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:20.762906 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e33216-c38d-4924-b28b-b5940342098c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:20.763203 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e33216-c38d-4924-b28b-b5940342098c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:20.763861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e33216-c38d-4924-b28b-b5940342098c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:20.765225 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e33216-c38d-4924-b28b-b5940342098c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:20.777654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-88e33216-c38d-4924-b28b-b5940342098c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 06:42:20.777654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:20.777654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:20.777654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:20.777654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:20.777654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:20.777654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:20.777654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:20.777654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 06:42:20.777654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:20.777654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:20.777654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:20.777654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:20.777654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:20.777654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:20.777654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:20.778803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:20.778803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:20.778803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:20.778803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:20.778803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:20.778803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:20.778803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:20.778803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:20.778803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:20.778803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:20.778803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:20.778803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:20.778803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:20.778803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:20.778803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:20.778803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:20.779936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:20.779936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:20.779936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:20.779936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:20.779936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:20.779936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:20.779936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:20.779936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:20.779936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:20.779936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:20.779936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:20.779936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:20.779936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:20.779936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 06:42:20.779936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:20.782175 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 408/837] 10.222.0.77 () {56 vars in 1132 bytes} [Wed May 11 06:42:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:20.789548 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e33216-c38d-4924-b28b-b5940342098c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:20.813526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8375a9-5d3c-47c3-a21d-df743ca94705 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:20.859355 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23d430-43c2-4ed4-a5a9-ec5d628911c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:20.860239 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23d430-43c2-4ed4-a5a9-ec5d628911c8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:20.860744 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23d430-43c2-4ed4-a5a9-ec5d628911c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:20.861029 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23d430-43c2-4ed4-a5a9-ec5d628911c8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:20.861692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23d430-43c2-4ed4-a5a9-ec5d628911c8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:20.863673 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23d430-43c2-4ed4-a5a9-ec5d628911c8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:20.877479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-bc23d430-43c2-4ed4-a5a9-ec5d628911c8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 06:42:20.877479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:20.877479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:20.877479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:20.877479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:20.877479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:20.877479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:20.877479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:20.877479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 06:42:20.877479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:20.877479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:20.877479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:20.877479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:20.877479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:20.877479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:20.877479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:20.877479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:20.878537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:20.878537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:20.878537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:20.878537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:20.878537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:20.878537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:20.878537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:20.878537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:20.878537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:20.878537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:20.878537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:20.878537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:20.878537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:20.878537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:20.878537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:20.878537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:20.879432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:20.879432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:20.879432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:20.879432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:20.879432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:20.879432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:20.879432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:20.879432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:20.879432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:20.879432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:20.879432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:20.879432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:20.879432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 06:42:20.879432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:20.879432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 430/838] 10.222.0.77 () {56 vars in 1114 bytes} [Wed May 11 06:42:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:20.884654 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23d430-43c2-4ed4-a5a9-ec5d628911c8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:20.918551 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e33216-c38d-4924-b28b-b5940342098c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:20.960689 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1ddd1-59c9-4b4a-b050-0eeaee03e038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:20.962103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1ddd1-59c9-4b4a-b050-0eeaee03e038 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:20.962565 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1ddd1-59c9-4b4a-b050-0eeaee03e038 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:20.963057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1ddd1-59c9-4b4a-b050-0eeaee03e038 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:20.964325 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1ddd1-59c9-4b4a-b050-0eeaee03e038 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:20.965109 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1ddd1-59c9-4b4a-b050-0eeaee03e038 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:20.966979 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1ddd1-59c9-4b4a-b050-0eeaee03e038 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:20.977918 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 409/839] 10.222.0.77 () {56 vars in 1126 bytes} [Wed May 11 06:42:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:20.978553 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1ddd1-59c9-4b4a-b050-0eeaee03e038 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:20.992841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23d430-43c2-4ed4-a5a9-ec5d628911c8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:21.034918 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c8bce-ae7a-4121-9e0f-b08f70956c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:21.036053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c8bce-ae7a-4121-9e0f-b08f70956c61 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:21.036772 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c8bce-ae7a-4121-9e0f-b08f70956c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:21.037448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c8bce-ae7a-4121-9e0f-b08f70956c61 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:21.038330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c8bce-ae7a-4121-9e0f-b08f70956c61 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:21.038779 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c8bce-ae7a-4121-9e0f-b08f70956c61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:21.040500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c8bce-ae7a-4121-9e0f-b08f70956c61 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:21.047327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 431/840] 10.222.0.77 () {56 vars in 1114 bytes} [Wed May 11 06:42:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:21.053310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c8bce-ae7a-4121-9e0f-b08f70956c61 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:21.079232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1ddd1-59c9-4b4a-b050-0eeaee03e038 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:21.112560 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93395acb-5eac-4197-aa21-047653066510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:21.113141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93395acb-5eac-4197-aa21-047653066510 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:21.113418 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93395acb-5eac-4197-aa21-047653066510 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:21.113686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93395acb-5eac-4197-aa21-047653066510 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:21.114492 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93395acb-5eac-4197-aa21-047653066510 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:21.114748 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93395acb-5eac-4197-aa21-047653066510 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:21.116138 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93395acb-5eac-4197-aa21-047653066510 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:21.126990 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 410/841] 10.222.0.77 () {56 vars in 1126 bytes} [Wed May 11 06:42:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:21.169141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c8bce-ae7a-4121-9e0f-b08f70956c61 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:21.203823 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f913c70-2c99-4aea-ae8b-b53d924fd815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:21.204697 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f913c70-2c99-4aea-ae8b-b53d924fd815 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:21.205036 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f913c70-2c99-4aea-ae8b-b53d924fd815 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:21.205367 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f913c70-2c99-4aea-ae8b-b53d924fd815 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:21.206159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f913c70-2c99-4aea-ae8b-b53d924fd815 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:21.206525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f913c70-2c99-4aea-ae8b-b53d924fd815 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:21.208107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f913c70-2c99-4aea-ae8b-b53d924fd815 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:21.213815 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 432/842] 10.222.0.77 () {56 vars in 1114 bytes} [Wed May 11 06:42:21 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:21.789172 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983727b-0a5d-4b96-b137-4b46c9eaa9b8 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:21.789494 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983727b-0a5d-4b96-b137-4b46c9eaa9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:21.789770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983727b-0a5d-4b96-b137-4b46c9eaa9b8 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:21.791365 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 411/843] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:21.796927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e93d83-0c9f-4669-801b-1b9cf3cebfca None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:21.797220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e93d83-0c9f-4669-801b-1b9cf3cebfca None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:21.797501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e93d83-0c9f-4669-801b-1b9cf3cebfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:21.814100 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-23e93d83-0c9f-4669-801b-1b9cf3cebfca None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:21.815332 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-23e93d83-0c9f-4669-801b-1b9cf3cebfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:21.884088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 433/844] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:21.907240 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983727b-0a5d-4b96-b137-4b46c9eaa9b8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:22.004886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983727b-0a5d-4b96-b137-4b46c9eaa9b8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:22.037795 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ecc0a-714d-4e4b-b67a-b61ad4f5533b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:22.038596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ecc0a-714d-4e4b-b67a-b61ad4f5533b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:22.038872 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ecc0a-714d-4e4b-b67a-b61ad4f5533b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:22.039228 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ecc0a-714d-4e4b-b67a-b61ad4f5533b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:22.050426 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ecc0a-714d-4e4b-b67a-b61ad4f5533b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:42:22.058120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-f51ecc0a-714d-4e4b-b67a-b61ad4f5533b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:42:22.058120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:22.058120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:22.058120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:22.058120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:22.058120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:22.058120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:22.058120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:22.058120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:22.058120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:22.058120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:22.058120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:22.058120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:42:22.058120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:42:22.058120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:42:22.058120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:42:22.059075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:42:22.059075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:42:22.059075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:42:22.059075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:42:22.059075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:22.059075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:22.059075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:22.059075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:22.059075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:22.059075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:22.059075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:22.059075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:22.059075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:22.059075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:22.059075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:22.059075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:22.059959 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:22.059959 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:22.059959 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:22.059959 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:22.059959 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:42:22.059959 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:42:22.059959 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:42:22.059959 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:42:22.059959 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:42:22.059959 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:42:22.059959 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:42:22.059959 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:22.059959 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 412/845] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:42:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:22.065760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e93d83-0c9f-4669-801b-1b9cf3cebfca None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:22.162308 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e93d83-0c9f-4669-801b-1b9cf3cebfca None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:22.195308 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca7ebd-a30b-433f-9231-e1d7a3f3efee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:22.196644 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca7ebd-a30b-433f-9231-e1d7a3f3efee None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:22.197152 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca7ebd-a30b-433f-9231-e1d7a3f3efee None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:22.197620 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca7ebd-a30b-433f-9231-e1d7a3f3efee None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:22.198570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca7ebd-a30b-433f-9231-e1d7a3f3efee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:22.199103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca7ebd-a30b-433f-9231-e1d7a3f3efee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:22.200687 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca7ebd-a30b-433f-9231-e1d7a3f3efee None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:22.209537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 434/846] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:42:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:22.215229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ecc0a-714d-4e4b-b67a-b61ad4f5533b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:22.315307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ecc0a-714d-4e4b-b67a-b61ad4f5533b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:22.350596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054af654-2167-4d75-b106-08e2e2899beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:22.351433 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054af654-2167-4d75-b106-08e2e2899beb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:22.351707 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054af654-2167-4d75-b106-08e2e2899beb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:22.351973 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054af654-2167-4d75-b106-08e2e2899beb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:22.362168 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054af654-2167-4d75-b106-08e2e2899beb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:22.363660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054af654-2167-4d75-b106-08e2e2899beb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:22.381212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-054af654-2167-4d75-b106-08e2e2899beb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:22.381212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:22.381212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:22.381212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:22.381212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:22.381212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:22.381212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:22.381212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:22.381212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:22.381212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:22.381212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:22.381212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:22.381212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:22.381212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:22.381212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:22.382198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:22.382198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:22.382198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:22.382198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:22.382198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:22.382198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:22.382198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:22.382198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:22.382198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:22.382198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:22.382198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:22.382198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:22.382198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:22.382198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:22.382198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:22.382198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:22.382198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:22.383162 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:22.383162 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:22.383162 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:22.383162 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:22.383162 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 413/847] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:22.390648 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca7ebd-a30b-433f-9231-e1d7a3f3efee None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:22.493793 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca7ebd-a30b-433f-9231-e1d7a3f3efee None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:22.527948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032ef6f-c54c-4a9e-8a9a-69b1f344915e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:22.529074 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032ef6f-c54c-4a9e-8a9a-69b1f344915e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:22.529554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032ef6f-c54c-4a9e-8a9a-69b1f344915e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:22.530023 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032ef6f-c54c-4a9e-8a9a-69b1f344915e None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:22.530990 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032ef6f-c54c-4a9e-8a9a-69b1f344915e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:22.531496 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032ef6f-c54c-4a9e-8a9a-69b1f344915e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:22.533064 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032ef6f-c54c-4a9e-8a9a-69b1f344915e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:22.546143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 435/848] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:22.552144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054af654-2167-4d75-b106-08e2e2899beb None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:22.651465 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054af654-2167-4d75-b106-08e2e2899beb None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:22.687808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c7f20-f5fc-4019-8c0e-6b8aacc3fe84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:22.688640 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c7f20-f5fc-4019-8c0e-6b8aacc3fe84 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:22.688918 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c7f20-f5fc-4019-8c0e-6b8aacc3fe84 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:22.689183 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c7f20-f5fc-4019-8c0e-6b8aacc3fe84 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:22.697237 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c7f20-f5fc-4019-8c0e-6b8aacc3fe84 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:22.698687 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c7f20-f5fc-4019-8c0e-6b8aacc3fe84 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:22.712698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-8e9c7f20-f5fc-4019-8c0e-6b8aacc3fe84 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 06:42:22.712698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:22.712698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:22.712698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:22.712698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:22.712698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:22.712698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:22.712698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:22.712698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:22.712698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:22.712698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:22.712698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:22.712698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:42:22.712698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:42:22.712698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:42:22.712698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:42:22.713638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:22.713638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:22.713638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:42:22.713638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:22.713638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:42:22.713638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:22.713638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:22.713638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:22.713638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:22.713638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:22.713638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:22.713638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:22.713638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:22.713638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:22.713638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:22.713638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:22.713638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:22.713638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:22.714605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:22.714605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:22.714605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:42:22.714605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:42:22.714605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:42:22.714605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:42:22.714605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:42:22.714605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:42:22.714605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 06:42:22.714605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:22.714605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 414/849] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:42:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:22.719735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032ef6f-c54c-4a9e-8a9a-69b1f344915e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:22.804113 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f21b6f-31f4-40d8-a8d2-6e2706f6b05c None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:22.804299 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f21b6f-31f4-40d8-a8d2-6e2706f6b05c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:22.804569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f21b6f-31f4-40d8-a8d2-6e2706f6b05c None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:22.806167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 415/850] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:42:22.810942 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efd155-f5b0-4bb2-a72d-ce5ae96d2448 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:22.811271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efd155-f5b0-4bb2-a72d-ce5ae96d2448 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:22.811548 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efd155-f5b0-4bb2-a72d-ce5ae96d2448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:22.821514 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032ef6f-c54c-4a9e-8a9a-69b1f344915e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:22.831471 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b8efd155-f5b0-4bb2-a72d-ce5ae96d2448 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:22.833080 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b8efd155-f5b0-4bb2-a72d-ce5ae96d2448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:22.856455 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6a4d0-9008-4a5a-8ccd-5af42412934a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:22.857537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6a4d0-9008-4a5a-8ccd-5af42412934a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:22.858065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6a4d0-9008-4a5a-8ccd-5af42412934a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:22.858552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6a4d0-9008-4a5a-8ccd-5af42412934a None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:22.859622 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6a4d0-9008-4a5a-8ccd-5af42412934a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:22.860130 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6a4d0-9008-4a5a-8ccd-5af42412934a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:22.861764 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6a4d0-9008-4a5a-8ccd-5af42412934a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:22.880354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 436/851] 10.222.0.77 () {56 vars in 1135 bytes} [Wed May 11 06:42:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:22.887021 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6a4d0-9008-4a5a-8ccd-5af42412934a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:22.919123 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 416/852] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:22.935472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efd155-f5b0-4bb2-a72d-ce5ae96d2448 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:23.002464 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6a4d0-9008-4a5a-8ccd-5af42412934a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:23.035951 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1158516-e74e-4cf1-bfe0-eedf437aabd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:23.036538 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1158516-e74e-4cf1-bfe0-eedf437aabd6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:23.036815 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1158516-e74e-4cf1-bfe0-eedf437aabd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:23.037148 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1158516-e74e-4cf1-bfe0-eedf437aabd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:23.043005 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efd155-f5b0-4bb2-a72d-ce5ae96d2448 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:23.089421 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a92715-7bc8-492c-b757-b51c98eb1285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:23.090708 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a92715-7bc8-492c-b757-b51c98eb1285 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:23.091350 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a92715-7bc8-492c-b757-b51c98eb1285 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:23.091774 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a92715-7bc8-492c-b757-b51c98eb1285 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:23.104333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1158516-e74e-4cf1-bfe0-eedf437aabd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:23.106000 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1158516-e74e-4cf1-bfe0-eedf437aabd6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:23.106117 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a92715-7bc8-492c-b757-b51c98eb1285 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:42:23.115618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-f6a92715-7bc8-492c-b757-b51c98eb1285 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:42:23.115618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:23.115618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:23.115618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:23.115618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:23.115618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:23.115618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:23.115618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:23.115618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:23.115618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:23.115618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:23.115618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:23.115618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:42:23.115618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:42:23.115618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:42:23.115618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:42:23.116865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:42:23.116865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:42:23.116865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:42:23.116865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:42:23.116865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:23.116865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:23.116865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:23.116865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:23.116865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:23.116865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:23.116865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:23.116865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:23.116865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:23.116865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:23.116865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:23.116865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:23.117909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:23.117909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:23.117909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:23.117909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:23.117909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:42:23.117909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:42:23.117909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:42:23.117909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:42:23.117909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:42:23.117909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:42:23.117909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:42:23.117909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:23.125343 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 417/853] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:42:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:23.126374 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a92715-7bc8-492c-b757-b51c98eb1285 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:23.227115 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 437/854] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:42:22 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 06:42:23.228781 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1158516-e74e-4cf1-bfe0-eedf437aabd6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:23.241993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a92715-7bc8-492c-b757-b51c98eb1285 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:23.291864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabc3ce-0acd-4e05-bf9c-8cef1fda9505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:23.291864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabc3ce-0acd-4e05-bf9c-8cef1fda9505 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:23.291864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabc3ce-0acd-4e05-bf9c-8cef1fda9505 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:23.291864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabc3ce-0acd-4e05-bf9c-8cef1fda9505 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:23.292289 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabc3ce-0acd-4e05-bf9c-8cef1fda9505 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:23.292289 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabc3ce-0acd-4e05-bf9c-8cef1fda9505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:23.293633 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabc3ce-0acd-4e05-bf9c-8cef1fda9505 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:23.309519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 418/855] 10.222.0.77 () {56 vars in 1103 bytes} [Wed May 11 06:42:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:23.310934 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabc3ce-0acd-4e05-bf9c-8cef1fda9505 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:23.349716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1158516-e74e-4cf1-bfe0-eedf437aabd6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:23.389923 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48729a4c-b882-46f3-ba1b-b762a25f2a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:23.391140 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48729a4c-b882-46f3-ba1b-b762a25f2a89 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:23.391660 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48729a4c-b882-46f3-ba1b-b762a25f2a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:23.392127 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48729a4c-b882-46f3-ba1b-b762a25f2a89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:23.402918 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48729a4c-b882-46f3-ba1b-b762a25f2a89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:23.404754 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48729a4c-b882-46f3-ba1b-b762a25f2a89 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:23.423053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-48729a4c-b882-46f3-ba1b-b762a25f2a89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:23.423053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:23.423053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:23.423053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:23.423053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:23.423053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:23.423053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:23.423053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:23.423053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:23.423053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:23.423053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:23.423053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:23.423053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:23.423053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:23.423053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:23.423995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:23.423995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:23.423995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:23.423995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:23.423995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:23.423995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:23.423995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:23.423995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:23.423995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:23.423995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:23.423995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:23.423995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:23.423995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:23.423995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:23.423995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:23.423995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:23.423995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:23.424902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:23.424902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:23.424902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:23.424902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:23.431529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabc3ce-0acd-4e05-bf9c-8cef1fda9505 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:23.431931 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 438/856] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:23.433407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48729a4c-b882-46f3-ba1b-b762a25f2a89 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:23.462672 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8562e13-8d57-413c-8013-05a384e42105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:23.463515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8562e13-8d57-413c-8013-05a384e42105 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:23.463810 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8562e13-8d57-413c-8013-05a384e42105 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:23.464064 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8562e13-8d57-413c-8013-05a384e42105 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:23.474413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8562e13-8d57-413c-8013-05a384e42105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:23.475885 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8562e13-8d57-413c-8013-05a384e42105 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:23.497742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-a8562e13-8d57-413c-8013-05a384e42105 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:23.497742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:23.497742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:23.497742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:23.497742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:23.497742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:23.497742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:23.497742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:23.497742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:23.497742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:23.497742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:23.497742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:23.497742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:23.497742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:23.497742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:23.498698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:23.498698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:23.498698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:23.498698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:23.498698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:23.498698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:23.498698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:23.498698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:23.498698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:23.498698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:23.498698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:23.498698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:23.498698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:23.498698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:23.498698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:23.498698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:23.498698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:23.499620 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:23.499620 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:23.499620 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:23.499620 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:23.500423 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 419/857] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:23.501781 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381bf32-0eeb-4800-bd21-69677a4a23db None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:23.502134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381bf32-0eeb-4800-bd21-69677a4a23db None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:23.502475 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381bf32-0eeb-4800-bd21-69677a4a23db None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:23.503839 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 420/858] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:23.505456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381bf32-0eeb-4800-bd21-69677a4a23db None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:23.536738 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48729a4c-b882-46f3-ba1b-b762a25f2a89 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:23.569408 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992ea96-809c-4e2e-8577-0b119e0801c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:23.570067 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992ea96-809c-4e2e-8577-0b119e0801c2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:23.570663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992ea96-809c-4e2e-8577-0b119e0801c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:23.570990 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992ea96-809c-4e2e-8577-0b119e0801c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:23.571701 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992ea96-809c-4e2e-8577-0b119e0801c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:23.572002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992ea96-809c-4e2e-8577-0b119e0801c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:23.573364 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992ea96-809c-4e2e-8577-0b119e0801c2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:23.584362 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 439/859] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:23.585516 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ebe11-d731-4bf5-a76e-e910036fc073 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:23.585770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ebe11-d731-4bf5-a76e-e910036fc073 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:23.586039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ebe11-d731-4bf5-a76e-e910036fc073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:23.600832 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381bf32-0eeb-4800-bd21-69677a4a23db None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:23.605486 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-651ebe11-d731-4bf5-a76e-e910036fc073 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:23.606688 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-651ebe11-d731-4bf5-a76e-e910036fc073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:23.634331 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108143ce-49c5-463d-b2ab-ae68966de11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:23.634990 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108143ce-49c5-463d-b2ab-ae68966de11b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:23.635282 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108143ce-49c5-463d-b2ab-ae68966de11b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:23.635541 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108143ce-49c5-463d-b2ab-ae68966de11b None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:23.636256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108143ce-49c5-463d-b2ab-ae68966de11b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:23.636554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108143ce-49c5-463d-b2ab-ae68966de11b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:23.637908 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108143ce-49c5-463d-b2ab-ae68966de11b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:23.649113 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 421/860] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:23.650323 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b68b6-aa05-4729-aca2-83b6fecfe87d None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:23.650605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b68b6-aa05-4729-aca2-83b6fecfe87d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:23.650872 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b68b6-aa05-4729-aca2-83b6fecfe87d None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:23.652089 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 422/861] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:23.655220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b68b6-aa05-4729-aca2-83b6fecfe87d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:23.679528 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 440/862] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:23.680379 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ebe11-d731-4bf5-a76e-e910036fc073 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:23.759229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b68b6-aa05-4729-aca2-83b6fecfe87d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:23.780786 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ebe11-d731-4bf5-a76e-e910036fc073 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:23.791564 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e6647-ab61-4a39-a202-da8a741627d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:23.792354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e6647-ab61-4a39-a202-da8a741627d6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:23.792636 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e6647-ab61-4a39-a202-da8a741627d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:23.792905 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e6647-ab61-4a39-a202-da8a741627d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:23.799460 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e6647-ab61-4a39-a202-da8a741627d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:23.800902 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e6647-ab61-4a39-a202-da8a741627d6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:23.812890 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7134477-8fb5-4fa6-b156-b88f20cc221d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:23.813691 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7134477-8fb5-4fa6-b156-b88f20cc221d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:23.813968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7134477-8fb5-4fa6-b156-b88f20cc221d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:23.814164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-ce7e6647-ab61-4a39-a202-da8a741627d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:23.814164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:23.814164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:23.814164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:23.814164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:23.814164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:23.814164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:23.814164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:23.814164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:23.814164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:23.814164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:23.814164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:23.814164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:42:23.814164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:42:23.814164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:42:23.815035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:42:23.815035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:23.815035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:23.815035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:23.815035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:23.815035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:23.815035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:23.815035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:23.815035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:23.815035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:23.815035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:23.815035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:23.815035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:23.815035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:23.815035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:23.815035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:23.815035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:23.815929 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:42:23.815929 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:42:23.815929 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:42:23.815929 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:42:23.815929 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:42:23.815929 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:42:23.815929 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:23.815929 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:23.816361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7134477-8fb5-4fa6-b156-b88f20cc221d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:23.816431 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 423/863] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:23.816850 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335198f-9808-4924-a0c2-93124523619a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:23.817154 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335198f-9808-4924-a0c2-93124523619a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:23.817438 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335198f-9808-4924-a0c2-93124523619a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:23.826288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7134477-8fb5-4fa6-b156-b88f20cc221d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:23.827770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7134477-8fb5-4fa6-b156-b88f20cc221d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:23.833401 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f335198f-9808-4924-a0c2-93124523619a None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:23.834581 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f335198f-9808-4924-a0c2-93124523619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:23.842525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c7134477-8fb5-4fa6-b156-b88f20cc221d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:42:23.842525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:23.842525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:23.842525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:23.842525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:23.842525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:23.842525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:23.842525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:23.842525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:23.842525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:23.842525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:23.842525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:23.842525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:42:23.842525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:42:23.842525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:42:23.842525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:42:23.843590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:23.843590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:23.843590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:42:23.843590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:23.843590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:42:23.843590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:23.843590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:23.843590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:23.843590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:23.843590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:23.843590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:23.843590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:23.843590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:23.843590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:23.843590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:23.843590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:23.843590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:23.843590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:23.844558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:23.844558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:23.844558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:42:23.844558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:42:23.844558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:42:23.844558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:42:23.844558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:42:23.844558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:42:23.844558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:42:23.844558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:23.844558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 441/864] 10.222.0.77 () {56 vars in 1117 bytes} [Wed May 11 06:42:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:23.844558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7134477-8fb5-4fa6-b156-b88f20cc221d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:23.901933 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 424/865] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:23.902610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335198f-9808-4924-a0c2-93124523619a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:23.936215 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7134477-8fb5-4fa6-b156-b88f20cc221d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:23.969683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb7f17-35ac-4bf2-91d1-5642c1ea602b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:23.970344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb7f17-35ac-4bf2-91d1-5642c1ea602b None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:23.970620 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb7f17-35ac-4bf2-91d1-5642c1ea602b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:23.970891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb7f17-35ac-4bf2-91d1-5642c1ea602b None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:23.971618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb7f17-35ac-4bf2-91d1-5642c1ea602b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:23.972995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb7f17-35ac-4bf2-91d1-5642c1ea602b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:23.986867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 442/866] 10.222.0.77 () {60 vars in 1141 bytes} [Wed May 11 06:42:23 2022] POST /identity/v3/services => generated 269 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:42:23.990012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb7f17-35ac-4bf2-91d1-5642c1ea602b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:23.996874 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335198f-9808-4924-a0c2-93124523619a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:24.040681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aec6d5-7653-413c-9cae-4f47dc884e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:24.041404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aec6d5-7653-413c-9cae-4f47dc884e3b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:24.041675 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aec6d5-7653-413c-9cae-4f47dc884e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:24.041952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aec6d5-7653-413c-9cae-4f47dc884e3b None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:24.042755 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aec6d5-7653-413c-9cae-4f47dc884e3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:24.043095 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aec6d5-7653-413c-9cae-4f47dc884e3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:24.044589 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aec6d5-7653-413c-9cae-4f47dc884e3b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:24.057250 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 425/867] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:42:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:24.058116 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aec6d5-7653-413c-9cae-4f47dc884e3b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:24.112411 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb7f17-35ac-4bf2-91d1-5642c1ea602b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:24.153794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeaed12-d5cf-4345-b903-a372d3d6c4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:24.154435 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeaed12-d5cf-4345-b903-a372d3d6c4df None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:24.154683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeaed12-d5cf-4345-b903-a372d3d6c4df None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:24.154988 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeaed12-d5cf-4345-b903-a372d3d6c4df None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:24.155840 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeaed12-d5cf-4345-b903-a372d3d6c4df None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:24.156152 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeaed12-d5cf-4345-b903-a372d3d6c4df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:24.157608 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeaed12-d5cf-4345-b903-a372d3d6c4df None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:24.160065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aec6d5-7653-413c-9cae-4f47dc884e3b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:24.176413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 443/868] 10.222.0.77 () {56 vars in 1149 bytes} [Wed May 11 06:42:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:24.177282 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeaed12-d5cf-4345-b903-a372d3d6c4df None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:24.195285 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625bab4-6de7-4a36-901b-14dcbb0d2f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:24.196311 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625bab4-6de7-4a36-901b-14dcbb0d2f4d None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:24.196593 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625bab4-6de7-4a36-901b-14dcbb0d2f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:24.196865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625bab4-6de7-4a36-901b-14dcbb0d2f4d None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:24.197581 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625bab4-6de7-4a36-901b-14dcbb0d2f4d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:24.198944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625bab4-6de7-4a36-901b-14dcbb0d2f4d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:24.216315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 426/869] 10.222.0.77 () {60 vars in 1141 bytes} [Wed May 11 06:42:24 2022] POST /identity/v3/services => generated 251 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:42:24.220496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625bab4-6de7-4a36-901b-14dcbb0d2f4d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:24.299279 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeaed12-d5cf-4345-b903-a372d3d6c4df None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:24.350652 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625bab4-6de7-4a36-901b-14dcbb0d2f4d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:24.355143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73747a-e434-4400-b9ed-6c6d0d51f9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:24.355905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73747a-e434-4400-b9ed-6c6d0d51f9fd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:24.356257 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73747a-e434-4400-b9ed-6c6d0d51f9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:24.356597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73747a-e434-4400-b9ed-6c6d0d51f9fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:24.357513 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73747a-e434-4400-b9ed-6c6d0d51f9fd None admin] RBAC: Adding query filter params (role.id=5debd8ad07a74bedbf2efd53b11cd7cd, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=f726f58d30734be7abf15400bff89533) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:24.357909 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73747a-e434-4400-b9ed-6c6d0d51f9fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:24.359502 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73747a-e434-4400-b9ed-6c6d0d51f9fd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:24.368910 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 444/870] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:42:24 2022] GET /identity/v3/role_assignments?user.id=f726f58d30734be7abf15400bff89533&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=5debd8ad07a74bedbf2efd53b11cd7cd => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:24.396171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce8df4-9797-46e9-8412-a69d6b8b2892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:24.397137 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce8df4-9797-46e9-8412-a69d6b8b2892 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:24.397665 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce8df4-9797-46e9-8412-a69d6b8b2892 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:24.398093 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce8df4-9797-46e9-8412-a69d6b8b2892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:24.473564 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce8df4-9797-46e9-8412-a69d6b8b2892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:24.475340 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce8df4-9797-46e9-8412-a69d6b8b2892 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:24.580077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 427/871] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:42:24 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:42:24.585405 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73747a-e434-4400-b9ed-6c6d0d51f9fd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:24.685228 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73747a-e434-4400-b9ed-6c6d0d51f9fd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:24.718125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d977e-4ed5-4075-9977-13adf4cd9585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:24.718938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d977e-4ed5-4075-9977-13adf4cd9585 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:24.719243 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d977e-4ed5-4075-9977-13adf4cd9585 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:24.719510 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d977e-4ed5-4075-9977-13adf4cd9585 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:24.729655 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d977e-4ed5-4075-9977-13adf4cd9585 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:24.731081 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d977e-4ed5-4075-9977-13adf4cd9585 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:24.748565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5d8d977e-4ed5-4075-9977-13adf4cd9585 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:24.748565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:24.748565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:24.748565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:24.748565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:24.748565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:24.748565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:24.748565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:24.748565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:24.748565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:24.748565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:24.748565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:24.748565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:24.748565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:24.748565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:24.749544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:24.749544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:24.749544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:24.749544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:24.749544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:24.749544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:24.749544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:24.749544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:24.749544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:24.749544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:24.749544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:24.749544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:24.749544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:24.749544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:24.749544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:24.749544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:24.749544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:24.751175 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:24.751175 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:24.751175 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:24.751175 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:24.751175 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 445/872] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:24.755360 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce8df4-9797-46e9-8412-a69d6b8b2892 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:24.854586 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce8df4-9797-46e9-8412-a69d6b8b2892 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:24.887973 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff7583-1716-4b3c-8e28-5bb179268fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:24.888647 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff7583-1716-4b3c-8e28-5bb179268fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:24.888924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff7583-1716-4b3c-8e28-5bb179268fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:24.889196 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff7583-1716-4b3c-8e28-5bb179268fb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:24.889924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff7583-1716-4b3c-8e28-5bb179268fb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:24.890230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff7583-1716-4b3c-8e28-5bb179268fb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:24.891634 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff7583-1716-4b3c-8e28-5bb179268fb0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:24.903347 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 428/873] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:24.908647 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d977e-4ed5-4075-9977-13adf4cd9585 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:25.007267 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d977e-4ed5-4075-9977-13adf4cd9585 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:25.040608 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b8cad-e888-4b77-8bed-07ba8f580fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:25.041414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b8cad-e888-4b77-8bed-07ba8f580fdf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:25.041697 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b8cad-e888-4b77-8bed-07ba8f580fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:25.041972 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b8cad-e888-4b77-8bed-07ba8f580fdf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:25.048745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b8cad-e888-4b77-8bed-07ba8f580fdf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:25.050204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b8cad-e888-4b77-8bed-07ba8f580fdf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:25.063917 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-3a4b8cad-e888-4b77-8bed-07ba8f580fdf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:25.063917 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:25.063917 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:25.063917 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:25.063917 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:25.063917 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:25.063917 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:25.063917 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:25.063917 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:25.063917 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:25.063917 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:25.063917 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:25.063917 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:42:25.063917 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:42:25.063917 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:42:25.065999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:42:25.065999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:25.065999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:25.065999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:25.065999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:25.065999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:25.065999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:25.065999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:25.065999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:25.065999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:25.065999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:25.065999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:25.065999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:25.065999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:25.065999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:25.065999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:25.065999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:25.068211 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:42:25.068211 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:42:25.068211 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:42:25.068211 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:42:25.068211 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:42:25.068211 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:42:25.068211 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:25.068211 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:25.068211 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 446/874] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:25.074979 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff7583-1716-4b3c-8e28-5bb179268fb0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:25.169995 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff7583-1716-4b3c-8e28-5bb179268fb0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:25.205111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227eab4-a965-4a6a-b15f-a0d92e8199d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:25.205778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227eab4-a965-4a6a-b15f-a0d92e8199d2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:25.206053 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227eab4-a965-4a6a-b15f-a0d92e8199d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:25.206323 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227eab4-a965-4a6a-b15f-a0d92e8199d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:25.207212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227eab4-a965-4a6a-b15f-a0d92e8199d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:25.207545 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227eab4-a965-4a6a-b15f-a0d92e8199d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:25.208974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227eab4-a965-4a6a-b15f-a0d92e8199d2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:25.222042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 429/875] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:42:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:25.228131 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b8cad-e888-4b77-8bed-07ba8f580fdf None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:25.329580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b8cad-e888-4b77-8bed-07ba8f580fdf None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:25.362473 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c444840-4942-4666-9d4c-420c8bb7a112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:25.363171 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c444840-4942-4666-9d4c-420c8bb7a112 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:25.363460 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c444840-4942-4666-9d4c-420c8bb7a112 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:25.363735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c444840-4942-4666-9d4c-420c8bb7a112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:25.364601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c444840-4942-4666-9d4c-420c8bb7a112 None admin] RBAC: Adding query filter params (role.id=46d109e3a1bd4f13b0d145cde46c75a9, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=99cbf80fc74c4183a6eed3e97f7196f9) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:25.364914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c444840-4942-4666-9d4c-420c8bb7a112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:25.366356 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c444840-4942-4666-9d4c-420c8bb7a112 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:25.372593 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 447/876] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:42:25 2022] GET /identity/v3/role_assignments?user.id=99cbf80fc74c4183a6eed3e97f7196f9&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=46d109e3a1bd4f13b0d145cde46c75a9 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:26.288606 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd4456-12bf-44fc-b0ba-e2d9b59ccde3 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:26.289174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd4456-12bf-44fc-b0ba-e2d9b59ccde3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:26.294667 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd4456-12bf-44fc-b0ba-e2d9b59ccde3 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:26.298036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 430/877] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:26.303169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba5429-b6b9-4806-8547-c488e838c893 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:26.304137 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba5429-b6b9-4806-8547-c488e838c893 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:26.304609 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba5429-b6b9-4806-8547-c488e838c893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:26.323530 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-18ba5429-b6b9-4806-8547-c488e838c893 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:26.325133 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-18ba5429-b6b9-4806-8547-c488e838c893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:26.399062 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 448/878] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:26.414801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd4456-12bf-44fc-b0ba-e2d9b59ccde3 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:26.496798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1c9ef-1b25-4d52-b693-7e0a2d7fe449 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:26.497143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1c9ef-1b25-4d52-b693-7e0a2d7fe449 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:26.497333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1c9ef-1b25-4d52-b693-7e0a2d7fe449 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:26.499104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 449/879] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:42:26.505602 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4d0d2-0945-41bb-b7a4-294862285cba None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:26.505602 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4d0d2-0945-41bb-b7a4-294862285cba None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:26.506033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4d0d2-0945-41bb-b7a4-294862285cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:26.520320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd4456-12bf-44fc-b0ba-e2d9b59ccde3 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:26.523985 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-09e4d0d2-0945-41bb-b7a4-294862285cba None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:26.525187 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-09e4d0d2-0945-41bb-b7a4-294862285cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:26.555626 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e12bd-967c-4a6a-a5e6-c4f27c3c002d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:26.556841 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e12bd-967c-4a6a-a5e6-c4f27c3c002d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:26.557439 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e12bd-967c-4a6a-a5e6-c4f27c3c002d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:26.557996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e12bd-967c-4a6a-a5e6-c4f27c3c002d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:26.559082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e12bd-967c-4a6a-a5e6-c4f27c3c002d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:26.560731 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e12bd-967c-4a6a-a5e6-c4f27c3c002d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:26.574284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-1e6e12bd-967c-4a6a-a5e6-c4f27c3c002d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 06:42:26.574284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:26.574284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:26.574284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:26.574284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:26.574284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:26.574284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:26.574284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:26.574284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 06:42:26.574284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:26.574284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:26.574284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:26.574284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:26.574284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:26.574284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:26.574284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:26.575330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:26.575330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:26.575330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:26.575330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:26.575330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:26.575330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:26.575330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:26.575330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:26.575330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:26.575330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:26.575330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:26.575330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:26.575330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:26.575330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:26.575330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:26.575330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:26.576264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:26.576264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:26.576264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:26.576264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:26.576264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:26.576264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:26.576264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:26.576264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:26.576264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:26.576264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:26.576264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:26.576264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:26.576264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:26.576264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 06:42:26.576264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:26.584735 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 431/880] 10.222.0.77 () {56 vars in 1132 bytes} [Wed May 11 06:42:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:26.586444 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e12bd-967c-4a6a-a5e6-c4f27c3c002d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:26.603099 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 450/881] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:26.617760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4d0d2-0945-41bb-b7a4-294862285cba None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:26.683949 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e12bd-967c-4a6a-a5e6-c4f27c3c002d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:26.718937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4d0d2-0945-41bb-b7a4-294862285cba None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:26.719652 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167aba67-7dac-4c39-a62f-7bd88dbcb008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:26.720323 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167aba67-7dac-4c39-a62f-7bd88dbcb008 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:26.720597 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167aba67-7dac-4c39-a62f-7bd88dbcb008 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:26.720866 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167aba67-7dac-4c39-a62f-7bd88dbcb008 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:26.721563 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167aba67-7dac-4c39-a62f-7bd88dbcb008 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:26.721864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167aba67-7dac-4c39-a62f-7bd88dbcb008 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:26.723328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167aba67-7dac-4c39-a62f-7bd88dbcb008 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:26.731264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 432/882] 10.222.0.77 () {56 vars in 1126 bytes} [Wed May 11 06:42:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:26.731264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16daf984-b038-4bce-b0fd-635ebb032f9d None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:26.731264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16daf984-b038-4bce-b0fd-635ebb032f9d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:26.731264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16daf984-b038-4bce-b0fd-635ebb032f9d None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:26.731264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 433/883] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:26.733904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16daf984-b038-4bce-b0fd-635ebb032f9d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:26.757637 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0543e-68cc-4c7f-a588-e986e79fb32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:26.758442 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0543e-68cc-4c7f-a588-e986e79fb32a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:26.758716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0543e-68cc-4c7f-a588-e986e79fb32a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:26.759006 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0543e-68cc-4c7f-a588-e986e79fb32a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:26.759693 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0543e-68cc-4c7f-a588-e986e79fb32a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:26.761062 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0543e-68cc-4c7f-a588-e986e79fb32a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:26.772532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-3ad0543e-68cc-4c7f-a588-e986e79fb32a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 06:42:26.772532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:26.772532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:26.772532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:26.772532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:26.772532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:26.772532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:26.772532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:26.772532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 06:42:26.772532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:26.772532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:26.772532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:26.772532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:26.772532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:26.772532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:26.772532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:26.772532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:26.773536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:26.773536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:26.773536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:26.773536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:26.773536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:26.773536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:26.773536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:26.773536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:26.773536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:26.773536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:26.773536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:26.773536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:26.773536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:26.773536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:26.773536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:26.773536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:26.774375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:26.774375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:26.774375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:26.774375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:26.774375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:26.774375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:26.774375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:26.774375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:26.774375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:26.774375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:26.774375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:26.774375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:26.774375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 06:42:26.774375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:26.774375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 451/884] 10.222.0.77 () {56 vars in 1114 bytes} [Wed May 11 06:42:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:26.775778 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbc322-24ca-40c9-8b68-480d84e5ab4b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:26.775778 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbc322-24ca-40c9-8b68-480d84e5ab4b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:26.775903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbc322-24ca-40c9-8b68-480d84e5ab4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:26.793064 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-51dbc322-24ca-40c9-8b68-480d84e5ab4b None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:26.794220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-51dbc322-24ca-40c9-8b68-480d84e5ab4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:26.838906 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16daf984-b038-4bce-b0fd-635ebb032f9d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:26.870097 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c05447-d1ba-4f81-834b-1570d860067c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:26.870764 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05447-d1ba-4f81-834b-1570d860067c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:26.871221 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05447-d1ba-4f81-834b-1570d860067c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:26.871326 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05447-d1ba-4f81-834b-1570d860067c None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:26.871573 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 452/885] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:26.872034 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c05447-d1ba-4f81-834b-1570d860067c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:26.872338 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c05447-d1ba-4f81-834b-1570d860067c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:26.873096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbc322-24ca-40c9-8b68-480d84e5ab4b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:26.873707 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c05447-d1ba-4f81-834b-1570d860067c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:26.883206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 434/886] 10.222.0.77 () {56 vars in 1126 bytes} [Wed May 11 06:42:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:26.884077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c05447-d1ba-4f81-834b-1570d860067c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:26.967401 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbc322-24ca-40c9-8b68-480d84e5ab4b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:26.978539 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c05447-d1ba-4f81-834b-1570d860067c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:26.999443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5966b3a-5457-461c-9b3a-1074620a1397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:27.000255 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5966b3a-5457-461c-9b3a-1074620a1397 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:27.000607 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5966b3a-5457-461c-9b3a-1074620a1397 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:27.000981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5966b3a-5457-461c-9b3a-1074620a1397 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:27.001726 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5966b3a-5457-461c-9b3a-1074620a1397 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:27.002121 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5966b3a-5457-461c-9b3a-1074620a1397 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:27.003563 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5966b3a-5457-461c-9b3a-1074620a1397 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:27.008097 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 453/887] 10.222.0.77 () {56 vars in 1114 bytes} [Wed May 11 06:42:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:27.008904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5966b3a-5457-461c-9b3a-1074620a1397 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:27.015901 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ef995-7598-467f-aa60-12ec9019f0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:27.016556 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ef995-7598-467f-aa60-12ec9019f0ec None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:27.016835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ef995-7598-467f-aa60-12ec9019f0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:27.017105 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ef995-7598-467f-aa60-12ec9019f0ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:27.017909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ef995-7598-467f-aa60-12ec9019f0ec None admin] RBAC: Adding query filter params (interface=public, service_id=34949c6db1164833ba71be385b5031ba, region_id=RegionOne) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:27.018217 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ef995-7598-467f-aa60-12ec9019f0ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:27.019619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ef995-7598-467f-aa60-12ec9019f0ec None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:27.025167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 435/888] 10.222.0.77 () {56 vars in 1251 bytes} [Wed May 11 06:42:26 2022] GET /identity/v3/endpoints?service_id=34949c6db1164833ba71be385b5031ba&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:27.025956 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ef995-7598-467f-aa60-12ec9019f0ec None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:27.112325 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5966b3a-5457-461c-9b3a-1074620a1397 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:27.123120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ef995-7598-467f-aa60-12ec9019f0ec None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:27.144427 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c3454-8fef-4d26-892d-abc270c51e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:27.145367 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c3454-8fef-4d26-892d-abc270c51e8f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:27.145644 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c3454-8fef-4d26-892d-abc270c51e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:27.145916 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c3454-8fef-4d26-892d-abc270c51e8f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:27.146569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c3454-8fef-4d26-892d-abc270c51e8f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:27.147968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c3454-8fef-4d26-892d-abc270c51e8f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:27.155250 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b1103-8444-4946-aab6-ed2e4fb5666b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:27.155920 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b1103-8444-4946-aab6-ed2e4fb5666b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:27.156198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b1103-8444-4946-aab6-ed2e4fb5666b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:27.156470 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b1103-8444-4946-aab6-ed2e4fb5666b None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:27.157180 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b1103-8444-4946-aab6-ed2e4fb5666b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:27.157487 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b1103-8444-4946-aab6-ed2e4fb5666b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:27.158848 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b1103-8444-4946-aab6-ed2e4fb5666b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:27.159527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-9c0c3454-8fef-4d26-892d-abc270c51e8f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:42:27.159527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:27.159527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:27.159527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:27.159527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:27.159527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:27.159527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:27.159527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:27.159527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:42:27.159527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:27.159527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:27.159527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:27.159527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:27.159527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:27.159527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:27.159527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:27.159527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:27.160470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:27.160470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:27.160470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:27.160470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:27.160470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:27.160470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:27.160470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:27.160470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:27.160470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:27.160470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:27.160470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:27.160470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:27.160470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:27.160470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:27.160470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:27.160470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:27.161937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:27.161937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:27.161937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:27.161937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:27.161937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:27.161937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:27.161937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:27.161937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:27.161937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:27.161937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:27.161937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:27.161937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:27.161937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:42:27.161937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:27.161937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 454/889] 10.222.0.77 () {56 vars in 1126 bytes} [Wed May 11 06:42:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:27.162739 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c3454-8fef-4d26-892d-abc270c51e8f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:27.174808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 436/890] 10.222.0.77 () {56 vars in 1114 bytes} [Wed May 11 06:42:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:27.174808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b1103-8444-4946-aab6-ed2e4fb5666b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:27.256329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c3454-8fef-4d26-892d-abc270c51e8f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:27.270900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b1103-8444-4946-aab6-ed2e4fb5666b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:27.290012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dcf67-7aef-465a-aea2-c1bd94551361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:27.290700 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dcf67-7aef-465a-aea2-c1bd94551361 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:27.291037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dcf67-7aef-465a-aea2-c1bd94551361 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:27.291311 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dcf67-7aef-465a-aea2-c1bd94551361 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:27.292003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237dcf67-7aef-465a-aea2-c1bd94551361 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:27.293388 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237dcf67-7aef-465a-aea2-c1bd94551361 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:27.299623 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 455/891] 10.222.0.77 () {56 vars in 1087 bytes} [Wed May 11 06:42:27 2022] GET /identity/v3/services => generated 1268 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:42:27.311136 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb7b53-afcb-4a15-a700-5693620d8952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:27.311824 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb7b53-afcb-4a15-a700-5693620d8952 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:27.312024 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dcf67-7aef-465a-aea2-c1bd94551361 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:27.312407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb7b53-afcb-4a15-a700-5693620d8952 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:27.312407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb7b53-afcb-4a15-a700-5693620d8952 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:27.313055 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb7b53-afcb-4a15-a700-5693620d8952 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:27.313461 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb7b53-afcb-4a15-a700-5693620d8952 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:27.314860 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb7b53-afcb-4a15-a700-5693620d8952 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:27.325239 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 437/892] 10.222.0.77 () {56 vars in 1122 bytes} [Wed May 11 06:42:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:27.326882 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb7b53-afcb-4a15-a700-5693620d8952 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:27.426940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dcf67-7aef-465a-aea2-c1bd94551361 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:27.430315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb7b53-afcb-4a15-a700-5693620d8952 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:27.463486 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107df79-442b-412f-9ae2-2d8f03173419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:27.464706 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107df79-442b-412f-9ae2-2d8f03173419 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:27.465313 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107df79-442b-412f-9ae2-2d8f03173419 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:27.465772 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107df79-442b-412f-9ae2-2d8f03173419 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:27.466681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb837b-7713-4cc9-b14c-41aaf636ecad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:27.467132 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107df79-442b-412f-9ae2-2d8f03173419 None admin] RBAC: Adding query filter params (interface=public, service_id=cdbd7bdbf8de48b58fac9f90b223a87d, region_id=RegionOne) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:27.467557 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb837b-7713-4cc9-b14c-41aaf636ecad None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:27.467833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107df79-442b-412f-9ae2-2d8f03173419 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:27.467936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb837b-7713-4cc9-b14c-41aaf636ecad None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:27.468253 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb837b-7713-4cc9-b14c-41aaf636ecad None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:27.469067 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb837b-7713-4cc9-b14c-41aaf636ecad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:27.469440 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb837b-7713-4cc9-b14c-41aaf636ecad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:27.470195 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107df79-442b-412f-9ae2-2d8f03173419 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:27.471021 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb837b-7713-4cc9-b14c-41aaf636ecad None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:27.483416 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 438/893] 10.222.0.77 () {56 vars in 1122 bytes} [Wed May 11 06:42:27 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:27.483668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 456/894] 10.222.0.77 () {56 vars in 1251 bytes} [Wed May 11 06:42:27 2022] GET /identity/v3/endpoints?service_id=cdbd7bdbf8de48b58fac9f90b223a87d&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:27.489764 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb837b-7713-4cc9-b14c-41aaf636ecad None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:27.602146 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb837b-7713-4cc9-b14c-41aaf636ecad None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:27.645574 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688bd6f-a110-44ee-b21c-8d80cd89b308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:27.646674 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688bd6f-a110-44ee-b21c-8d80cd89b308 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:27.647210 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688bd6f-a110-44ee-b21c-8d80cd89b308 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:27.647683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688bd6f-a110-44ee-b21c-8d80cd89b308 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:27.648594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688bd6f-a110-44ee-b21c-8d80cd89b308 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:27.650220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688bd6f-a110-44ee-b21c-8d80cd89b308 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:27.657297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 439/895] 10.222.0.77 () {56 vars in 1087 bytes} [Wed May 11 06:42:27 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:42:27.675104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c7795-c885-452e-987e-e977ff0c028a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:27.675436 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c7795-c885-452e-987e-e977ff0c028a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:27.675678 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c7795-c885-452e-987e-e977ff0c028a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:27.679965 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 457/896] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:27.687798 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9bca5-ad74-4b6d-9386-3a59fca73c04 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:27.687798 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9bca5-ad74-4b6d-9386-3a59fca73c04 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:27.687798 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9bca5-ad74-4b6d-9386-3a59fca73c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:27.706278 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9ae9bca5-ad74-4b6d-9386-3a59fca73c04 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:27.706948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9ae9bca5-ad74-4b6d-9386-3a59fca73c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:27.781175 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 440/897] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:27.804502 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c7795-c885-452e-987e-e977ff0c028a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:27.913580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c7795-c885-452e-987e-e977ff0c028a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:27.946499 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aeda99-a49d-4e41-894d-81c6b97ea6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:27.947264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aeda99-a49d-4e41-894d-81c6b97ea6ef None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:27.947591 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aeda99-a49d-4e41-894d-81c6b97ea6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:27.947863 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aeda99-a49d-4e41-894d-81c6b97ea6ef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:27.958813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aeda99-a49d-4e41-894d-81c6b97ea6ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:42:27.967073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-18aeda99-a49d-4e41-894d-81c6b97ea6ef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:42:27.967073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:27.967073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:27.967073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:27.967073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:27.967073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:27.967073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:27.967073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:27.967073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:27.967073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:27.967073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:27.967073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:27.967073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:42:27.967073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:42:27.967073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:42:27.967073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:42:27.968020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:42:27.968020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:42:27.968020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:42:27.968020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:42:27.968020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:27.968020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:27.968020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:27.968020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:27.968020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:27.968020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:27.968020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:27.968020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:27.968020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:27.968020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:27.968020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:27.968020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:27.968873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:27.968873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:27.968873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:27.968873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:27.968873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:42:27.968873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:42:27.968873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:42:27.968873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:42:27.968873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:42:27.968873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:42:27.968873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:42:27.968873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:27.968873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 458/898] 10.222.0.77 () {56 vars in 1120 bytes} [Wed May 11 06:42:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:27.974587 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9bca5-ad74-4b6d-9386-3a59fca73c04 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:28.075467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9bca5-ad74-4b6d-9386-3a59fca73c04 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:28.110103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efa15f-6b1a-4f80-93e9-5cd953d68003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:28.110786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efa15f-6b1a-4f80-93e9-5cd953d68003 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:28.111083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efa15f-6b1a-4f80-93e9-5cd953d68003 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:28.111355 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efa15f-6b1a-4f80-93e9-5cd953d68003 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:28.112254 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efa15f-6b1a-4f80-93e9-5cd953d68003 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:28.112557 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efa15f-6b1a-4f80-93e9-5cd953d68003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:28.114034 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efa15f-6b1a-4f80-93e9-5cd953d68003 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:28.122783 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 441/899] 10.222.0.77 () {56 vars in 1115 bytes} [Wed May 11 06:42:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:28.128415 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aeda99-a49d-4e41-894d-81c6b97ea6ef None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:28.231597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aeda99-a49d-4e41-894d-81c6b97ea6ef None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:28.265206 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05799153-acec-44c2-9b8e-dcd10abd0adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:28.266008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05799153-acec-44c2-9b8e-dcd10abd0adc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:28.266284 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05799153-acec-44c2-9b8e-dcd10abd0adc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:28.266557 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05799153-acec-44c2-9b8e-dcd10abd0adc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:28.276665 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05799153-acec-44c2-9b8e-dcd10abd0adc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:28.278132 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05799153-acec-44c2-9b8e-dcd10abd0adc None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:28.296177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-05799153-acec-44c2-9b8e-dcd10abd0adc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:28.296177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:28.296177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:28.296177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:28.296177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:28.296177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:28.296177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:28.296177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:28.296177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:28.296177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:28.296177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:28.296177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:28.296177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:28.296177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:28.296177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:28.298351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:28.298351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:28.298351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:28.298351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:28.298351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:28.298351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:28.298351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:28.298351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:28.298351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:28.298351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:28.298351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:28.298351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:28.298351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:28.298351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:28.298351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:28.298351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:28.298351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:28.300586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:28.300586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:28.300586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:28.300586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:28.300586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 459/900] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:28.307036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efa15f-6b1a-4f80-93e9-5cd953d68003 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:28.401757 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efa15f-6b1a-4f80-93e9-5cd953d68003 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:28.434317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f7e4c-1f0c-419e-b615-27c03043d83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:28.435403 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f7e4c-1f0c-419e-b615-27c03043d83b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:28.435898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f7e4c-1f0c-419e-b615-27c03043d83b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:28.436375 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f7e4c-1f0c-419e-b615-27c03043d83b None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:28.437296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f7e4c-1f0c-419e-b615-27c03043d83b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:28.437893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f7e4c-1f0c-419e-b615-27c03043d83b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:28.439505 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f7e4c-1f0c-419e-b615-27c03043d83b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:28.452220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 442/901] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:28.462988 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05799153-acec-44c2-9b8e-dcd10abd0adc None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:28.560503 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05799153-acec-44c2-9b8e-dcd10abd0adc None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:28.593899 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ae543-df63-43ca-be2c-8a65dcb335e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:28.594730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ae543-df63-43ca-be2c-8a65dcb335e4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:28.595036 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ae543-df63-43ca-be2c-8a65dcb335e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:28.595315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ae543-df63-43ca-be2c-8a65dcb335e4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:28.603223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ae543-df63-43ca-be2c-8a65dcb335e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:28.604664 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ae543-df63-43ca-be2c-8a65dcb335e4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:28.618939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-9c7ae543-df63-43ca-be2c-8a65dcb335e4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:42:28.618939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:28.618939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:28.618939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:28.618939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:28.618939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:28.618939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:28.618939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:28.618939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:28.618939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:28.618939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:28.618939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:28.618939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:42:28.618939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:42:28.618939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:42:28.618939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:42:28.619957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:28.619957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:28.619957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:42:28.619957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:28.619957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:42:28.619957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:28.619957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:28.619957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:28.619957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:28.619957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:28.619957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:28.619957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:28.619957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:28.619957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:28.619957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:28.619957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:28.619957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:28.619957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:28.620961 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:28.620961 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:28.620961 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:42:28.620961 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:42:28.620961 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:42:28.620961 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:42:28.620961 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:42:28.620961 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:42:28.620961 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:42:28.620961 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:28.620961 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 460/902] 10.222.0.77 () {56 vars in 1117 bytes} [Wed May 11 06:42:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:28.626258 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f7e4c-1f0c-419e-b615-27c03043d83b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:28.725001 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f7e4c-1f0c-419e-b615-27c03043d83b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:28.756739 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b93bdd-6c57-47f0-9cee-bc00d657ddde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:28.757411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b93bdd-6c57-47f0-9cee-bc00d657ddde None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:28.757693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b93bdd-6c57-47f0-9cee-bc00d657ddde None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:28.757968 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b93bdd-6c57-47f0-9cee-bc00d657ddde None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:28.758796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b93bdd-6c57-47f0-9cee-bc00d657ddde None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:28.759122 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b93bdd-6c57-47f0-9cee-bc00d657ddde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:28.760608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b93bdd-6c57-47f0-9cee-bc00d657ddde None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:28.777778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 443/903] 10.222.0.77 () {56 vars in 1149 bytes} [Wed May 11 06:42:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:28.783457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ae543-df63-43ca-be2c-8a65dcb335e4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:28.883241 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ae543-df63-43ca-be2c-8a65dcb335e4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:28.915950 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888601ba-d474-416c-bba4-247f47367ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:28.916606 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888601ba-d474-416c-bba4-247f47367ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:28.916884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888601ba-d474-416c-bba4-247f47367ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:28.917155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888601ba-d474-416c-bba4-247f47367ba6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:28.989063 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888601ba-d474-416c-bba4-247f47367ba6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:28.990534 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888601ba-d474-416c-bba4-247f47367ba6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:29.087066 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 461/904] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:42:28 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:42:29.092463 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b93bdd-6c57-47f0-9cee-bc00d657ddde None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:29.187734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b93bdd-6c57-47f0-9cee-bc00d657ddde None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:29.221670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674dd48-eed1-49ff-b597-02a291b2610e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:29.222853 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674dd48-eed1-49ff-b597-02a291b2610e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:29.223419 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674dd48-eed1-49ff-b597-02a291b2610e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:29.223891 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674dd48-eed1-49ff-b597-02a291b2610e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:29.234403 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674dd48-eed1-49ff-b597-02a291b2610e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:29.236187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674dd48-eed1-49ff-b597-02a291b2610e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:29.253805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-f674dd48-eed1-49ff-b597-02a291b2610e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:29.253805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:29.253805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:29.253805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:29.253805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:29.253805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:29.253805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:29.253805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:29.253805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:29.253805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:29.253805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:29.253805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:29.253805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:29.253805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:29.253805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:29.254792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:29.254792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:29.254792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:29.254792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:29.254792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:29.254792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:29.254792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:29.254792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:29.254792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:29.254792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:29.254792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:29.254792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:29.254792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:29.254792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:29.254792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:29.254792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:29.254792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:29.255743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:29.255743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:29.255743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:29.255743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:29.258034 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 444/905] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:29.263287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888601ba-d474-416c-bba4-247f47367ba6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:29.365981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888601ba-d474-416c-bba4-247f47367ba6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:29.399097 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdce6e1-fee6-4c4a-a5e4-f5456660e971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:29.399769 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdce6e1-fee6-4c4a-a5e4-f5456660e971 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:29.400044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdce6e1-fee6-4c4a-a5e4-f5456660e971 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:29.400314 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdce6e1-fee6-4c4a-a5e4-f5456660e971 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:29.401093 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdce6e1-fee6-4c4a-a5e4-f5456660e971 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:29.401394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdce6e1-fee6-4c4a-a5e4-f5456660e971 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:29.402807 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdce6e1-fee6-4c4a-a5e4-f5456660e971 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:29.414990 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 462/906] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:29.420599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674dd48-eed1-49ff-b597-02a291b2610e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:29.523773 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674dd48-eed1-49ff-b597-02a291b2610e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:29.557693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb701238-8541-4373-972b-8c8fefc558cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:29.558884 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb701238-8541-4373-972b-8c8fefc558cc None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:29.559435 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb701238-8541-4373-972b-8c8fefc558cc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:29.559908 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb701238-8541-4373-972b-8c8fefc558cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:29.567124 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb701238-8541-4373-972b-8c8fefc558cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:29.568804 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb701238-8541-4373-972b-8c8fefc558cc None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:29.583167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-eb701238-8541-4373-972b-8c8fefc558cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:29.583167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:29.583167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:29.583167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:29.583167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:29.583167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:29.583167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:29.583167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:29.583167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:29.583167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:29.583167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:29.583167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:29.583167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:42:29.583167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:42:29.583167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:42:29.584128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:42:29.584128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:29.584128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:29.584128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:29.584128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:29.584128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:29.584128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:29.584128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:29.584128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:29.584128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:29.584128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:29.584128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:29.584128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:29.584128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:29.584128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:29.584128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:29.584128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:29.585051 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:42:29.585051 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:42:29.585051 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:42:29.585051 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:42:29.585051 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:42:29.585051 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:42:29.585051 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:29.585051 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:29.587644 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 445/907] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:29.598998 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdce6e1-fee6-4c4a-a5e4-f5456660e971 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:29.629960 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8700d-3e30-4985-9662-2d94b85219bb None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:29.630302 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8700d-3e30-4985-9662-2d94b85219bb None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:29.630515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8700d-3e30-4985-9662-2d94b85219bb None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:29.632173 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 446/908] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:42:29.643162 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855cc31-c87d-494d-a917-1273a18ccb25 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:29.643457 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855cc31-c87d-494d-a917-1273a18ccb25 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:29.643722 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855cc31-c87d-494d-a917-1273a18ccb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:29.661143 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0855cc31-c87d-494d-a917-1273a18ccb25 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:29.662424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0855cc31-c87d-494d-a917-1273a18ccb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:29.700622 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdce6e1-fee6-4c4a-a5e4-f5456660e971 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:29.733920 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbd3c8-d56b-4ade-b3a2-1e9b4bcd7b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:29.734589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbd3c8-d56b-4ade-b3a2-1e9b4bcd7b0f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:29.734866 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbd3c8-d56b-4ade-b3a2-1e9b4bcd7b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:29.735161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbd3c8-d56b-4ade-b3a2-1e9b4bcd7b0f None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:29.735952 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fbd3c8-d56b-4ade-b3a2-1e9b4bcd7b0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:29.736254 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fbd3c8-d56b-4ade-b3a2-1e9b4bcd7b0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:29.737892 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fbd3c8-d56b-4ade-b3a2-1e9b4bcd7b0f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:29.740067 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 447/909] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:42:29.752600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 463/910] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:42:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:29.758729 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855cc31-c87d-494d-a917-1273a18ccb25 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:29.763512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbd3c8-d56b-4ade-b3a2-1e9b4bcd7b0f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:29.866292 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbd3c8-d56b-4ade-b3a2-1e9b4bcd7b0f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:29.873349 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855cc31-c87d-494d-a917-1273a18ccb25 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:29.901967 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade29ad-a830-4eca-8ca9-4fb4f52da381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:29.902785 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade29ad-a830-4eca-8ca9-4fb4f52da381 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:29.903102 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade29ad-a830-4eca-8ca9-4fb4f52da381 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:29.903378 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade29ad-a830-4eca-8ca9-4fb4f52da381 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:29.904029 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade29ad-a830-4eca-8ca9-4fb4f52da381 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:29.905406 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade29ad-a830-4eca-8ca9-4fb4f52da381 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:29.908210 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4a912-5afa-4074-a1f8-393d43b21486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:29.908875 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4a912-5afa-4074-a1f8-393d43b21486 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:29.909228 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4a912-5afa-4074-a1f8-393d43b21486 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:29.909511 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4a912-5afa-4074-a1f8-393d43b21486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:29.910349 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4a912-5afa-4074-a1f8-393d43b21486 None admin] RBAC: Adding query filter params (role.id=4e9d3c690fdb4f48878128cd834eb431, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=99cbf80fc74c4183a6eed3e97f7196f9) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:29.910723 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4a912-5afa-4074-a1f8-393d43b21486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:29.912254 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4a912-5afa-4074-a1f8-393d43b21486 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:29.917249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-bade29ad-a830-4eca-8ca9-4fb4f52da381 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 06:42:29.917249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:29.917249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:29.917249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:29.917249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:29.917249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:29.917249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:29.917249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:29.917249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 06:42:29.917249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:29.917249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:29.917249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:29.917249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:29.917249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:29.917249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:29.917249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:29.928114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:29.928114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:29.928114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:29.928114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:29.928114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:29.928114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:29.928114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:29.928114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:29.928114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:29.928114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:29.928114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:29.928114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:29.928114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:29.928114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:29.928114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:29.928114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:29.928982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:29.928982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:29.928982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:29.928982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:29.928982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:29.928982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:29.928982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:29.928982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:29.928982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:29.928982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:29.928982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:29.928982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:29.928982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:29.928982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 06:42:29.928982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:29.929794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 448/911] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:42:29 2022] GET /identity/v3/role_assignments?user.id=99cbf80fc74c4183a6eed3e97f7196f9&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=4e9d3c690fdb4f48878128cd834eb431 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:29.929794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec28151-2ac1-46ad-b578-42b9745220c9 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:29.929794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec28151-2ac1-46ad-b578-42b9745220c9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:29.929794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec28151-2ac1-46ad-b578-42b9745220c9 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:29.930061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 464/912] 10.222.0.77 () {56 vars in 1132 bytes} [Wed May 11 06:42:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:29.930138 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 449/913] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:29.930213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade29ad-a830-4eca-8ca9-4fb4f52da381 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:29.930283 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f2535-0de4-4eb7-85f2-2d9051746171 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:29.930283 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f2535-0de4-4eb7-85f2-2d9051746171 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:29.930283 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f2535-0de4-4eb7-85f2-2d9051746171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:29.949123 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-4c7f2535-0de4-4eb7-85f2-2d9051746171 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:29.950348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4c7f2535-0de4-4eb7-85f2-2d9051746171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:30.021643 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 450/914] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:30.023057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d4852-a518-462a-a363-e7fe48275d00 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:30.023407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d4852-a518-462a-a363-e7fe48275d00 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:30.023681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d4852-a518-462a-a363-e7fe48275d00 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:30.025289 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 451/915] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:30.030717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa916e-b54d-4494-92d8-e8a4912a94b0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:30.031046 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa916e-b54d-4494-92d8-e8a4912a94b0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:30.031328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa916e-b54d-4494-92d8-e8a4912a94b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:30.048136 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade29ad-a830-4eca-8ca9-4fb4f52da381 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:30.048661 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-bfaa916e-b54d-4494-92d8-e8a4912a94b0 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:30.049888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bfaa916e-b54d-4494-92d8-e8a4912a94b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:30.082574 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600a281-6163-404c-b1e2-5bbc48fcf766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:30.083288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600a281-6163-404c-b1e2-5bbc48fcf766 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:30.083569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600a281-6163-404c-b1e2-5bbc48fcf766 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:30.083841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600a281-6163-404c-b1e2-5bbc48fcf766 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:30.084562 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600a281-6163-404c-b1e2-5bbc48fcf766 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:30.084872 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600a281-6163-404c-b1e2-5bbc48fcf766 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:30.086295 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600a281-6163-404c-b1e2-5bbc48fcf766 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:30.096156 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 465/916] 10.222.0.77 () {56 vars in 1126 bytes} [Wed May 11 06:42:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:30.097121 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600a281-6163-404c-b1e2-5bbc48fcf766 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:30.127061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 452/917] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:42:30.127061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa916e-b54d-4494-92d8-e8a4912a94b0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:30.198621 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600a281-6163-404c-b1e2-5bbc48fcf766 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:30.228122 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa916e-b54d-4494-92d8-e8a4912a94b0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:30.230427 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdcaf4-77f2-4b9e-ba0e-187f53b6e3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:30.231197 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdcaf4-77f2-4b9e-ba0e-187f53b6e3ab None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:30.231481 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdcaf4-77f2-4b9e-ba0e-187f53b6e3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:30.231748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdcaf4-77f2-4b9e-ba0e-187f53b6e3ab None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:30.232472 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdcaf4-77f2-4b9e-ba0e-187f53b6e3ab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:30.233840 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdcaf4-77f2-4b9e-ba0e-187f53b6e3ab None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:30.249687 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 466/918] 10.222.0.77 () {60 vars in 1141 bytes} [Wed May 11 06:42:30 2022] POST /identity/v3/services => generated 241 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:42:30.250339 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdcaf4-77f2-4b9e-ba0e-187f53b6e3ab None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:30.282855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11456f-53db-40ef-b6cc-e0d115deb920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:30.283785 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11456f-53db-40ef-b6cc-e0d115deb920 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:30.284456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11456f-53db-40ef-b6cc-e0d115deb920 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:30.284737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11456f-53db-40ef-b6cc-e0d115deb920 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:30.285471 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11456f-53db-40ef-b6cc-e0d115deb920 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:30.285819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11456f-53db-40ef-b6cc-e0d115deb920 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:30.287626 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11456f-53db-40ef-b6cc-e0d115deb920 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:30.299423 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 453/919] 10.222.0.77 () {56 vars in 1126 bytes} [Wed May 11 06:42:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:30.302207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11456f-53db-40ef-b6cc-e0d115deb920 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:30.382116 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdcaf4-77f2-4b9e-ba0e-187f53b6e3ab None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:30.425191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59a5b5-8fa3-4ef8-95d4-60956889b982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:30.426456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11456f-53db-40ef-b6cc-e0d115deb920 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:30.427063 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59a5b5-8fa3-4ef8-95d4-60956889b982 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:30.427538 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59a5b5-8fa3-4ef8-95d4-60956889b982 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:30.428002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59a5b5-8fa3-4ef8-95d4-60956889b982 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:30.428890 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59a5b5-8fa3-4ef8-95d4-60956889b982 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:30.430603 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59a5b5-8fa3-4ef8-95d4-60956889b982 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:30.444210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-8f59a5b5-8fa3-4ef8-95d4-60956889b982 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 06:42:30.444210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:30.444210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:30.444210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:30.444210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:30.444210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:30.444210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:30.444210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:30.444210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 06:42:30.444210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:30.444210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:30.444210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:30.444210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:30.444210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:30.444210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:30.444210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:30.444210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:30.445643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:30.445643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:30.445643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:30.445643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:30.445643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:30.445643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:30.445643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:30.445643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:30.445643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:30.445643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:30.445643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:30.445643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:30.445643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:30.445643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:30.445643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:30.445643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:30.446476 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:30.446476 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:30.446476 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:30.446476 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:30.446476 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:30.446476 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:30.446476 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:30.446476 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:30.446476 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:30.446476 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:30.446476 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:30.446476 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:30.446476 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 06:42:30.446476 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:30.449456 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 467/920] 10.222.0.77 () {56 vars in 1114 bytes} [Wed May 11 06:42:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:30.457774 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59a5b5-8fa3-4ef8-95d4-60956889b982 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:30.463845 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11626fb7-b678-4662-8a9d-8d35cbc51029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:30.464519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11626fb7-b678-4662-8a9d-8d35cbc51029 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:30.464796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11626fb7-b678-4662-8a9d-8d35cbc51029 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:30.465158 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11626fb7-b678-4662-8a9d-8d35cbc51029 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:30.466352 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11626fb7-b678-4662-8a9d-8d35cbc51029 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:30.468125 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11626fb7-b678-4662-8a9d-8d35cbc51029 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:30.489824 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 454/921] 10.222.0.77 () {60 vars in 1144 bytes} [Wed May 11 06:42:30 2022] POST /identity/v3/endpoints => generated 347 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:42:30.578152 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59a5b5-8fa3-4ef8-95d4-60956889b982 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:30.621419 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fef9ee-6153-4a72-a8f5-5c06f8c86d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:30.622823 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fef9ee-6153-4a72-a8f5-5c06f8c86d67 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:30.623271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fef9ee-6153-4a72-a8f5-5c06f8c86d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:30.623682 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fef9ee-6153-4a72-a8f5-5c06f8c86d67 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:30.624552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fef9ee-6153-4a72-a8f5-5c06f8c86d67 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:30.625005 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fef9ee-6153-4a72-a8f5-5c06f8c86d67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:30.626615 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fef9ee-6153-4a72-a8f5-5c06f8c86d67 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:30.633247 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 468/922] 10.222.0.77 () {56 vars in 1114 bytes} [Wed May 11 06:42:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:30.639004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11626fb7-b678-4662-8a9d-8d35cbc51029 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:30.749302 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11626fb7-b678-4662-8a9d-8d35cbc51029 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:30.782384 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ce8d9-0aab-4b13-8904-e27ee3a921a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:30.783110 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ce8d9-0aab-4b13-8904-e27ee3a921a4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:30.783394 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ce8d9-0aab-4b13-8904-e27ee3a921a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:30.783669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ce8d9-0aab-4b13-8904-e27ee3a921a4 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:30.784388 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ce8d9-0aab-4b13-8904-e27ee3a921a4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:30.784697 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ce8d9-0aab-4b13-8904-e27ee3a921a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:30.786125 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ce8d9-0aab-4b13-8904-e27ee3a921a4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:30.791569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 455/923] 10.222.0.77 () {56 vars in 1114 bytes} [Wed May 11 06:42:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:30.797232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fef9ee-6153-4a72-a8f5-5c06f8c86d67 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:30.896671 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fef9ee-6153-4a72-a8f5-5c06f8c86d67 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:30.930440 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c128a-7a92-4471-aff0-60c53aa1700d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:30.931142 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c128a-7a92-4471-aff0-60c53aa1700d None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:30.931425 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c128a-7a92-4471-aff0-60c53aa1700d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:30.931698 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c128a-7a92-4471-aff0-60c53aa1700d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:30.932462 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c128a-7a92-4471-aff0-60c53aa1700d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:30.933832 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c128a-7a92-4471-aff0-60c53aa1700d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:30.955778 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 469/924] 10.222.0.77 () {60 vars in 1144 bytes} [Wed May 11 06:42:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:42:32.190900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cfa7d-2948-4d22-af99-a1a1c965f168 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:32.191499 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cfa7d-2948-4d22-af99-a1a1c965f168 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:32.191859 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cfa7d-2948-4d22-af99-a1a1c965f168 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:32.193530 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 456/925] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:32.199227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89082df7-43c8-4630-a001-7f92b26e1854 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:32.199640 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89082df7-43c8-4630-a001-7f92b26e1854 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:32.199953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89082df7-43c8-4630-a001-7f92b26e1854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:32.217384 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-89082df7-43c8-4630-a001-7f92b26e1854 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:32.218567 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-89082df7-43c8-4630-a001-7f92b26e1854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:32.291520 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 470/926] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:32.313263 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19cfa7d-2948-4d22-af99-a1a1c965f168 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:32.418939 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19cfa7d-2948-4d22-af99-a1a1c965f168 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:32.457670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5c9c9-fa20-4722-98a4-97947935a5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:32.458414 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5c9c9-fa20-4722-98a4-97947935a5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:32.458694 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5c9c9-fa20-4722-98a4-97947935a5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:32.458981 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5c9c9-fa20-4722-98a4-97947935a5d3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:32.470211 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5c9c9-fa20-4722-98a4-97947935a5d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:42:32.478348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-2cc5c9c9-fa20-4722-98a4-97947935a5d3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:42:32.478348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:32.478348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:32.478348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:32.478348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:32.478348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:32.478348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:32.478348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:32.478348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:32.478348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:32.478348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:32.478348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:32.478348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:42:32.478348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:42:32.478348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:42:32.478348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:42:32.479330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:42:32.479330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:42:32.479330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:42:32.479330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:42:32.479330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:32.479330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:32.479330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:32.479330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:32.479330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:32.479330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:32.479330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:32.479330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:32.479330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:32.479330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:32.479330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:32.479330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:32.480177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:32.480177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:32.480177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:32.480177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:32.480177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:42:32.480177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:42:32.480177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:42:32.480177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:42:32.480177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:42:32.480177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:42:32.480177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:42:32.480177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:32.480177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 457/927] 10.222.0.77 () {56 vars in 1120 bytes} [Wed May 11 06:42:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:32.487247 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89082df7-43c8-4630-a001-7f92b26e1854 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:32.580247 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff095-8673-4803-adc8-8ded829c8737 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:32.580594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff095-8673-4803-adc8-8ded829c8737 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:32.580809 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff095-8673-4803-adc8-8ded829c8737 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:32.582310 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 458/928] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:32.587336 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1afc8b-045b-4021-99b8-9963ac338e10 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:32.587625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1afc8b-045b-4021-99b8-9963ac338e10 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:32.587894 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1afc8b-045b-4021-99b8-9963ac338e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:32.588684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89082df7-43c8-4630-a001-7f92b26e1854 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:32.608184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-dd1afc8b-045b-4021-99b8-9963ac338e10 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:32.609986 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-dd1afc8b-045b-4021-99b8-9963ac338e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:32.625050 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77300fce-8bbf-42b1-9880-a6203683a4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:32.626146 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77300fce-8bbf-42b1-9880-a6203683a4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:32.626622 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77300fce-8bbf-42b1-9880-a6203683a4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:32.627126 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77300fce-8bbf-42b1-9880-a6203683a4e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:32.628234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77300fce-8bbf-42b1-9880-a6203683a4e9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:32.628850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77300fce-8bbf-42b1-9880-a6203683a4e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:32.630566 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77300fce-8bbf-42b1-9880-a6203683a4e9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:32.641528 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 471/929] 10.222.0.77 () {56 vars in 1115 bytes} [Wed May 11 06:42:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:32.647886 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77300fce-8bbf-42b1-9880-a6203683a4e9 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:32.711146 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 459/930] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:32.734871 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1afc8b-045b-4021-99b8-9963ac338e10 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:32.770816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77300fce-8bbf-42b1-9880-a6203683a4e9 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:32.815069 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d80fb-71ca-4290-8be6-7ddf54b1bde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:32.815884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d80fb-71ca-4290-8be6-7ddf54b1bde5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:32.816163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d80fb-71ca-4290-8be6-7ddf54b1bde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:32.816431 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d80fb-71ca-4290-8be6-7ddf54b1bde5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:32.827487 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d80fb-71ca-4290-8be6-7ddf54b1bde5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:32.828936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d80fb-71ca-4290-8be6-7ddf54b1bde5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:32.832848 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1afc8b-045b-4021-99b8-9963ac338e10 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:32.845552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ab5d80fb-71ca-4290-8be6-7ddf54b1bde5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:32.845552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:32.845552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:32.845552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:32.845552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:32.845552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:32.845552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:32.845552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:32.845552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:32.845552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:32.845552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:32.845552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:32.845552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:32.845552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:32.845552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:32.846512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:32.846512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:32.846512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:32.846512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:32.846512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:32.846512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:32.846512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:32.846512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:32.846512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:32.846512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:32.846512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:32.846512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:32.846512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:32.846512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:32.846512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:32.846512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:32.846512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:32.847508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:32.847508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:32.847508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:32.847508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:32.847508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 472/931] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:32.848366 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4b0c9-e401-453a-8bbf-db9579fbd682 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:32.848366 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4b0c9-e401-453a-8bbf-db9579fbd682 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:32.848969 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4b0c9-e401-453a-8bbf-db9579fbd682 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:32.850016 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 473/932] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:32.854734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4b0c9-e401-453a-8bbf-db9579fbd682 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:32.874855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b831d60-5d2a-4781-b3b1-0d61ab127a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:32.876207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b831d60-5d2a-4781-b3b1-0d61ab127a0d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:32.876656 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b831d60-5d2a-4781-b3b1-0d61ab127a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:32.877067 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b831d60-5d2a-4781-b3b1-0d61ab127a0d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:32.877870 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b831d60-5d2a-4781-b3b1-0d61ab127a0d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:32.880135 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b831d60-5d2a-4781-b3b1-0d61ab127a0d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:32.894835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-4b831d60-5d2a-4781-b3b1-0d61ab127a0d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:42:32.894835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:32.894835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:32.894835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:32.894835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:32.894835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:32.894835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:32.894835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:32.894835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:42:32.894835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:32.894835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:32.894835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:32.894835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:32.894835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:32.894835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:32.894835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:32.894835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:32.896084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:32.896084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:32.896084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:32.896084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:32.896084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:32.896084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:32.896084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:32.896084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:32.896084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:32.896084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:32.896084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:32.896084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:32.896084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:32.896084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:32.896084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:32.896084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:32.897132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:32.897132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:32.897132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:32.897132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:32.897132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:32.897132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:32.897132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:32.897132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:32.897132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:32.897132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:32.897132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:32.897132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:32.897132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:42:32.897132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:32.900285 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 460/933] 10.222.0.77 () {56 vars in 1126 bytes} [Wed May 11 06:42:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:32.901994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49047bc8-17ac-4f0b-a199-c26037616aa4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:32.902651 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49047bc8-17ac-4f0b-a199-c26037616aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:32.903082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49047bc8-17ac-4f0b-a199-c26037616aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:32.923613 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-49047bc8-17ac-4f0b-a199-c26037616aa4 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:32.925332 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-49047bc8-17ac-4f0b-a199-c26037616aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:32.959347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4b0c9-e401-453a-8bbf-db9579fbd682 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:32.991753 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 461/934] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:32.992084 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2bf1c-490c-4d63-88f7-1cfedd083e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:32.992814 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2bf1c-490c-4d63-88f7-1cfedd083e59 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:32.993095 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2bf1c-490c-4d63-88f7-1cfedd083e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:32.993364 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2bf1c-490c-4d63-88f7-1cfedd083e59 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:32.994083 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2bf1c-490c-4d63-88f7-1cfedd083e59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:32.994382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2bf1c-490c-4d63-88f7-1cfedd083e59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:32.995791 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2bf1c-490c-4d63-88f7-1cfedd083e59 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:33.001231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49047bc8-17ac-4f0b-a199-c26037616aa4 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:33.011884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 474/935] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:33.013498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2bf1c-490c-4d63-88f7-1cfedd083e59 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:33.105070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49047bc8-17ac-4f0b-a199-c26037616aa4 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:33.114324 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2bf1c-490c-4d63-88f7-1cfedd083e59 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:33.137636 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3273e-ed69-4581-82e4-d4111439305f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:33.138307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3273e-ed69-4581-82e4-d4111439305f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:33.138588 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3273e-ed69-4581-82e4-d4111439305f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:33.138861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3273e-ed69-4581-82e4-d4111439305f None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:33.139601 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3273e-ed69-4581-82e4-d4111439305f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:33.139912 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3273e-ed69-4581-82e4-d4111439305f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:33.141284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3273e-ed69-4581-82e4-d4111439305f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:33.150436 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 462/936] 10.222.0.77 () {56 vars in 1122 bytes} [Wed May 11 06:42:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:33.150436 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3273e-ed69-4581-82e4-d4111439305f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:33.151603 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc515e4-9ef0-4c04-a596-0764aaff761d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:33.152431 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc515e4-9ef0-4c04-a596-0764aaff761d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:33.152717 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc515e4-9ef0-4c04-a596-0764aaff761d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:33.152996 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc515e4-9ef0-4c04-a596-0764aaff761d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:33.160232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc515e4-9ef0-4c04-a596-0764aaff761d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:33.161721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc515e4-9ef0-4c04-a596-0764aaff761d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:33.177484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-1dc515e4-9ef0-4c04-a596-0764aaff761d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:42:33.177484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:33.177484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:33.177484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:33.177484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:33.177484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:33.177484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:33.177484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:33.177484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:33.177484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:33.177484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:33.177484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:33.177484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:42:33.177484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:42:33.177484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:42:33.177484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:42:33.178459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:33.178459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:33.178459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:42:33.178459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:33.178459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:42:33.178459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:33.178459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:33.178459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:33.178459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:33.178459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:33.178459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:33.178459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:33.178459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:33.178459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:33.178459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:33.178459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:33.178459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:33.178459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:33.179540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:33.179540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:33.179540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:42:33.179540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:42:33.179540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:42:33.179540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:42:33.179540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:42:33.179540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:42:33.179540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:42:33.179540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:33.179540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 475/937] 10.222.0.77 () {56 vars in 1117 bytes} [Wed May 11 06:42:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:33.179540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc515e4-9ef0-4c04-a596-0764aaff761d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:33.250416 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3273e-ed69-4581-82e4-d4111439305f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:33.273792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc515e4-9ef0-4c04-a596-0764aaff761d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:33.283600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9d892-5826-4ac1-9a41-074485855de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:33.284407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9d892-5826-4ac1-9a41-074485855de3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:33.284685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9d892-5826-4ac1-9a41-074485855de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:33.284989 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9d892-5826-4ac1-9a41-074485855de3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:33.285600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9d892-5826-4ac1-9a41-074485855de3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:33.286986 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9d892-5826-4ac1-9a41-074485855de3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:33.298386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-16f9d892-5826-4ac1-9a41-074485855de3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 06:42:33.298386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:33.298386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:33.298386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:33.298386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:33.298386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:33.298386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:33.298386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:33.298386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 06:42:33.298386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:33.298386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:33.298386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:33.298386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:33.298386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:33.298386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:33.298386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:33.298386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:33.299434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:33.299434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:33.299434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:33.299434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:33.299434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:33.299434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:33.299434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:33.299434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:33.299434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:33.299434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:33.299434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:33.299434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:33.299434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:33.299434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:33.299434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:33.299434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:33.305670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:33.305670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:33.305670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:33.305670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:33.305670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:33.305670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:33.305670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:33.305670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:33.305670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:33.305670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:33.305670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:33.305670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:33.305670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 06:42:33.305670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:33.305670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 463/938] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:33.306526 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9d892-5826-4ac1-9a41-074485855de3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:33.310049 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee1898-1919-4614-ae30-deb9237b58be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:33.310726 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee1898-1919-4614-ae30-deb9237b58be None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:33.311039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee1898-1919-4614-ae30-deb9237b58be None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:33.311318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee1898-1919-4614-ae30-deb9237b58be None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:33.312043 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee1898-1919-4614-ae30-deb9237b58be None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:33.312352 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee1898-1919-4614-ae30-deb9237b58be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:33.313730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee1898-1919-4614-ae30-deb9237b58be None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:33.318588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 476/939] 10.222.0.77 () {56 vars in 1122 bytes} [Wed May 11 06:42:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:33.319677 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b44f9b-5ccf-4bcf-8395-5f1f9fcf1eac None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:33.319964 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b44f9b-5ccf-4bcf-8395-5f1f9fcf1eac None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:33.320582 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b44f9b-5ccf-4bcf-8395-5f1f9fcf1eac None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:33.321840 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 477/940] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:33.323900 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b44f9b-5ccf-4bcf-8395-5f1f9fcf1eac None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:33.395824 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9d892-5826-4ac1-9a41-074485855de3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:33.416981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b44f9b-5ccf-4bcf-8395-5f1f9fcf1eac None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:33.427543 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f7faf-be69-4126-93e4-2f95d514fb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:33.428215 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f7faf-be69-4126-93e4-2f95d514fb32 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:33.428492 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f7faf-be69-4126-93e4-2f95d514fb32 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:33.428767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f7faf-be69-4126-93e4-2f95d514fb32 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:33.429636 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f7faf-be69-4126-93e4-2f95d514fb32 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:33.429922 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f7faf-be69-4126-93e4-2f95d514fb32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:33.431383 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f7faf-be69-4126-93e4-2f95d514fb32 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:33.448755 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 464/941] 10.222.0.77 () {56 vars in 1149 bytes} [Wed May 11 06:42:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:33.449553 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f7faf-be69-4126-93e4-2f95d514fb32 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:33.450271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed27b72-8c19-42f6-b03a-521f7edbd678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:33.451159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed27b72-8c19-42f6-b03a-521f7edbd678 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:33.451444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed27b72-8c19-42f6-b03a-521f7edbd678 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:33.451717 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed27b72-8c19-42f6-b03a-521f7edbd678 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:33.452421 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed27b72-8c19-42f6-b03a-521f7edbd678 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:33.452699 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed27b72-8c19-42f6-b03a-521f7edbd678 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:33.454084 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed27b72-8c19-42f6-b03a-521f7edbd678 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:33.458879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 478/942] 10.222.0.77 () {56 vars in 1112 bytes} [Wed May 11 06:42:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:33.460064 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb371aa5-a753-45a7-ac1e-3ce78b462155 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:33.460346 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb371aa5-a753-45a7-ac1e-3ce78b462155 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:33.460605 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb371aa5-a753-45a7-ac1e-3ce78b462155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:33.477224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-cb371aa5-a753-45a7-ac1e-3ce78b462155 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:33.478410 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cb371aa5-a753-45a7-ac1e-3ce78b462155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:33.541075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 479/943] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:33.541826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb371aa5-a753-45a7-ac1e-3ce78b462155 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:33.543532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f7faf-be69-4126-93e4-2f95d514fb32 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:33.578836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d554a4-6e30-41fb-a7d6-6c4b73e08d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:33.579526 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d554a4-6e30-41fb-a7d6-6c4b73e08d72 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:33.579808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d554a4-6e30-41fb-a7d6-6c4b73e08d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:33.580073 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d554a4-6e30-41fb-a7d6-6c4b73e08d72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:33.580854 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d554a4-6e30-41fb-a7d6-6c4b73e08d72 None admin] RBAC: Adding query filter params (interface=public, service_id=8d3a641d76b448e9a3c6caac738e8fb0, region_id=RegionOne) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:33.581157 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d554a4-6e30-41fb-a7d6-6c4b73e08d72 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:33.582520 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d554a4-6e30-41fb-a7d6-6c4b73e08d72 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:33.591777 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 465/944] 10.222.0.77 () {56 vars in 1251 bytes} [Wed May 11 06:42:33 2022] GET /identity/v3/endpoints?service_id=8d3a641d76b448e9a3c6caac738e8fb0&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:33.591777 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d554a4-6e30-41fb-a7d6-6c4b73e08d72 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:33.636836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb371aa5-a753-45a7-ac1e-3ce78b462155 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:33.670191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d5cdb-c531-4b7b-a2aa-1850e7d3761f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:33.671016 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d5cdb-c531-4b7b-a2aa-1850e7d3761f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:33.671293 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d5cdb-c531-4b7b-a2aa-1850e7d3761f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:33.671558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d5cdb-c531-4b7b-a2aa-1850e7d3761f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:33.681212 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d5cdb-c531-4b7b-a2aa-1850e7d3761f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:33.682662 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d5cdb-c531-4b7b-a2aa-1850e7d3761f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:33.684104 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d554a4-6e30-41fb-a7d6-6c4b73e08d72 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:33.699858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c24d5cdb-c531-4b7b-a2aa-1850e7d3761f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:33.699858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:33.699858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:33.699858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:33.699858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:33.699858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:33.699858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:33.699858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:33.699858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:33.699858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:33.699858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:33.699858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:33.699858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:33.699858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:33.699858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:33.700798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:33.700798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:33.700798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:33.700798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:33.700798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:33.700798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:33.700798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:33.700798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:33.700798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:33.700798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:33.700798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:33.700798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:33.700798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:33.700798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:33.700798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:33.700798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:33.700798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:33.701732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:33.701732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:33.701732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:33.701732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:33.701732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 480/945] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:33.702029 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d5cdb-c531-4b7b-a2aa-1850e7d3761f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:33.717136 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515e1e0-a87d-4a3f-9f77-a18380e08692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:33.717820 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515e1e0-a87d-4a3f-9f77-a18380e08692 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:33.718103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515e1e0-a87d-4a3f-9f77-a18380e08692 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:33.718382 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515e1e0-a87d-4a3f-9f77-a18380e08692 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:33.719135 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515e1e0-a87d-4a3f-9f77-a18380e08692 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:33.719455 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515e1e0-a87d-4a3f-9f77-a18380e08692 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:33.720837 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515e1e0-a87d-4a3f-9f77-a18380e08692 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:33.725556 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 466/946] 10.222.0.77 () {56 vars in 1112 bytes} [Wed May 11 06:42:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:33.726225 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515e1e0-a87d-4a3f-9f77-a18380e08692 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:33.812089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d5cdb-c531-4b7b-a2aa-1850e7d3761f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:33.830699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515e1e0-a87d-4a3f-9f77-a18380e08692 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:33.852603 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7aaaf6-59c7-498f-bb56-50b8d87bdb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:33.853285 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7aaaf6-59c7-498f-bb56-50b8d87bdb8a None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:33.853566 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7aaaf6-59c7-498f-bb56-50b8d87bdb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:33.853860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7aaaf6-59c7-498f-bb56-50b8d87bdb8a None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:33.854589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7aaaf6-59c7-498f-bb56-50b8d87bdb8a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:33.856115 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7aaaf6-59c7-498f-bb56-50b8d87bdb8a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:33.857555 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: WARNING keystone.server.flask.common [None req-da7aaaf6-59c7-498f-bb56-50b8d87bdb8a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 11 06:42:33.871071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a60aa-95bc-4e5e-a74b-ee5f9c9ad829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:33.871869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a60aa-95bc-4e5e-a74b-ee5f9c9ad829 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:33.872150 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a60aa-95bc-4e5e-a74b-ee5f9c9ad829 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:33.872406 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a60aa-95bc-4e5e-a74b-ee5f9c9ad829 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:33.873109 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a60aa-95bc-4e5e-a74b-ee5f9c9ad829 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:33.874540 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a60aa-95bc-4e5e-a74b-ee5f9c9ad829 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:33.876488 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.sql.core [None req-da7aaaf6-59c7-498f-bb56-50b8d87bdb8a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 06:42:33.876488 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 11 06:42:33.876488 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [parameters: {'id': 'c63c9796c15b401eb850092f67cd8d65', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 11 06:42:33.876488 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80058) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 06:42:33.884558 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 467/947] 10.222.0.77 () {56 vars in 1087 bytes} [Wed May 11 06:42:33 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:42:33.885740 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a60aa-95bc-4e5e-a74b-ee5f9c9ad829 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:33.893235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-da7aaaf6-59c7-498f-bb56-50b8d87bdb8a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c63c9796c15b401eb850092f67cd8d65.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c63c9796c15b401eb850092f67cd8d65. May 11 06:42:33.893235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:33.893235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 06:42:33.893235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 06:42:33.893235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 06:42:33.893235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 06:42:33.893235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 06:42:33.893235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application result = self._query(query) May 11 06:42:33.893235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 06:42:33.893235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application conn.query(q) May 11 06:42:33.893235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 06:42:33.893235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 06:42:33.893235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 06:42:33.894165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application result.read() May 11 06:42:33.894165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 06:42:33.894165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 06:42:33.894165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 06:42:33.894165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 06:42:33.894165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 06:42:33.894165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 06:42:33.894165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 06:42:33.894165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 06:42:33.894165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 06:42:33.894165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:33.894165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 06:42:33.894165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:33.894165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:33.894165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 06:42:33.894165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 06:42:33.894165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 11 06:42:33.894165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return project_ref.to_dict() May 11 06:42:33.895376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 06:42:33.895376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application next(self.gen) May 11 06:42:33.895376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 06:42:33.895376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application yield resource May 11 06:42:33.895376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 06:42:33.895376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application next(self.gen) May 11 06:42:33.895376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 06:42:33.895376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self.session.rollback() May 11 06:42:33.895376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 06:42:33.895376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self.force_reraise() May 11 06:42:33.895376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 06:42:33.895376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise self.value May 11 06:42:33.895376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 06:42:33.895376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 06:42:33.895376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 06:42:33.895376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application session.commit() May 11 06:42:33.895376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 06:42:33.896363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 06:42:33.896363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 06:42:33.896363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._prepare_impl() May 11 06:42:33.896363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 06:42:33.896363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self.session.flush() May 11 06:42:33.896363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 06:42:33.896363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._flush(objects) May 11 06:42:33.896363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 06:42:33.896363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 06:42:33.896363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 06:42:33.896363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application compat.raise_( May 11 06:42:33.896363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 06:42:33.896363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception May 11 06:42:33.896363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 06:42:33.896363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application flush_context.execute() May 11 06:42:33.896363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 06:42:33.896363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rec.execute(self) May 11 06:42:33.897341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 06:42:33.897341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 06:42:33.897341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 06:42:33.897341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 06:42:33.897341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 11 06:42:33.897341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application c = connection._execute_20( May 11 06:42:33.897341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 06:42:33.897341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 06:42:33.897341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 06:42:33.897341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 06:42:33.897341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 06:42:33.897341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 06:42:33.897341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 06:42:33.897341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 06:42:33.897341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 06:42:33.898150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 06:42:33.898150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 06:42:33.898150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception May 11 06:42:33.898150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 06:42:33.898150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 06:42:33.898150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 06:42:33.898150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 06:42:33.898150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 06:42:33.898150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application result = self._query(query) May 11 06:42:33.898150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 06:42:33.898150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application conn.query(q) May 11 06:42:33.898150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 06:42:33.898150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 06:42:33.898150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 06:42:33.898150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application result.read() May 11 06:42:33.898150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 06:42:33.898150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 06:42:33.899160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 06:42:33.899160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 06:42:33.899160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 06:42:33.899160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 06:42:33.899160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 06:42:33.899160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 06:42:33.899160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 06:42:33.899160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 11 06:42:33.899160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [parameters: {'id': 'c63c9796c15b401eb850092f67cd8d65', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 11 06:42:33.899160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 06:42:33.899160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:33.899160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:33.899160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:33.899160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:33.899160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 11 06:42:33.900305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 11 06:42:33.900305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 06:42:33.900305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 06:42:33.900305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 11 06:42:33.900305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:33.900305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:33.900305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:33.900305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:33.900305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:33.900305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:33.900305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:33.900305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:33.900305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:33.900305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:33.900305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:33.900305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:33.900305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:33.901982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:33.901982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 11 06:42:33.901982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 11 06:42:33.901982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:33.901982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:33.901982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 11 06:42:33.901982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.Conflict( May 11 06:42:33.901982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c63c9796c15b401eb850092f67cd8d65. May 11 06:42:33.901982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:33.901982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 481/948] 10.222.0.77 () {60 vars in 1140 bytes} [Wed May 11 06:42:33 2022] POST /identity/v3/projects => generated 262 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:33.901982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7aaaf6-59c7-498f-bb56-50b8d87bdb8a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:34.038064 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a60aa-95bc-4e5e-a74b-ee5f9c9ad829 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:34.039960 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7aaaf6-59c7-498f-bb56-50b8d87bdb8a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:34.075850 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e303b08-820d-4a76-9cc8-77526eb9bc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:34.076528 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e303b08-820d-4a76-9cc8-77526eb9bc30 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:34.076813 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e303b08-820d-4a76-9cc8-77526eb9bc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:34.077086 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e303b08-820d-4a76-9cc8-77526eb9bc30 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:34.077826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e303b08-820d-4a76-9cc8-77526eb9bc30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:34.078130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e303b08-820d-4a76-9cc8-77526eb9bc30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:34.080082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e303b08-820d-4a76-9cc8-77526eb9bc30 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:34.083346 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2231b-d708-483f-a0d3-d0347a86414e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:34.084172 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2231b-d708-483f-a0d3-d0347a86414e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:34.084457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2231b-d708-483f-a0d3-d0347a86414e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:34.084732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2231b-d708-483f-a0d3-d0347a86414e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:34.092415 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2231b-d708-483f-a0d3-d0347a86414e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:34.094112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2231b-d708-483f-a0d3-d0347a86414e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:34.094245 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 468/949] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:34.100158 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e303b08-820d-4a76-9cc8-77526eb9bc30 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:34.110696 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f3a2231b-d708-483f-a0d3-d0347a86414e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:34.110696 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:34.110696 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:34.110696 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:34.110696 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:34.110696 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:34.110696 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:34.110696 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:34.110696 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:34.110696 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:34.110696 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:34.110696 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:34.110696 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:42:34.110696 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:42:34.110696 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:42:34.111694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:42:34.111694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:34.111694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:34.111694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:34.111694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:34.111694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:34.111694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:34.111694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:34.111694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:34.111694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:34.111694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:34.111694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:34.111694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:34.111694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:34.111694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:34.111694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:34.111694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:34.112630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:42:34.112630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:42:34.112630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:42:34.112630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:42:34.112630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:42:34.112630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:42:34.112630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:34.112630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:34.112630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 482/950] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:34.117721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2231b-d708-483f-a0d3-d0347a86414e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:34.206445 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e303b08-820d-4a76-9cc8-77526eb9bc30 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:34.229030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2231b-d708-483f-a0d3-d0347a86414e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:34.239587 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f5290-df99-439c-a40b-2bd77a34e06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:34.240398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f5290-df99-439c-a40b-2bd77a34e06a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:34.240678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f5290-df99-439c-a40b-2bd77a34e06a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:34.240951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f5290-df99-439c-a40b-2bd77a34e06a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:34.247869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f5290-df99-439c-a40b-2bd77a34e06a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:34.249335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f5290-df99-439c-a40b-2bd77a34e06a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:34.264335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-e87f5290-df99-439c-a40b-2bd77a34e06a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:34.264335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:34.264335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:34.264335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:34.264335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:34.264335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:34.264335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:34.264335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:34.264335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:34.264335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:34.264335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:34.264335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:34.264335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:42:34.264335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:42:34.264335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:42:34.265693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:42:34.265693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:34.265693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:34.265693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:34.265693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:34.265693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:34.265693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:34.265693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:34.265693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:34.265693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:34.265693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:34.265693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:34.265693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:34.265693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:34.265693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:34.265693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:34.265693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:34.266611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:42:34.266611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:42:34.266611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:42:34.266611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:42:34.266611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:42:34.266611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:42:34.266611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:34.266611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:34.267081 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbee2a-1bdf-41e2-8d34-958d371c2f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:34.267081 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbee2a-1bdf-41e2-8d34-958d371c2f85 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:34.267081 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbee2a-1bdf-41e2-8d34-958d371c2f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:34.267081 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbee2a-1bdf-41e2-8d34-958d371c2f85 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:34.267887 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbee2a-1bdf-41e2-8d34-958d371c2f85 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:34.270985 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbee2a-1bdf-41e2-8d34-958d371c2f85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:34.270985 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbee2a-1bdf-41e2-8d34-958d371c2f85 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:34.271336 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 469/951] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:34.271570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f5290-df99-439c-a40b-2bd77a34e06a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:34.295314 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 483/952] 10.222.0.77 () {56 vars in 1112 bytes} [Wed May 11 06:42:34 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:34.376837 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f5290-df99-439c-a40b-2bd77a34e06a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:34.414872 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38bfa6-f7a3-4678-aad0-851dd9997e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:34.415645 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38bfa6-f7a3-4678-aad0-851dd9997e22 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:34.415923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38bfa6-f7a3-4678-aad0-851dd9997e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:34.416196 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38bfa6-f7a3-4678-aad0-851dd9997e22 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:34.417002 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38bfa6-f7a3-4678-aad0-851dd9997e22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:34.417307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38bfa6-f7a3-4678-aad0-851dd9997e22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:34.418761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38bfa6-f7a3-4678-aad0-851dd9997e22 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:34.436551 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 470/953] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:42:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:34.437995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbee2a-1bdf-41e2-8d34-958d371c2f85 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:34.540563 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbee2a-1bdf-41e2-8d34-958d371c2f85 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:34.574448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc42b7-7c7a-4c6f-989d-73ee8a82a7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:34.575861 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc42b7-7c7a-4c6f-989d-73ee8a82a7b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:34.576356 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc42b7-7c7a-4c6f-989d-73ee8a82a7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:34.576835 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc42b7-7c7a-4c6f-989d-73ee8a82a7b7 None admin] PATH_INFO: `/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/99cbf80fc74c4183a6eed3e97f7196f9/roles/4e9d3c690fdb4f48878128cd834eb431` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:34.579412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc42b7-7c7a-4c6f-989d-73ee8a82a7b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f573a9de6904664ace6287072a8a7dc, user_id=99cbf80fc74c4183a6eed3e97f7196f9, role_id=4e9d3c690fdb4f48878128cd834eb431)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:34.581055 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc42b7-7c7a-4c6f-989d-73ee8a82a7b7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:34.598030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 484/954] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:42:34 2022] PUT /identity/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/99cbf80fc74c4183a6eed3e97f7196f9/roles/4e9d3c690fdb4f48878128cd834eb431 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:42:36.015790 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a015776-16a4-49ad-972d-baf1b6a88d52 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:36.016357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a015776-16a4-49ad-972d-baf1b6a88d52 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:36.016357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a015776-16a4-49ad-972d-baf1b6a88d52 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:36.017995 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 471/955] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:36.024099 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9f563-d970-412f-a25b-c8f1e8a19c19 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:36.024607 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9f563-d970-412f-a25b-c8f1e8a19c19 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:36.024607 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9f563-d970-412f-a25b-c8f1e8a19c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:36.042009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-00a9f563-d970-412f-a25b-c8f1e8a19c19 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:36.043566 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-00a9f563-d970-412f-a25b-c8f1e8a19c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:36.115085 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 485/956] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:36.131835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a015776-16a4-49ad-972d-baf1b6a88d52 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:36.191981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80de89-beae-4b09-88ec-a9b146a3057b None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:36.192605 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80de89-beae-4b09-88ec-a9b146a3057b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:36.193080 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80de89-beae-4b09-88ec-a9b146a3057b None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:36.194902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 486/957] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:42:36.200616 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb56a40-07bf-414e-b12c-7b289e7cea31 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:36.201146 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb56a40-07bf-414e-b12c-7b289e7cea31 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:36.201620 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb56a40-07bf-414e-b12c-7b289e7cea31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:36.218439 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2bb56a40-07bf-414e-b12c-7b289e7cea31 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:36.220034 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2bb56a40-07bf-414e-b12c-7b289e7cea31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:36.236950 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a015776-16a4-49ad-972d-baf1b6a88d52 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:36.275943 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eda6a-90a3-4d6e-abde-e1e08f7e1ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:36.276528 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eda6a-90a3-4d6e-abde-e1e08f7e1ec4 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:36.276804 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eda6a-90a3-4d6e-abde-e1e08f7e1ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:36.277070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eda6a-90a3-4d6e-abde-e1e08f7e1ec4 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:36.278199 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307eda6a-90a3-4d6e-abde-e1e08f7e1ec4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:36.279886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307eda6a-90a3-4d6e-abde-e1e08f7e1ec4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:36.298175 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 487/958] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:42:36.311389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 472/959] 10.222.0.77 () {60 vars in 1141 bytes} [Wed May 11 06:42:36 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:42:36.326443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb56a40-07bf-414e-b12c-7b289e7cea31 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:36.433303 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb56a40-07bf-414e-b12c-7b289e7cea31 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:36.478039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54616cfb-cf62-4616-ac92-c4fa1cb55fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:36.478869 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54616cfb-cf62-4616-ac92-c4fa1cb55fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:36.479182 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54616cfb-cf62-4616-ac92-c4fa1cb55fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:36.479458 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54616cfb-cf62-4616-ac92-c4fa1cb55fc1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:36.480122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54616cfb-cf62-4616-ac92-c4fa1cb55fc1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:36.481527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54616cfb-cf62-4616-ac92-c4fa1cb55fc1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:36.494994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-54616cfb-cf62-4616-ac92-c4fa1cb55fc1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:42:36.494994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:36.494994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:36.494994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:36.494994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:36.494994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:36.494994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:36.494994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:36.494994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:42:36.494994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:36.494994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:36.494994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:36.494994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:36.494994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:36.494994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:36.494994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:36.494994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:36.496179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:36.496179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:36.496179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:36.496179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:36.496179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:36.496179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:36.496179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:36.496179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:36.496179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:36.496179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:36.496179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:36.496179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:36.496179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:36.496179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:36.496179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:36.496179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:36.497475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:36.497475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:36.497475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:36.497475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:36.497475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:36.497475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:36.497475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:36.497475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:36.497475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:36.497475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:36.497475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:36.497475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:36.497475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:42:36.497475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:36.497475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 488/960] 10.222.0.77 () {56 vars in 1126 bytes} [Wed May 11 06:42:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:36.505258 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eda6a-90a3-4d6e-abde-e1e08f7e1ec4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:36.606121 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eda6a-90a3-4d6e-abde-e1e08f7e1ec4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:36.612333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c49d84-1334-4741-8ffa-7de8b88fa685 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:36.612907 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c49d84-1334-4741-8ffa-7de8b88fa685 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:36.613385 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c49d84-1334-4741-8ffa-7de8b88fa685 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:36.615271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 489/961] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:42:36.620438 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc5c00-a395-43a0-841a-ac47c4933bdb None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:36.620993 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc5c00-a395-43a0-841a-ac47c4933bdb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:36.621470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc5c00-a395-43a0-841a-ac47c4933bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:36.640362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f815c-f618-4e3b-b55d-75d1a3043d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:36.641262 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f815c-f618-4e3b-b55d-75d1a3043d56 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:36.641704 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f815c-f618-4e3b-b55d-75d1a3043d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:36.642114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f815c-f618-4e3b-b55d-75d1a3043d56 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:36.642986 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f815c-f618-4e3b-b55d-75d1a3043d56 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:36.643434 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-63cc5c00-a395-43a0-841a-ac47c4933bdb None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:36.643592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f815c-f618-4e3b-b55d-75d1a3043d56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:36.644833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-63cc5c00-a395-43a0-841a-ac47c4933bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:36.645282 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f815c-f618-4e3b-b55d-75d1a3043d56 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:36.655144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 473/962] 10.222.0.77 () {56 vars in 1122 bytes} [Wed May 11 06:42:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:36.656808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f815c-f618-4e3b-b55d-75d1a3043d56 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:36.739057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 490/963] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:42:36.762990 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f815c-f618-4e3b-b55d-75d1a3043d56 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:36.767701 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc5c00-a395-43a0-841a-ac47c4933bdb None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:36.811706 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcc3ae-3b74-4608-95d6-660fb95a6fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:36.812931 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcc3ae-3b74-4608-95d6-660fb95a6fae None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:36.813749 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcc3ae-3b74-4608-95d6-660fb95a6fae None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:36.814512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcc3ae-3b74-4608-95d6-660fb95a6fae None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:36.815609 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcc3ae-3b74-4608-95d6-660fb95a6fae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:36.816137 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcc3ae-3b74-4608-95d6-660fb95a6fae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:36.818031 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcc3ae-3b74-4608-95d6-660fb95a6fae None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:36.825283 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 474/964] 10.222.0.77 () {56 vars in 1122 bytes} [Wed May 11 06:42:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:36.830587 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcc3ae-3b74-4608-95d6-660fb95a6fae None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:36.875053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc5c00-a395-43a0-841a-ac47c4933bdb None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:36.910417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41887734-0cea-4b2a-bf78-a02e47ebbcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:36.911150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41887734-0cea-4b2a-bf78-a02e47ebbcff None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:36.911428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41887734-0cea-4b2a-bf78-a02e47ebbcff None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:36.911703 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41887734-0cea-4b2a-bf78-a02e47ebbcff None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:36.912412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41887734-0cea-4b2a-bf78-a02e47ebbcff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:36.913844 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41887734-0cea-4b2a-bf78-a02e47ebbcff None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:36.928549 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.sql.core [None req-41887734-0cea-4b2a-bf78-a02e47ebbcff None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 06:42:36.928549 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 11 06:42:36.928549 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [parameters: {'user_id': '8f7ef94d40b345fd9b9381c5145c4be6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 11 06:42:36.928549 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80058) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 06:42:36.931835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcc3ae-3b74-4608-95d6-660fb95a6fae None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:36.935762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-41887734-0cea-4b2a-bf78-a02e47ebbcff None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 11 06:42:36.935762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:36.935762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 06:42:36.935762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 06:42:36.935762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 06:42:36.935762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 06:42:36.935762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 06:42:36.935762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application result = self._query(query) May 11 06:42:36.935762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 06:42:36.935762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application conn.query(q) May 11 06:42:36.935762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 06:42:36.935762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 06:42:36.935762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 06:42:36.935762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application result.read() May 11 06:42:36.935762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 06:42:36.936760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 06:42:36.936760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 06:42:36.936760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 06:42:36.936760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 06:42:36.936760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 06:42:36.936760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 06:42:36.936760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 06:42:36.936760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 06:42:36.936760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:36.936760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 06:42:36.936760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:36.936760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:36.936760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 06:42:36.936760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 06:42:36.936760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 11 06:42:36.936760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 11 06:42:36.936760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 06:42:36.936760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application next(self.gen) May 11 06:42:36.937752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 06:42:36.937752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application yield resource May 11 06:42:36.937752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 06:42:36.937752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application next(self.gen) May 11 06:42:36.937752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 06:42:36.937752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self.session.rollback() May 11 06:42:36.937752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 06:42:36.937752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self.force_reraise() May 11 06:42:36.937752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 06:42:36.937752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise self.value May 11 06:42:36.937752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 06:42:36.937752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 06:42:36.937752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 06:42:36.937752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application session.commit() May 11 06:42:36.937752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 06:42:36.937752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 06:42:36.937752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 06:42:36.938668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._prepare_impl() May 11 06:42:36.938668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 06:42:36.938668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self.session.flush() May 11 06:42:36.938668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 06:42:36.938668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._flush(objects) May 11 06:42:36.938668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 06:42:36.938668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 06:42:36.938668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 06:42:36.938668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application compat.raise_( May 11 06:42:36.938668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 06:42:36.938668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception May 11 06:42:36.938668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 06:42:36.938668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application flush_context.execute() May 11 06:42:36.938668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 06:42:36.938668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rec.execute(self) May 11 06:42:36.938668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 06:42:36.938668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 06:42:36.939597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 06:42:36.939597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 06:42:36.939597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 11 06:42:36.939597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application result = connection._execute_20( May 11 06:42:36.939597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 06:42:36.939597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 06:42:36.939597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 06:42:36.939597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 06:42:36.939597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 06:42:36.939597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 06:42:36.939597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 06:42:36.939597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 06:42:36.939597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 06:42:36.939597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 06:42:36.939597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 06:42:36.939597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception May 11 06:42:36.940445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 06:42:36.940445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 06:42:36.940445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 06:42:36.940445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 06:42:36.940445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 06:42:36.940445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application result = self._query(query) May 11 06:42:36.940445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 06:42:36.940445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application conn.query(q) May 11 06:42:36.940445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 06:42:36.940445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 06:42:36.940445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 06:42:36.940445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application result.read() May 11 06:42:36.940445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 06:42:36.940445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 06:42:36.940445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 06:42:36.940445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 06:42:36.941315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 06:42:36.941315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 06:42:36.941315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 06:42:36.941315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 06:42:36.941315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 06:42:36.941315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 11 06:42:36.941315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [parameters: {'user_id': '8f7ef94d40b345fd9b9381c5145c4be6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 11 06:42:36.941315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 06:42:36.941315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:36.941315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:36.941315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:36.941315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:36.941315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:36.941315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:36.941315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:36.942166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:36.942166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:36.942166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:36.942166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:36.942166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:36.942166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:36.942166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:36.942166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 11 06:42:36.942166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 11 06:42:36.942166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:36.942166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:36.942166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:42:36.942166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:36.942166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:42:36.942166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:36.942166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 11 06:42:36.942166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 11 06:42:36.943168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 11 06:42:36.943168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 11 06:42:36.943168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 06:42:36.943168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 06:42:36.943168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 11 06:42:36.943168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:36.943168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 491/965] 10.222.0.77 () {60 vars in 1131 bytes} [Wed May 11 06:42:36 2022] POST /identity/v3/users => generated 160 bytes in 170 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:36.943168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e12c1-ef8e-4763-82db-fb4746eb029b None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:36.943168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e12c1-ef8e-4763-82db-fb4746eb029b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:36.943168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e12c1-ef8e-4763-82db-fb4746eb029b None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:36.943765 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 492/966] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:36.945031 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e12c1-ef8e-4763-82db-fb4746eb029b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:36.979954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c06d7-5b62-4cef-9115-765abbe273db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:36.980905 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c06d7-5b62-4cef-9115-765abbe273db None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:36.981344 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c06d7-5b62-4cef-9115-765abbe273db None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:36.981613 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c06d7-5b62-4cef-9115-765abbe273db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:36.982370 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c06d7-5b62-4cef-9115-765abbe273db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:36.983763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c06d7-5b62-4cef-9115-765abbe273db None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:37.006442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 475/967] 10.222.0.77 () {60 vars in 1144 bytes} [Wed May 11 06:42:36 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:42:37.008070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4139fbe-4a5d-4fa4-b468-11866b8e20af None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:37.008408 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4139fbe-4a5d-4fa4-b468-11866b8e20af None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:37.008693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4139fbe-4a5d-4fa4-b468-11866b8e20af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:37.027004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f4139fbe-4a5d-4fa4-b468-11866b8e20af None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:37.028192 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f4139fbe-4a5d-4fa4-b468-11866b8e20af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:37.073976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e12c1-ef8e-4763-82db-fb4746eb029b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:37.111411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 476/968] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:37.114934 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46249ee-e946-4fb1-982f-7acee3d40a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:37.116166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46249ee-e946-4fb1-982f-7acee3d40a01 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:37.116695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46249ee-e946-4fb1-982f-7acee3d40a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:37.117183 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46249ee-e946-4fb1-982f-7acee3d40a01 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:37.126426 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46249ee-e946-4fb1-982f-7acee3d40a01 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:37.127403 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4139fbe-4a5d-4fa4-b468-11866b8e20af None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:37.128686 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46249ee-e946-4fb1-982f-7acee3d40a01 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:37.145881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-e46249ee-e946-4fb1-982f-7acee3d40a01 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 06:42:37.145881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:37.145881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:37.145881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:37.145881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:37.145881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:37.145881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:37.145881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:37.145881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:37.145881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:37.145881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:37.145881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:37.145881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:42:37.145881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:42:37.145881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:42:37.145881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:42:37.146913 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:37.146913 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:37.146913 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:42:37.146913 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:37.146913 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:42:37.146913 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:37.146913 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:37.146913 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:37.146913 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:37.146913 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:37.146913 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:37.146913 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:37.146913 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:37.146913 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:37.146913 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:37.146913 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:37.146913 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:37.146913 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:37.147903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:37.147903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:37.147903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:42:37.147903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:42:37.147903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:42:37.147903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:42:37.147903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:42:37.147903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:42:37.147903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 06:42:37.147903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:37.150747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 493/969] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:42:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:37.156594 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46249ee-e946-4fb1-982f-7acee3d40a01 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:37.251814 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4139fbe-4a5d-4fa4-b468-11866b8e20af None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:37.276730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46249ee-e946-4fb1-982f-7acee3d40a01 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:37.295930 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64f866-523c-42be-ab48-2861bfc9bcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:37.296761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64f866-523c-42be-ab48-2861bfc9bcd3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:37.297034 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64f866-523c-42be-ab48-2861bfc9bcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:37.297306 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64f866-523c-42be-ab48-2861bfc9bcd3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:37.311237 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64f866-523c-42be-ab48-2861bfc9bcd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:42:37.314664 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70faee8c-4961-4a6b-94d5-e21f8344ea36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:37.315614 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70faee8c-4961-4a6b-94d5-e21f8344ea36 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:37.316094 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70faee8c-4961-4a6b-94d5-e21f8344ea36 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:37.316565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70faee8c-4961-4a6b-94d5-e21f8344ea36 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:37.317684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70faee8c-4961-4a6b-94d5-e21f8344ea36 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:37.318220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70faee8c-4961-4a6b-94d5-e21f8344ea36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:37.319886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-fe64f866-523c-42be-ab48-2861bfc9bcd3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:42:37.319886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:37.319886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:37.319886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:37.319886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:37.319886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:37.319886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:37.319886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:37.319886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:37.319886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:37.319886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:37.319886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:37.319886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:42:37.319886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:42:37.319886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:42:37.319886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:42:37.321207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:42:37.321207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:42:37.321207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:42:37.321207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:42:37.321207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:37.321207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:37.321207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:37.321207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:37.321207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:37.321207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:37.321207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:37.321207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:37.321207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:37.321207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:37.321207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:37.321207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:37.322274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:37.322274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:37.322274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:37.322274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:37.322274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:42:37.322274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:42:37.322274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:42:37.322274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:42:37.322274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:42:37.322274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:42:37.322274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:42:37.322274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:37.322274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 477/970] 10.222.0.77 () {56 vars in 1120 bytes} [Wed May 11 06:42:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:37.323069 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70faee8c-4961-4a6b-94d5-e21f8344ea36 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:37.329399 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64f866-523c-42be-ab48-2861bfc9bcd3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:37.367969 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 494/971] 10.222.0.77 () {56 vars in 1101 bytes} [Wed May 11 06:42:37 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:37.434756 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64f866-523c-42be-ab48-2861bfc9bcd3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:37.471619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9711a-e626-4044-aa19-f4ed28fc4427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:37.472302 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9711a-e626-4044-aa19-f4ed28fc4427 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:37.472576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9711a-e626-4044-aa19-f4ed28fc4427 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:37.472843 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9711a-e626-4044-aa19-f4ed28fc4427 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:37.473675 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9711a-e626-4044-aa19-f4ed28fc4427 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:37.473978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9711a-e626-4044-aa19-f4ed28fc4427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:37.475408 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9711a-e626-4044-aa19-f4ed28fc4427 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:37.484919 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 478/972] 10.222.0.77 () {56 vars in 1115 bytes} [Wed May 11 06:42:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:37.492405 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70faee8c-4961-4a6b-94d5-e21f8344ea36 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:37.599802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70faee8c-4961-4a6b-94d5-e21f8344ea36 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:37.632953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb6364-243f-48a5-8ac8-021964e9e64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:37.633769 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb6364-243f-48a5-8ac8-021964e9e64a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:37.634043 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb6364-243f-48a5-8ac8-021964e9e64a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:37.634314 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb6364-243f-48a5-8ac8-021964e9e64a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:37.645073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb6364-243f-48a5-8ac8-021964e9e64a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:37.646531 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb6364-243f-48a5-8ac8-021964e9e64a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:37.663976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-96cb6364-243f-48a5-8ac8-021964e9e64a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:37.663976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:37.663976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:37.663976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:37.663976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:37.663976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:37.663976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:37.663976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:37.663976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:37.663976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:37.663976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:37.663976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:37.663976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:37.663976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:37.663976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:37.665090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:37.665090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:37.665090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:37.665090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:37.665090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:37.665090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:37.665090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:37.665090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:37.665090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:37.665090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:37.665090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:37.665090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:37.665090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:37.665090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:37.665090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:37.665090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:37.665090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:37.666007 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:37.666007 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:37.666007 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:37.666007 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:37.666007 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 495/973] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:37.672397 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9711a-e626-4044-aa19-f4ed28fc4427 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:37.775845 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9711a-e626-4044-aa19-f4ed28fc4427 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:37.808112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b5841-e979-4ada-9260-94e79e925946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:37.808772 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b5841-e979-4ada-9260-94e79e925946 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:37.809049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b5841-e979-4ada-9260-94e79e925946 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:37.809316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b5841-e979-4ada-9260-94e79e925946 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:37.810020 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b5841-e979-4ada-9260-94e79e925946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:37.810320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b5841-e979-4ada-9260-94e79e925946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:37.811712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b5841-e979-4ada-9260-94e79e925946 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:37.823783 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 479/974] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:37.829335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb6364-243f-48a5-8ac8-021964e9e64a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:37.927289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb6364-243f-48a5-8ac8-021964e9e64a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:37.960722 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd56e8-3dd3-4b09-8cec-3a430b8219c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:37.961537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd56e8-3dd3-4b09-8cec-3a430b8219c9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:37.961811 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd56e8-3dd3-4b09-8cec-3a430b8219c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:37.962077 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd56e8-3dd3-4b09-8cec-3a430b8219c9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:37.968935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd56e8-3dd3-4b09-8cec-3a430b8219c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:37.970433 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd56e8-3dd3-4b09-8cec-3a430b8219c9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:37.984853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-76dd56e8-3dd3-4b09-8cec-3a430b8219c9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:42:37.984853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:37.984853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:37.984853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:37.984853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:37.984853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:37.984853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:37.984853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:37.984853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:37.984853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:37.984853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:37.984853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:37.984853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:42:37.984853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:42:37.984853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:42:37.984853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:42:37.986008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:37.986008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:37.986008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:42:37.986008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:37.986008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:42:37.986008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:37.986008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:37.986008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:37.986008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:37.986008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:37.986008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:37.986008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:37.986008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:37.986008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:37.986008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:37.986008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:37.986008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:37.986008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:37.986994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:37.986994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:37.986994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:42:37.986994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:42:37.986994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:42:37.986994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:42:37.986994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:42:37.986994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:42:37.986994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:42:37.986994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:37.990724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 496/975] 10.222.0.77 () {56 vars in 1117 bytes} [Wed May 11 06:42:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:37.992594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b5841-e979-4ada-9260-94e79e925946 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:38.090377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b5841-e979-4ada-9260-94e79e925946 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:38.123670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822f14a-19e5-4ef0-af44-deb5f3f8138c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:38.124428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822f14a-19e5-4ef0-af44-deb5f3f8138c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:38.124769 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822f14a-19e5-4ef0-af44-deb5f3f8138c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:38.125101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822f14a-19e5-4ef0-af44-deb5f3f8138c None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:38.125998 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822f14a-19e5-4ef0-af44-deb5f3f8138c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:38.126369 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822f14a-19e5-4ef0-af44-deb5f3f8138c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:38.127893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822f14a-19e5-4ef0-af44-deb5f3f8138c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:38.145021 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 480/976] 10.222.0.77 () {56 vars in 1149 bytes} [Wed May 11 06:42:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:38.150507 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd56e8-3dd3-4b09-8cec-3a430b8219c9 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:38.251154 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd56e8-3dd3-4b09-8cec-3a430b8219c9 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:38.292586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579e983-54a4-4348-9ba6-179b7cd89526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:38.292586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579e983-54a4-4348-9ba6-179b7cd89526 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:38.292586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579e983-54a4-4348-9ba6-179b7cd89526 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:38.292586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579e983-54a4-4348-9ba6-179b7cd89526 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:38.360568 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579e983-54a4-4348-9ba6-179b7cd89526 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:38.361925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579e983-54a4-4348-9ba6-179b7cd89526 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:38.458267 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 497/977] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:42:38 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:42:38.464133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822f14a-19e5-4ef0-af44-deb5f3f8138c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:38.564516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822f14a-19e5-4ef0-af44-deb5f3f8138c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:38.598727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de5a9d-8a90-416e-92d4-e2a95360f0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:38.599550 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de5a9d-8a90-416e-92d4-e2a95360f0fb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:38.599822 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de5a9d-8a90-416e-92d4-e2a95360f0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:38.600085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de5a9d-8a90-416e-92d4-e2a95360f0fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:38.609791 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de5a9d-8a90-416e-92d4-e2a95360f0fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:38.611316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de5a9d-8a90-416e-92d4-e2a95360f0fb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:38.628148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-80de5a9d-8a90-416e-92d4-e2a95360f0fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:38.628148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:38.628148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:38.628148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:38.628148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:38.628148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:38.628148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:38.628148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:38.628148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:38.628148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:38.628148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:38.628148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:38.628148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:38.628148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:38.628148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:38.629059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:38.629059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:38.629059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:38.629059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:38.629059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:38.629059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:38.629059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:38.629059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:38.629059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:38.629059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:38.629059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:38.629059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:38.629059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:38.629059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:38.629059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:38.629059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:38.629059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:38.630025 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:38.630025 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:38.630025 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:38.630025 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:38.631097 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 481/978] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:38.635114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579e983-54a4-4348-9ba6-179b7cd89526 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:38.651622 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb79108-64c1-45b7-ba6f-f919e080dae8 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:38.651900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb79108-64c1-45b7-ba6f-f919e080dae8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:38.652179 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb79108-64c1-45b7-ba6f-f919e080dae8 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:38.653584 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 482/979] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:38.658509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f6bb1-c976-4911-813d-d6d858c6e7c4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:38.658797 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f6bb1-c976-4911-813d-d6d858c6e7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:38.659104 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f6bb1-c976-4911-813d-d6d858c6e7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:38.676299 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-170f6bb1-c976-4911-813d-d6d858c6e7c4 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:38.677493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-170f6bb1-c976-4911-813d-d6d858c6e7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:38.732437 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579e983-54a4-4348-9ba6-179b7cd89526 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:38.743005 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 483/980] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:42:38.765629 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f6bb1-c976-4911-813d-d6d858c6e7c4 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:38.768834 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04c3f3-4f96-4902-b1c3-7c717522c854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:38.769509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04c3f3-4f96-4902-b1c3-7c717522c854 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:38.769825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04c3f3-4f96-4902-b1c3-7c717522c854 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:38.770090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04c3f3-4f96-4902-b1c3-7c717522c854 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:38.770815 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04c3f3-4f96-4902-b1c3-7c717522c854 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:38.771149 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04c3f3-4f96-4902-b1c3-7c717522c854 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:38.772520 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04c3f3-4f96-4902-b1c3-7c717522c854 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:38.783729 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 498/981] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:38.789249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04c3f3-4f96-4902-b1c3-7c717522c854 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:38.863585 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f6bb1-c976-4911-813d-d6d858c6e7c4 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:38.883704 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04c3f3-4f96-4902-b1c3-7c717522c854 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:38.896516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e7468-a1e5-46e7-8d86-6e7de8dcec24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:38.897299 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e7468-a1e5-46e7-8d86-6e7de8dcec24 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:38.897610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e7468-a1e5-46e7-8d86-6e7de8dcec24 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:38.897870 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e7468-a1e5-46e7-8d86-6e7de8dcec24 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:38.898528 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e7468-a1e5-46e7-8d86-6e7de8dcec24 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:38.899943 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e7468-a1e5-46e7-8d86-6e7de8dcec24 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:38.912925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-386e7468-a1e5-46e7-8d86-6e7de8dcec24 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 06:42:38.912925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:38.912925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:38.912925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:38.912925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:38.912925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:38.912925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:38.912925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:38.912925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 06:42:38.912925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:38.912925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:38.912925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:38.912925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:38.912925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:38.912925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:38.912925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:38.912925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:38.914032 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:38.914032 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:38.914032 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:38.914032 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:38.914032 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:38.914032 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:38.914032 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:38.914032 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:38.914032 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:38.914032 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:38.914032 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:38.914032 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:38.914032 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:38.914032 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:38.914032 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:38.914032 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:38.914903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:38.914903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:38.914903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:38.914903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:38.914903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:38.914903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:38.914903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:38.914903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:38.914903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:38.914903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:38.914903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:38.914903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:38.914903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 06:42:38.914903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:38.919357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 484/982] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:38.920198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e7468-a1e5-46e7-8d86-6e7de8dcec24 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:38.920523 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b05c1-9c70-49eb-bb14-3af74893ff82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:38.921338 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b05c1-9c70-49eb-bb14-3af74893ff82 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:38.921620 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b05c1-9c70-49eb-bb14-3af74893ff82 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:38.921901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b05c1-9c70-49eb-bb14-3af74893ff82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:38.928780 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b05c1-9c70-49eb-bb14-3af74893ff82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:38.930234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b05c1-9c70-49eb-bb14-3af74893ff82 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:38.945634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-699b05c1-9c70-49eb-bb14-3af74893ff82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:38.945634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:38.945634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:38.945634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:38.945634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:38.945634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:38.945634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:38.945634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:38.945634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:38.945634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:38.945634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:38.945634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:38.945634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:42:38.945634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:42:38.945634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:42:38.946618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:42:38.946618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:38.946618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:38.946618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:38.946618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:38.946618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:38.946618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:38.946618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:38.946618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:38.946618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:38.946618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:38.946618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:38.946618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:38.946618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:38.946618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:38.946618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:38.946618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:38.947569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:42:38.947569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:42:38.947569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:42:38.947569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:42:38.947569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:42:38.947569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:42:38.947569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:38.947569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:38.947569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 499/983] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:38.952540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b05c1-9c70-49eb-bb14-3af74893ff82 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:39.027083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e7468-a1e5-46e7-8d86-6e7de8dcec24 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:39.049625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b05c1-9c70-49eb-bb14-3af74893ff82 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:39.058063 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586d10f-9ccf-4dad-9aac-f4c45fa55daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:39.058729 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586d10f-9ccf-4dad-9aac-f4c45fa55daf None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:39.059031 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586d10f-9ccf-4dad-9aac-f4c45fa55daf None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:39.059304 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586d10f-9ccf-4dad-9aac-f4c45fa55daf None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:39.060010 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586d10f-9ccf-4dad-9aac-f4c45fa55daf None admin] RBAC: Adding query filter params (name=compute) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:39.060308 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586d10f-9ccf-4dad-9aac-f4c45fa55daf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:39.061670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586d10f-9ccf-4dad-9aac-f4c45fa55daf None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:39.066612 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 485/984] 10.222.0.77 () {56 vars in 1112 bytes} [Wed May 11 06:42:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:39.072714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586d10f-9ccf-4dad-9aac-f4c45fa55daf None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:39.083625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9ae99-6989-42ef-a491-71e923be5735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:39.084302 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9ae99-6989-42ef-a491-71e923be5735 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:39.084553 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9ae99-6989-42ef-a491-71e923be5735 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:39.084843 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9ae99-6989-42ef-a491-71e923be5735 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:39.085648 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9ae99-6989-42ef-a491-71e923be5735 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:39.085936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9ae99-6989-42ef-a491-71e923be5735 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:39.087444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9ae99-6989-42ef-a491-71e923be5735 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:39.100484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 500/985] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:42:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:39.106910 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9ae99-6989-42ef-a491-71e923be5735 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:39.174128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586d10f-9ccf-4dad-9aac-f4c45fa55daf None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:39.202368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9ae99-6989-42ef-a491-71e923be5735 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:39.206984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c4559-5964-4e30-bd51-90a51ad631fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:39.207713 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c4559-5964-4e30-bd51-90a51ad631fa None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:39.207994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c4559-5964-4e30-bd51-90a51ad631fa None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:39.208263 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c4559-5964-4e30-bd51-90a51ad631fa None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:39.208973 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c4559-5964-4e30-bd51-90a51ad631fa None admin] RBAC: Adding query filter params (type=compute) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:39.209284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c4559-5964-4e30-bd51-90a51ad631fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:39.210654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c4559-5964-4e30-bd51-90a51ad631fa None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:39.215322 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 486/986] 10.222.0.77 () {56 vars in 1112 bytes} [Wed May 11 06:42:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:39.221110 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c4559-5964-4e30-bd51-90a51ad631fa None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:39.235634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b28edc-fd09-4423-b04e-de3b8c705c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:39.236302 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b28edc-fd09-4423-b04e-de3b8c705c9a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:39.236592 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b28edc-fd09-4423-b04e-de3b8c705c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:39.236870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b28edc-fd09-4423-b04e-de3b8c705c9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:39.237709 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b28edc-fd09-4423-b04e-de3b8c705c9a None admin] RBAC: Adding query filter params (role.id=4e9d3c690fdb4f48878128cd834eb431, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=99cbf80fc74c4183a6eed3e97f7196f9) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:39.238027 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b28edc-fd09-4423-b04e-de3b8c705c9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:39.239571 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b28edc-fd09-4423-b04e-de3b8c705c9a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:39.245695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 501/987] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:42:39 2022] GET /identity/v3/role_assignments?user.id=99cbf80fc74c4183a6eed3e97f7196f9&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=4e9d3c690fdb4f48878128cd834eb431 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:39.280204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaeaa8-0c1b-461e-9f94-78145d85c29f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:39.280465 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaeaa8-0c1b-461e-9f94-78145d85c29f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:39.280743 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaeaa8-0c1b-461e-9f94-78145d85c29f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:39.282466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 502/988] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:42:39.288494 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1329bca-1afb-4b81-8108-d9a25370601b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:39.288691 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1329bca-1afb-4b81-8108-d9a25370601b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:39.288968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1329bca-1afb-4b81-8108-d9a25370601b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:39.306795 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a1329bca-1afb-4b81-8108-d9a25370601b None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:39.308557 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a1329bca-1afb-4b81-8108-d9a25370601b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:39.336747 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c4559-5964-4e30-bd51-90a51ad631fa None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:39.374258 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04763a85-3ab3-4189-911e-347203896c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:39.374948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04763a85-3ab3-4189-911e-347203896c59 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:39.375300 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04763a85-3ab3-4189-911e-347203896c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:39.375556 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04763a85-3ab3-4189-911e-347203896c59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:39.376364 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04763a85-3ab3-4189-911e-347203896c59 None admin] RBAC: Adding query filter params (interface=public, service_id=706b50a7d8c74d1eb2db47c854b436f2, region_id=RegionOne) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:39.376677 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04763a85-3ab3-4189-911e-347203896c59 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:39.378076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04763a85-3ab3-4189-911e-347203896c59 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:39.388030 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 487/989] 10.222.0.77 () {56 vars in 1251 bytes} [Wed May 11 06:42:39 2022] GET /identity/v3/endpoints?service_id=706b50a7d8c74d1eb2db47c854b436f2&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:39.388226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 503/990] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:42:39.389259 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04763a85-3ab3-4189-911e-347203896c59 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:39.407128 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1329bca-1afb-4b81-8108-d9a25370601b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:39.500069 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04763a85-3ab3-4189-911e-347203896c59 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:39.512805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1329bca-1afb-4b81-8108-d9a25370601b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:39.532854 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1735d2c-7df0-436d-b109-776f31cee878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:39.533532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1735d2c-7df0-436d-b109-776f31cee878 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:39.533816 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1735d2c-7df0-436d-b109-776f31cee878 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:39.534089 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1735d2c-7df0-436d-b109-776f31cee878 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:39.534802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1735d2c-7df0-436d-b109-776f31cee878 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:39.536226 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1735d2c-7df0-436d-b109-776f31cee878 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:39.542606 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 488/991] 10.222.0.77 () {56 vars in 1087 bytes} [Wed May 11 06:42:39 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:42:39.546080 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d1293-5517-4269-94cc-93d01c5c6c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:39.546912 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d1293-5517-4269-94cc-93d01c5c6c73 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:39.547209 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d1293-5517-4269-94cc-93d01c5c6c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:39.547480 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d1293-5517-4269-94cc-93d01c5c6c73 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:39.548146 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d1293-5517-4269-94cc-93d01c5c6c73 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:39.549556 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d1293-5517-4269-94cc-93d01c5c6c73 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:39.562500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-187d1293-5517-4269-94cc-93d01c5c6c73 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:42:39.562500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:39.562500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:39.562500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:39.562500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:39.562500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:39.562500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:39.562500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:39.562500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:42:39.562500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:39.562500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:39.562500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:39.562500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:39.562500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:39.562500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:39.562500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:39.562500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:39.563708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:39.563708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:39.563708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:39.563708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:39.563708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:39.563708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:39.563708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:39.563708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:39.563708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:39.563708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:39.563708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:39.563708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:39.563708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:39.563708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:39.563708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:39.563708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:39.564652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:39.564652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:39.564652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:39.564652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:39.564652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:39.564652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:39.564652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:39.564652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:39.564652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:39.564652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:39.564652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:39.564652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:39.564652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:42:39.564652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:39.564652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 504/992] 10.222.0.77 () {56 vars in 1126 bytes} [Wed May 11 06:42:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:39.570730 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1735d2c-7df0-436d-b109-776f31cee878 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:39.677265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1735d2c-7df0-436d-b109-776f31cee878 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:39.717735 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c628bc7-8378-4429-910d-3a0af4e2b219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:39.718414 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c628bc7-8378-4429-910d-3a0af4e2b219 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:39.718659 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c628bc7-8378-4429-910d-3a0af4e2b219 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:39.718952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c628bc7-8378-4429-910d-3a0af4e2b219 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:39.719704 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c628bc7-8378-4429-910d-3a0af4e2b219 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:39.720004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c628bc7-8378-4429-910d-3a0af4e2b219 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:39.721366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c628bc7-8378-4429-910d-3a0af4e2b219 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:39.726924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 489/993] 10.222.0.77 () {56 vars in 1122 bytes} [Wed May 11 06:42:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:39.732726 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d1293-5517-4269-94cc-93d01c5c6c73 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:39.839884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d1293-5517-4269-94cc-93d01c5c6c73 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:39.873505 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf0387-95a5-41d8-bdd2-ec11941dec72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:39.874174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf0387-95a5-41d8-bdd2-ec11941dec72 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:39.874427 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf0387-95a5-41d8-bdd2-ec11941dec72 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:39.874730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf0387-95a5-41d8-bdd2-ec11941dec72 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:39.875472 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf0387-95a5-41d8-bdd2-ec11941dec72 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:39.875779 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf0387-95a5-41d8-bdd2-ec11941dec72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:39.877155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf0387-95a5-41d8-bdd2-ec11941dec72 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:39.882416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 505/994] 10.222.0.77 () {56 vars in 1122 bytes} [Wed May 11 06:42:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:39.888167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c628bc7-8378-4429-910d-3a0af4e2b219 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:39.984618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c628bc7-8378-4429-910d-3a0af4e2b219 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:40.017418 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ae1c3-ec94-42ea-b4b0-d22eb7f0635c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:40.018087 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ae1c3-ec94-42ea-b4b0-d22eb7f0635c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:40.018329 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ae1c3-ec94-42ea-b4b0-d22eb7f0635c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:40.018637 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ae1c3-ec94-42ea-b4b0-d22eb7f0635c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:40.019473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ae1c3-ec94-42ea-b4b0-d22eb7f0635c None admin] RBAC: Adding query filter params (interface=admin, service_id=8d3a641d76b448e9a3c6caac738e8fb0, region_id=RegionOne) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:40.019843 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ae1c3-ec94-42ea-b4b0-d22eb7f0635c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:40.021224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ae1c3-ec94-42ea-b4b0-d22eb7f0635c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:40.026558 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 490/995] 10.222.0.77 () {56 vars in 1249 bytes} [Wed May 11 06:42:39 2022] GET /identity/v3/endpoints?service_id=8d3a641d76b448e9a3c6caac738e8fb0&interface=admin®ion_id=RegionOne => generated 193 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:40.032037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf0387-95a5-41d8-bdd2-ec11941dec72 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:40.131699 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf0387-95a5-41d8-bdd2-ec11941dec72 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:40.165262 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56079455-d580-41bc-8419-9b257a6c9ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:40.165937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56079455-d580-41bc-8419-9b257a6c9ffd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:40.166220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56079455-d580-41bc-8419-9b257a6c9ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:40.166498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56079455-d580-41bc-8419-9b257a6c9ffd None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:40.167220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56079455-d580-41bc-8419-9b257a6c9ffd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:40.168606 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56079455-d580-41bc-8419-9b257a6c9ffd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:40.174843 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 506/996] 10.222.0.77 () {56 vars in 1087 bytes} [Wed May 11 06:42:40 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:42:41.484530 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357476f-9e48-4ace-8abd-96ba4ea5fa0e None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:41.485072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357476f-9e48-4ace-8abd-96ba4ea5fa0e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:41.485072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357476f-9e48-4ace-8abd-96ba4ea5fa0e None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:41.486565 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 491/997] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:41.491873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770abe4-2ae6-48da-8760-97df888a582f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:41.492361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770abe4-2ae6-48da-8760-97df888a582f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:41.492471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770abe4-2ae6-48da-8760-97df888a582f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:41.509171 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e770abe4-2ae6-48da-8760-97df888a582f None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:41.510337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e770abe4-2ae6-48da-8760-97df888a582f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:41.576689 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 507/998] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:41 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:42:41.598626 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357476f-9e48-4ace-8abd-96ba4ea5fa0e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:41.699853 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357476f-9e48-4ace-8abd-96ba4ea5fa0e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:41.736515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3c458-a211-4e69-95f4-752fde79c35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:41.737310 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3c458-a211-4e69-95f4-752fde79c35e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:41.737550 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3c458-a211-4e69-95f4-752fde79c35e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:41.737857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3c458-a211-4e69-95f4-752fde79c35e None admin] PATH_INFO: `/v3/services/image` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:41.738532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3c458-a211-4e69-95f4-752fde79c35e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:41.739918 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3c458-a211-4e69-95f4-752fde79c35e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:41.751531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-5fc3c458-a211-4e69-95f4-752fde79c35e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 06:42:41.751531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:41.751531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:41.751531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:41.751531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:41.751531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:41.751531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:41.751531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:41.751531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 06:42:41.751531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:41.751531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:41.751531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:41.751531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:41.751531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:41.751531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:41.751531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:41.751531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:41.752592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:41.752592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:41.752592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:41.752592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:41.752592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:41.752592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:41.752592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:41.752592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:41.752592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:41.752592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:41.752592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:41.752592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:41.752592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:41.752592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:41.752592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:41.752592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:41.753504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:41.753504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:41.753504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:41.753504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:41.753504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:41.753504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:41.753504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:41.753504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:41.753504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:41.753504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:41.753504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:41.753504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:41.753504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 06:42:41.753504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:41.755343 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 492/999] 10.222.0.77 () {56 vars in 1105 bytes} [Wed May 11 06:42:41 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:41.758847 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770abe4-2ae6-48da-8760-97df888a582f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:41.773996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7a713-b533-4f23-afd1-8e6a74d6c03d None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:41.774458 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7a713-b533-4f23-afd1-8e6a74d6c03d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:41.774585 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7a713-b533-4f23-afd1-8e6a74d6c03d None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:41.776104 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 493/1000] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:42:41.783799 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a9c8b-5a04-4631-be02-81bbb07e85e1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:41.784306 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a9c8b-5a04-4631-be02-81bbb07e85e1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:41.784793 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a9c8b-5a04-4631-be02-81bbb07e85e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:41.803556 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d02a9c8b-5a04-4631-be02-81bbb07e85e1 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:41.804728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d02a9c8b-5a04-4631-be02-81bbb07e85e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:41.862744 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770abe4-2ae6-48da-8760-97df888a582f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:41.871834 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 494/1001] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:41 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:42:41.894283 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a9c8b-5a04-4631-be02-81bbb07e85e1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:41.897882 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf43097-ffe7-46e9-bc78-a09735089480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:41.898578 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf43097-ffe7-46e9-bc78-a09735089480 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:41.898856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf43097-ffe7-46e9-bc78-a09735089480 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:41.899160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf43097-ffe7-46e9-bc78-a09735089480 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:41.899873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf43097-ffe7-46e9-bc78-a09735089480 None admin] RBAC: Adding query filter params (name=image) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:41.900176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf43097-ffe7-46e9-bc78-a09735089480 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:41.901549 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf43097-ffe7-46e9-bc78-a09735089480 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:41.906929 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 508/1002] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:41.912472 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf43097-ffe7-46e9-bc78-a09735089480 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:41.991414 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a9c8b-5a04-4631-be02-81bbb07e85e1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:42.012614 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf43097-ffe7-46e9-bc78-a09735089480 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:42.024851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f43be-30b8-49e4-a22a-b1c90791eed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:42.025662 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f43be-30b8-49e4-a22a-b1c90791eed4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:42.025941 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f43be-30b8-49e4-a22a-b1c90791eed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:42.026213 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f43be-30b8-49e4-a22a-b1c90791eed4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:42.026876 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f43be-30b8-49e4-a22a-b1c90791eed4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:42.028287 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f43be-30b8-49e4-a22a-b1c90791eed4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:42.039699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-cd4f43be-30b8-49e4-a22a-b1c90791eed4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 06:42:42.039699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:42.039699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:42.039699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:42.039699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:42.039699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:42.039699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:42.039699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:42.039699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 06:42:42.039699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:42.039699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:42.039699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:42.039699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:42.039699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:42.039699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:42.039699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:42.039699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:42.040678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:42.040678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:42.040678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:42.040678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:42.040678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:42.040678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:42.040678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:42.040678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:42.040678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:42.040678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:42.040678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:42.040678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:42.040678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:42.040678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:42.040678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:42.040678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:42.041571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:42.041571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:42.041571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:42.041571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:42.041571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:42.041571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:42.041571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:42.041571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:42.041571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:42.041571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:42.041571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:42.041571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:42.041571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 06:42:42.041571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:42.041571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 495/1003] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:42.046792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f43be-30b8-49e4-a22a-b1c90791eed4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:42.051221 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d640a-87e8-4390-9c1f-4043e300503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:42.051896 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d640a-87e8-4390-9c1f-4043e300503d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:42.052178 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d640a-87e8-4390-9c1f-4043e300503d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:42.052452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d640a-87e8-4390-9c1f-4043e300503d None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:42.053160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d640a-87e8-4390-9c1f-4043e300503d None admin] RBAC: Adding query filter params (type=image) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:42.053467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d640a-87e8-4390-9c1f-4043e300503d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:42.054841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d640a-87e8-4390-9c1f-4043e300503d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:42.071231 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 509/1004] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:41 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:42.149898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f43be-30b8-49e4-a22a-b1c90791eed4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:42.188019 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38f9ee-e20a-4b0e-b27c-433d5df6bd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:42.188720 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38f9ee-e20a-4b0e-b27c-433d5df6bd1b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:42.189003 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38f9ee-e20a-4b0e-b27c-433d5df6bd1b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:42.189283 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38f9ee-e20a-4b0e-b27c-433d5df6bd1b None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:42.190022 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38f9ee-e20a-4b0e-b27c-433d5df6bd1b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:42.190327 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38f9ee-e20a-4b0e-b27c-433d5df6bd1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:42.191864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38f9ee-e20a-4b0e-b27c-433d5df6bd1b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:42.202849 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 496/1005] 10.222.0.77 () {56 vars in 1112 bytes} [Wed May 11 06:42:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:42.204940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d640a-87e8-4390-9c1f-4043e300503d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:42.307401 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d640a-87e8-4390-9c1f-4043e300503d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:42.339570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32787d6b-b098-4acc-a984-d3762f908e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:42.340247 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32787d6b-b098-4acc-a984-d3762f908e8a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:42.340527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32787d6b-b098-4acc-a984-d3762f908e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:42.340803 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32787d6b-b098-4acc-a984-d3762f908e8a None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:42.341545 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32787d6b-b098-4acc-a984-d3762f908e8a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:42.341849 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32787d6b-b098-4acc-a984-d3762f908e8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:42.343255 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32787d6b-b098-4acc-a984-d3762f908e8a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:42.349152 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 510/1006] 10.222.0.77 () {56 vars in 1112 bytes} [Wed May 11 06:42:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:42.354620 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38f9ee-e20a-4b0e-b27c-433d5df6bd1b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:42.370907 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c044402-0f31-41b2-aec8-fb8f540fa43f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:42.371251 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c044402-0f31-41b2-aec8-fb8f540fa43f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:42.371895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c044402-0f31-41b2-aec8-fb8f540fa43f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:42.373743 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 511/1007] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:42:42.378535 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c9c80-47ae-40e9-8d9c-bfd5d942bc44 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:42.378821 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c9c80-47ae-40e9-8d9c-bfd5d942bc44 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:42.379195 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c9c80-47ae-40e9-8d9c-bfd5d942bc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:42.396120 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6d4c9c80-47ae-40e9-8d9c-bfd5d942bc44 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:42.397277 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6d4c9c80-47ae-40e9-8d9c-bfd5d942bc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:42.454359 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38f9ee-e20a-4b0e-b27c-433d5df6bd1b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:42.464269 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 512/1008] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:42:42.485912 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10d643-305c-4d3e-89f1-0485850a9cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:42.486443 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10d643-305c-4d3e-89f1-0485850a9cf4 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:42.486635 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10d643-305c-4d3e-89f1-0485850a9cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:42.486848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c9c80-47ae-40e9-8d9c-bfd5d942bc44 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:42.486949 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10d643-305c-4d3e-89f1-0485850a9cf4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:42.487683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10d643-305c-4d3e-89f1-0485850a9cf4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:42.489330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10d643-305c-4d3e-89f1-0485850a9cf4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:42.519186 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 497/1009] 10.222.0.77 () {60 vars in 1144 bytes} [Wed May 11 06:42:42 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:42:42.593133 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c9c80-47ae-40e9-8d9c-bfd5d942bc44 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:42.635675 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe997fc-117a-4867-856a-4213a42e9263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:42.636507 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe997fc-117a-4867-856a-4213a42e9263 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:42.636785 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe997fc-117a-4867-856a-4213a42e9263 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:42.637059 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe997fc-117a-4867-856a-4213a42e9263 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:42.637716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe997fc-117a-4867-856a-4213a42e9263 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:42.639145 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe997fc-117a-4867-856a-4213a42e9263 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:42.652163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-9fe997fc-117a-4867-856a-4213a42e9263 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:42:42.652163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:42.652163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:42.652163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:42.652163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:42.652163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:42.652163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:42.652163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:42.652163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:42:42.652163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:42.652163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:42.652163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:42.652163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:42.652163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:42.652163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:42.652163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:42.652163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:42.653271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:42.653271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:42.653271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:42.653271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:42.653271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:42.653271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:42.653271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:42.653271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:42.653271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:42.653271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:42.653271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:42.653271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:42.653271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:42.653271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:42.653271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:42.653271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:42.654161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:42.654161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:42.654161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:42.654161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:42.654161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:42.654161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:42.654161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:42.654161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:42.654161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:42.654161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:42.654161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:42.654161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:42.654161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:42:42.654161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:42.658842 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 513/1010] 10.222.0.77 () {56 vars in 1126 bytes} [Wed May 11 06:42:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:42.660335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10d643-305c-4d3e-89f1-0485850a9cf4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:42.762944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10d643-305c-4d3e-89f1-0485850a9cf4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:42.795076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc599829-6b66-4594-926b-5eae61005b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:42.795757 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc599829-6b66-4594-926b-5eae61005b0d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:42.796041 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc599829-6b66-4594-926b-5eae61005b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:42.796320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc599829-6b66-4594-926b-5eae61005b0d None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:42.797032 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc599829-6b66-4594-926b-5eae61005b0d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:42.797343 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc599829-6b66-4594-926b-5eae61005b0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:42.798765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc599829-6b66-4594-926b-5eae61005b0d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:42.804271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 498/1011] 10.222.0.77 () {56 vars in 1122 bytes} [Wed May 11 06:42:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:42.810586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe997fc-117a-4867-856a-4213a42e9263 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:42.905901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe997fc-117a-4867-856a-4213a42e9263 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:42.939664 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083797d-473d-4ee7-abfb-1c21a6cb270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:42.940333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083797d-473d-4ee7-abfb-1c21a6cb270d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:42.940612 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083797d-473d-4ee7-abfb-1c21a6cb270d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:42.940881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083797d-473d-4ee7-abfb-1c21a6cb270d None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:42.941656 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083797d-473d-4ee7-abfb-1c21a6cb270d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:42.941965 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083797d-473d-4ee7-abfb-1c21a6cb270d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:42.943428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083797d-473d-4ee7-abfb-1c21a6cb270d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:42.948745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 514/1012] 10.222.0.77 () {56 vars in 1122 bytes} [Wed May 11 06:42:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:42.954636 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc599829-6b66-4594-926b-5eae61005b0d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:43.055724 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc599829-6b66-4594-926b-5eae61005b0d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:43.094466 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cab39f-c044-4270-9c7e-5b909011c412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:43.095168 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cab39f-c044-4270-9c7e-5b909011c412 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:43.095452 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cab39f-c044-4270-9c7e-5b909011c412 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:43.095728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cab39f-c044-4270-9c7e-5b909011c412 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:43.096481 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cab39f-c044-4270-9c7e-5b909011c412 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:43.097924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cab39f-c044-4270-9c7e-5b909011c412 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:43.113628 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 499/1013] 10.222.0.77 () {60 vars in 1144 bytes} [Wed May 11 06:42:42 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:42:44.290232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc2635-b225-4a10-bbb0-4c8692b3a747 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:44.291296 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc2635-b225-4a10-bbb0-4c8692b3a747 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:44.291773 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc2635-b225-4a10-bbb0-4c8692b3a747 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:44.293634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 515/1014] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:44.299918 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8b194-b434-486d-b7fa-e7adc8f39e23 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:44.300362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8b194-b434-486d-b7fa-e7adc8f39e23 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:44.300467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8b194-b434-486d-b7fa-e7adc8f39e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:44.318384 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-62f8b194-b434-486d-b7fa-e7adc8f39e23 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:44.319606 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-62f8b194-b434-486d-b7fa-e7adc8f39e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:44.392407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 500/1015] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:44 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:44.414709 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc2635-b225-4a10-bbb0-4c8692b3a747 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:44.514103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc2635-b225-4a10-bbb0-4c8692b3a747 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:44.545523 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffd247-2dce-4810-862c-ca3161c4d5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:44.546117 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffd247-2dce-4810-862c-ca3161c4d5c0 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:44.546389 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffd247-2dce-4810-862c-ca3161c4d5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:44.546658 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffd247-2dce-4810-862c-ca3161c4d5c0 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:44.547419 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffd247-2dce-4810-862c-ca3161c4d5c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:44.548781 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffd247-2dce-4810-862c-ca3161c4d5c0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:44.565682 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 516/1016] 10.222.0.77 () {60 vars in 1141 bytes} [Wed May 11 06:42:44 2022] POST /identity/v3/services => generated 242 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:42:44.841728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fb4d8-6844-486c-b6e3-0088d3ac509f None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:44.841930 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fb4d8-6844-486c-b6e3-0088d3ac509f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:44.842193 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fb4d8-6844-486c-b6e3-0088d3ac509f None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:44.843595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 501/1017] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:44.849183 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd14174-c112-4283-bf12-0eac3b843cd4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:44.849471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd14174-c112-4283-bf12-0eac3b843cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:44.849746 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd14174-c112-4283-bf12-0eac3b843cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:44.867137 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-abd14174-c112-4283-bf12-0eac3b843cd4 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:44.868328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-abd14174-c112-4283-bf12-0eac3b843cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:44.942615 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 517/1018] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:44.967247 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fb4d8-6844-486c-b6e3-0088d3ac509f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:45.075376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fb4d8-6844-486c-b6e3-0088d3ac509f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:45.111165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4168cb-6f09-40c1-aaaa-f68b7c865c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:45.111893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4168cb-6f09-40c1-aaaa-f68b7c865c4b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:45.112167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4168cb-6f09-40c1-aaaa-f68b7c865c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:45.112435 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4168cb-6f09-40c1-aaaa-f68b7c865c4b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:45.122285 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4168cb-6f09-40c1-aaaa-f68b7c865c4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:42:45.130473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-ac4168cb-6f09-40c1-aaaa-f68b7c865c4b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:42:45.130473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:45.130473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:45.130473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:45.130473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:45.130473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:45.130473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:45.130473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:45.130473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:45.130473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:45.130473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:45.130473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:45.130473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:42:45.130473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:42:45.130473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:42:45.130473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:42:45.131619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:42:45.131619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:42:45.131619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:42:45.131619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:42:45.131619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:45.131619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:45.131619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:45.131619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:45.131619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:45.131619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:45.131619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:45.131619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:45.131619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:45.131619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:45.131619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:45.131619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:45.132554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:45.132554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:45.132554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:45.132554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:45.132554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:42:45.132554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:42:45.132554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:42:45.132554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:42:45.132554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:42:45.132554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:42:45.132554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:42:45.132554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:45.135295 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 502/1019] 10.222.0.77 () {56 vars in 1120 bytes} [Wed May 11 06:42:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:45.137774 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd14174-c112-4283-bf12-0eac3b843cd4 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:45.238155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd14174-c112-4283-bf12-0eac3b843cd4 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:45.272546 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63332725-23d8-4286-94d6-7b7a1dbc5ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:45.273218 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63332725-23d8-4286-94d6-7b7a1dbc5ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:45.273497 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63332725-23d8-4286-94d6-7b7a1dbc5ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:45.273765 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63332725-23d8-4286-94d6-7b7a1dbc5ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:45.274512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63332725-23d8-4286-94d6-7b7a1dbc5ea1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:45.274817 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63332725-23d8-4286-94d6-7b7a1dbc5ea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:45.276252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63332725-23d8-4286-94d6-7b7a1dbc5ea1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:45.287470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 518/1020] 10.222.0.77 () {56 vars in 1115 bytes} [Wed May 11 06:42:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:45.293642 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4168cb-6f09-40c1-aaaa-f68b7c865c4b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:45.349779 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9f039-a3fa-4442-8085-0324d7ac1b38 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:45.350329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9f039-a3fa-4442-8085-0324d7ac1b38 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:45.350329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9f039-a3fa-4442-8085-0324d7ac1b38 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:45.351734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 519/1021] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:42:45.356637 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a939e-e323-4e23-b53e-f67f862e4ba9 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:45.356930 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a939e-e323-4e23-b53e-f67f862e4ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:45.357211 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a939e-e323-4e23-b53e-f67f862e4ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:45.374087 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4e5a939e-e323-4e23-b53e-f67f862e4ba9 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:45.375213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4e5a939e-e323-4e23-b53e-f67f862e4ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:45.393434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4168cb-6f09-40c1-aaaa-f68b7c865c4b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:45.426109 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f8c70-8a20-4c57-80b1-b476548172a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:45.426908 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f8c70-8a20-4c57-80b1-b476548172a8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:45.427214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f8c70-8a20-4c57-80b1-b476548172a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:45.427483 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f8c70-8a20-4c57-80b1-b476548172a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:45.438057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f8c70-8a20-4c57-80b1-b476548172a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:45.439874 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f8c70-8a20-4c57-80b1-b476548172a8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:45.449758 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 520/1022] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:42:45.456898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-aa5f8c70-8a20-4c57-80b1-b476548172a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:45.456898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:45.456898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:45.456898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:45.456898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:45.456898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:45.456898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:45.456898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:45.456898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:45.456898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:45.456898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:45.456898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:45.456898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:45.456898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:45.456898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:45.457838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:45.457838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:45.457838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:45.457838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:45.457838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:45.457838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:45.457838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:45.457838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:45.457838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:45.457838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:45.457838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:45.457838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:45.457838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:45.457838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:45.457838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:45.457838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:45.457838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:45.458747 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:45.458747 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:45.458747 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:45.458747 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:45.462872 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 503/1023] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:45.464035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a939e-e323-4e23-b53e-f67f862e4ba9 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:45.467085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f8c70-8a20-4c57-80b1-b476548172a8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:45.563000 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f8c70-8a20-4c57-80b1-b476548172a8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:45.568151 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a939e-e323-4e23-b53e-f67f862e4ba9 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:45.596405 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a91698-eee9-4012-913f-dbe73ffa058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:45.597214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a91698-eee9-4012-913f-dbe73ffa058f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:45.597489 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a91698-eee9-4012-913f-dbe73ffa058f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:45.597861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a91698-eee9-4012-913f-dbe73ffa058f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:45.599050 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a91698-eee9-4012-913f-dbe73ffa058f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:45.600538 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a91698-eee9-4012-913f-dbe73ffa058f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:45.601753 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c16abf-ee28-4b21-a708-b49f792d9d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:45.607138 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c16abf-ee28-4b21-a708-b49f792d9d63 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:45.607280 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 504/1024] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:45.607365 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c16abf-ee28-4b21-a708-b49f792d9d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:45.607365 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c16abf-ee28-4b21-a708-b49f792d9d63 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:45.607365 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c16abf-ee28-4b21-a708-b49f792d9d63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:45.607365 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c16abf-ee28-4b21-a708-b49f792d9d63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:45.607365 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c16abf-ee28-4b21-a708-b49f792d9d63 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:45.608285 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a91698-eee9-4012-913f-dbe73ffa058f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:45.616537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 521/1025] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:45.621833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c16abf-ee28-4b21-a708-b49f792d9d63 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:45.704597 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a91698-eee9-4012-913f-dbe73ffa058f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:45.717480 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c16abf-ee28-4b21-a708-b49f792d9d63 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:45.737849 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dac5bb-767a-4ec9-b0c2-9c409f2a90ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:45.738577 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dac5bb-767a-4ec9-b0c2-9c409f2a90ee None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:45.738849 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dac5bb-767a-4ec9-b0c2-9c409f2a90ee None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:45.739170 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dac5bb-767a-4ec9-b0c2-9c409f2a90ee None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:45.739886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dac5bb-767a-4ec9-b0c2-9c409f2a90ee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:45.741336 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dac5bb-767a-4ec9-b0c2-9c409f2a90ee None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:45.750219 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a5f8e-9a67-4ef2-a5d9-d3f7fe49c00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:45.751042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a5f8e-9a67-4ef2-a5d9-d3f7fe49c00c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:45.751324 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a5f8e-9a67-4ef2-a5d9-d3f7fe49c00c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:45.751609 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a5f8e-9a67-4ef2-a5d9-d3f7fe49c00c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:45.759256 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a5f8e-9a67-4ef2-a5d9-d3f7fe49c00c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:45.760828 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a5f8e-9a67-4ef2-a5d9-d3f7fe49c00c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:45.768514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 505/1026] 10.222.0.77 () {60 vars in 1141 bytes} [Wed May 11 06:42:45 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:42:45.775122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-024a5f8e-9a67-4ef2-a5d9-d3f7fe49c00c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 06:42:45.775122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:45.775122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:45.775122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:45.775122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:45.775122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:45.775122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:45.775122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:45.775122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:45.775122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:45.775122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:45.775122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:45.775122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:42:45.775122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:42:45.775122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:42:45.775122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:42:45.777349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:45.777349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:45.777349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:42:45.777349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:45.777349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:42:45.777349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:45.777349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:45.777349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:45.777349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:45.777349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:45.777349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:45.777349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:45.777349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:45.777349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:45.777349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:45.777349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:45.777349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:45.777349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:45.778334 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:45.778334 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:45.778334 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:42:45.778334 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:42:45.778334 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:42:45.778334 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:42:45.778334 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:42:45.778334 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:42:45.778334 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 06:42:45.778334 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:45.783698 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 522/1027] 10.222.0.77 () {56 vars in 1093 bytes} [Wed May 11 06:42:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:45.788808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dac5bb-767a-4ec9-b0c2-9c409f2a90ee None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:45.899171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dac5bb-767a-4ec9-b0c2-9c409f2a90ee None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:45.936258 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b4f66-1a5b-4b8d-829b-206247775935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:45.936956 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b4f66-1a5b-4b8d-829b-206247775935 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:45.937234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b4f66-1a5b-4b8d-829b-206247775935 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:45.937467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b4f66-1a5b-4b8d-829b-206247775935 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:45.938361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b4f66-1a5b-4b8d-829b-206247775935 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:45.938658 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b4f66-1a5b-4b8d-829b-206247775935 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:45.940154 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b4f66-1a5b-4b8d-829b-206247775935 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:45.958940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 506/1028] 10.222.0.77 () {56 vars in 1133 bytes} [Wed May 11 06:42:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:45.964463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a5f8e-9a67-4ef2-a5d9-d3f7fe49c00c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:46.060661 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a5f8e-9a67-4ef2-a5d9-d3f7fe49c00c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:46.092829 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6509db-fe66-454c-9928-bfa86653a080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:46.093533 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6509db-fe66-454c-9928-bfa86653a080 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:46.093791 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6509db-fe66-454c-9928-bfa86653a080 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:46.094087 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6509db-fe66-454c-9928-bfa86653a080 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:46.159437 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6509db-fe66-454c-9928-bfa86653a080 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:46.160994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6509db-fe66-454c-9928-bfa86653a080 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:46.260387 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 523/1029] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:42:45 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:42:46.266030 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b4f66-1a5b-4b8d-829b-206247775935 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:46.365056 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b4f66-1a5b-4b8d-829b-206247775935 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:46.398903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c416d-c134-4f1b-8d75-117eb3f3ba00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:46.399709 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c416d-c134-4f1b-8d75-117eb3f3ba00 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:46.399991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c416d-c134-4f1b-8d75-117eb3f3ba00 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:46.400239 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c416d-c134-4f1b-8d75-117eb3f3ba00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:46.410475 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c416d-c134-4f1b-8d75-117eb3f3ba00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:46.411966 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c416d-c134-4f1b-8d75-117eb3f3ba00 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:46.429478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-cc0c416d-c134-4f1b-8d75-117eb3f3ba00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:46.429478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:46.429478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:46.429478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:46.429478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:46.429478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:46.429478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:46.429478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:46.429478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:46.429478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:46.429478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:46.429478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:46.429478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:46.429478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:46.429478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:46.430428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:46.430428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:46.430428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:46.430428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:46.430428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:46.430428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:46.430428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:46.430428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:46.430428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:46.430428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:46.430428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:46.430428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:46.430428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:46.430428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:46.430428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:46.430428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:46.430428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:46.431398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:46.431398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:46.431398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:46.431398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:46.432273 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 507/1030] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:46.436381 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6509db-fe66-454c-9928-bfa86653a080 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:46.541061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6509db-fe66-454c-9928-bfa86653a080 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:46.575067 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ebcc0-8599-4915-99ac-fa0a0b27bc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:46.575736 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ebcc0-8599-4915-99ac-fa0a0b27bc6b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:46.576009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ebcc0-8599-4915-99ac-fa0a0b27bc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:46.576277 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ebcc0-8599-4915-99ac-fa0a0b27bc6b None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:46.577000 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ebcc0-8599-4915-99ac-fa0a0b27bc6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:46.577301 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ebcc0-8599-4915-99ac-fa0a0b27bc6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:46.578663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ebcc0-8599-4915-99ac-fa0a0b27bc6b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:46.590038 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 524/1031] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:46.595715 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c416d-c134-4f1b-8d75-117eb3f3ba00 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:46.698838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c416d-c134-4f1b-8d75-117eb3f3ba00 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:46.732060 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013f968-2754-4f67-bc03-f1d42a88fdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:46.732852 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013f968-2754-4f67-bc03-f1d42a88fdfb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:46.733128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013f968-2754-4f67-bc03-f1d42a88fdfb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:46.733394 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013f968-2754-4f67-bc03-f1d42a88fdfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:46.739984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013f968-2754-4f67-bc03-f1d42a88fdfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:46.741433 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013f968-2754-4f67-bc03-f1d42a88fdfb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:46.754776 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-e013f968-2754-4f67-bc03-f1d42a88fdfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:46.754776 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:46.754776 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:46.754776 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:46.754776 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:46.754776 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:46.754776 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:46.754776 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:46.754776 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:46.754776 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:46.754776 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:46.754776 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:46.754776 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:42:46.754776 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:42:46.754776 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:42:46.755836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:42:46.755836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:46.755836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:46.755836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:46.755836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:46.755836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:46.755836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:46.755836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:46.755836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:46.755836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:46.755836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:46.755836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:46.755836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:46.755836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:46.755836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:46.755836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:46.755836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:46.756744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:42:46.756744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:42:46.756744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:42:46.756744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:42:46.756744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:42:46.756744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:42:46.756744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:46.756744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:46.760795 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 508/1032] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:46.762282 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ebcc0-8599-4915-99ac-fa0a0b27bc6b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:46.810435 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a8605-26c3-4685-968a-8f862fda33de None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:46.810621 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a8605-26c3-4685-968a-8f862fda33de None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:46.810860 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a8605-26c3-4685-968a-8f862fda33de None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:46.812443 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 509/1033] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:42:46.817270 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e223432-20e2-4719-9e43-aa481a953ac0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:46.817557 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e223432-20e2-4719-9e43-aa481a953ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:46.817786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e223432-20e2-4719-9e43-aa481a953ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:46.835753 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-6e223432-20e2-4719-9e43-aa481a953ac0 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:46.836954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6e223432-20e2-4719-9e43-aa481a953ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:46.863258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ebcc0-8599-4915-99ac-fa0a0b27bc6b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:46.895976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50686a7-7748-4974-ba96-d5a08a83c5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:46.896644 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50686a7-7748-4974-ba96-d5a08a83c5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:46.896935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50686a7-7748-4974-ba96-d5a08a83c5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:46.897192 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50686a7-7748-4974-ba96-d5a08a83c5c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:46.897975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50686a7-7748-4974-ba96-d5a08a83c5c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:46.898295 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50686a7-7748-4974-ba96-d5a08a83c5c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:46.899743 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50686a7-7748-4974-ba96-d5a08a83c5c8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:46.907088 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 510/1034] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:42:46.912104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 525/1035] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:42:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:46.918152 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e223432-20e2-4719-9e43-aa481a953ac0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:46.923947 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50686a7-7748-4974-ba96-d5a08a83c5c8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:47.016275 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e223432-20e2-4719-9e43-aa481a953ac0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:47.020229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50686a7-7748-4974-ba96-d5a08a83c5c8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:47.049720 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb064257-abd5-4664-8424-071baa8bbfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:47.050395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb064257-abd5-4664-8424-071baa8bbfc3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:47.050660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb064257-abd5-4664-8424-071baa8bbfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:47.050977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb064257-abd5-4664-8424-071baa8bbfc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:47.051813 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb064257-abd5-4664-8424-071baa8bbfc3 None admin] RBAC: Adding query filter params (role.id=4e9d3c690fdb4f48878128cd834eb431, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=edf9d57de89a4701ba1a5b079d0ad348) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:47.052109 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb064257-abd5-4664-8424-071baa8bbfc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:47.053543 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb064257-abd5-4664-8424-071baa8bbfc3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:47.053644 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c50e8-fc0d-4da0-86ba-e16a880f21b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:47.054410 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c50e8-fc0d-4da0-86ba-e16a880f21b5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:47.054689 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c50e8-fc0d-4da0-86ba-e16a880f21b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:47.054978 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c50e8-fc0d-4da0-86ba-e16a880f21b5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:47.055636 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c50e8-fc0d-4da0-86ba-e16a880f21b5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:47.056990 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c50e8-fc0d-4da0-86ba-e16a880f21b5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:47.059198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 511/1036] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:42:46 2022] GET /identity/v3/role_assignments?user.id=edf9d57de89a4701ba1a5b079d0ad348&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=4e9d3c690fdb4f48878128cd834eb431 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:47.068836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-671c50e8-fc0d-4da0-86ba-e16a880f21b5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 06:42:47.068836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:47.068836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:47.068836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:47.068836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:47.068836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:47.068836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:47.068836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:47.068836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 06:42:47.068836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:47.068836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:47.068836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:47.068836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:47.068836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:47.068836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:47.068836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:47.068836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:47.070223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:47.070223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:47.070223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:47.070223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:47.070223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:47.070223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:47.070223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:47.070223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:47.070223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:47.070223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:47.070223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:47.070223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:47.070223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:47.070223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:47.070223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:47.070223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:47.071554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:47.071554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:47.071554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:47.071554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:47.071554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:47.071554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:47.071554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:47.071554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:47.071554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:47.071554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:47.071554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:47.071554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:47.071554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 06:42:47.071554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:47.075395 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 526/1037] 10.222.0.77 () {56 vars in 1105 bytes} [Wed May 11 06:42:46 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:47.076828 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb064257-abd5-4664-8424-071baa8bbfc3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:47.182539 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb064257-abd5-4664-8424-071baa8bbfc3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:47.218990 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dae49f-31d3-439f-8289-0e7b99f7b3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:47.219676 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dae49f-31d3-439f-8289-0e7b99f7b3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:47.219959 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dae49f-31d3-439f-8289-0e7b99f7b3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:47.220231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dae49f-31d3-439f-8289-0e7b99f7b3e8 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:47.220941 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dae49f-31d3-439f-8289-0e7b99f7b3e8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:47.221242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dae49f-31d3-439f-8289-0e7b99f7b3e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:47.222682 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dae49f-31d3-439f-8289-0e7b99f7b3e8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:47.228087 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 512/1038] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:47.234090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c50e8-fc0d-4da0-86ba-e16a880f21b5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:47.335974 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c50e8-fc0d-4da0-86ba-e16a880f21b5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:47.369389 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be38bf-45ba-45ca-baec-616b4f64ec6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:47.370066 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be38bf-45ba-45ca-baec-616b4f64ec6d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:47.370350 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be38bf-45ba-45ca-baec-616b4f64ec6d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:47.370602 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be38bf-45ba-45ca-baec-616b4f64ec6d None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:47.371347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be38bf-45ba-45ca-baec-616b4f64ec6d None admin] RBAC: Adding query filter params (type=image) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:47.371656 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be38bf-45ba-45ca-baec-616b4f64ec6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:47.373038 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be38bf-45ba-45ca-baec-616b4f64ec6d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:47.382675 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 527/1039] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:47.384249 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dae49f-31d3-439f-8289-0e7b99f7b3e8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:47.482584 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dae49f-31d3-439f-8289-0e7b99f7b3e8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:47.515847 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa40646-5956-4e3d-800e-f4b048cd52fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:47.516514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa40646-5956-4e3d-800e-f4b048cd52fa None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:47.516793 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa40646-5956-4e3d-800e-f4b048cd52fa None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:47.517064 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa40646-5956-4e3d-800e-f4b048cd52fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:47.517850 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa40646-5956-4e3d-800e-f4b048cd52fa None admin] RBAC: Adding query filter params (interface=public, service_id=1ace3d8886cc412a9398a756c062f6f8, region_id=RegionOne) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:47.518157 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa40646-5956-4e3d-800e-f4b048cd52fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:47.519567 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa40646-5956-4e3d-800e-f4b048cd52fa None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:47.529297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 513/1040] 10.222.0.77 () {56 vars in 1251 bytes} [Wed May 11 06:42:47 2022] GET /identity/v3/endpoints?service_id=1ace3d8886cc412a9398a756c062f6f8&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:47.530499 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be38bf-45ba-45ca-baec-616b4f64ec6d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:47.629826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be38bf-45ba-45ca-baec-616b4f64ec6d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:47.663126 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bbbea-169a-45ce-9cc9-92db6b6e1d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:47.663792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bbbea-169a-45ce-9cc9-92db6b6e1d3a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:47.664068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bbbea-169a-45ce-9cc9-92db6b6e1d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:47.664337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bbbea-169a-45ce-9cc9-92db6b6e1d3a None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:47.665013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771bbbea-169a-45ce-9cc9-92db6b6e1d3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:47.666381 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771bbbea-169a-45ce-9cc9-92db6b6e1d3a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:47.672995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 528/1041] 10.222.0.77 () {56 vars in 1087 bytes} [Wed May 11 06:42:47 2022] GET /identity/v3/services => generated 1957 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:42:48.043834 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dc46b-21d7-44d7-ab8f-64279ab62dba None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:48.044107 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dc46b-21d7-44d7-ab8f-64279ab62dba None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:48.044358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dc46b-21d7-44d7-ab8f-64279ab62dba None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:48.045898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 514/1042] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:48.051099 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c7273-d934-48ed-bfc6-9ce1e379f441 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:48.051357 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c7273-d934-48ed-bfc6-9ce1e379f441 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:48.051657 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c7273-d934-48ed-bfc6-9ce1e379f441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:48.068639 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-308c7273-d934-48ed-bfc6-9ce1e379f441 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:48.069806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-308c7273-d934-48ed-bfc6-9ce1e379f441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:48.136520 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 529/1043] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:42:48.160669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3dc46b-21d7-44d7-ab8f-64279ab62dba None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:48.267883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3dc46b-21d7-44d7-ab8f-64279ab62dba None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:48.307057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b79ed2-659c-442d-b543-d5c0e4e313d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:48.307867 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b79ed2-659c-442d-b543-d5c0e4e313d7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:48.308143 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b79ed2-659c-442d-b543-d5c0e4e313d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:48.308465 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b79ed2-659c-442d-b543-d5c0e4e313d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:48.309708 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b79ed2-659c-442d-b543-d5c0e4e313d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:48.311175 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b79ed2-659c-442d-b543-d5c0e4e313d7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:48.317469 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 515/1044] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:48.318702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c7273-d934-48ed-bfc6-9ce1e379f441 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:48.413301 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c7273-d934-48ed-bfc6-9ce1e379f441 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:48.447725 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b63fd6-9a0a-4673-aae6-919cb4f9dd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:48.448402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b63fd6-9a0a-4673-aae6-919cb4f9dd72 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:48.448675 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b63fd6-9a0a-4673-aae6-919cb4f9dd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:48.448946 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b63fd6-9a0a-4673-aae6-919cb4f9dd72 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:48.449667 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b63fd6-9a0a-4673-aae6-919cb4f9dd72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:48.451128 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b63fd6-9a0a-4673-aae6-919cb4f9dd72 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:48.472689 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 530/1045] 10.222.0.77 () {60 vars in 1132 bytes} [Wed May 11 06:42:48 2022] POST /identity/v3/users => generated 285 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:42:49.276397 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd90b0-bdef-4c9a-ba6b-1de86805cea1 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:49.277125 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd90b0-bdef-4c9a-ba6b-1de86805cea1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:49.277125 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd90b0-bdef-4c9a-ba6b-1de86805cea1 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:49.278352 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 516/1046] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:49.283976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d0345-c391-4533-94de-4424a85364be None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:49.284450 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d0345-c391-4533-94de-4424a85364be None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:49.284529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d0345-c391-4533-94de-4424a85364be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:49.302894 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ba0d0345-c391-4533-94de-4424a85364be None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:49.304136 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ba0d0345-c391-4533-94de-4424a85364be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:49.371122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 531/1047] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:42:49.392510 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd90b0-bdef-4c9a-ba6b-1de86805cea1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:49.494260 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd90b0-bdef-4c9a-ba6b-1de86805cea1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:49.527259 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e236e5-1d2e-47d0-a3a6-2aa32d35bc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:49.528025 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e236e5-1d2e-47d0-a3a6-2aa32d35bc89 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:49.528301 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e236e5-1d2e-47d0-a3a6-2aa32d35bc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:49.528575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e236e5-1d2e-47d0-a3a6-2aa32d35bc89 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:49.542225 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e236e5-1d2e-47d0-a3a6-2aa32d35bc89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:42:49.550482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-f2e236e5-1d2e-47d0-a3a6-2aa32d35bc89 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:42:49.550482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:49.550482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:49.550482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:49.550482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:49.550482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:49.550482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:49.550482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:49.550482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:49.550482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:49.550482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:49.550482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:49.550482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:42:49.550482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:42:49.550482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:42:49.550482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:42:49.551727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:42:49.551727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:42:49.551727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:42:49.551727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:42:49.551727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:49.551727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:49.551727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:49.551727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:49.551727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:49.551727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:49.551727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:49.551727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:49.551727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:49.551727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:49.551727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:49.551727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:49.557842 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:49.557842 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:49.557842 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:49.557842 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:49.557842 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:42:49.557842 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:42:49.557842 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:42:49.557842 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:42:49.557842 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:42:49.557842 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:42:49.557842 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:42:49.557842 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:49.557842 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 517/1048] 10.222.0.77 () {56 vars in 1120 bytes} [Wed May 11 06:42:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:49.558555 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d0345-c391-4533-94de-4424a85364be None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:49.659222 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d0345-c391-4533-94de-4424a85364be None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:49.694241 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b77f12-75fb-43d6-a7e9-ce057e499fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:49.695324 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b77f12-75fb-43d6-a7e9-ce057e499fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:49.695614 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b77f12-75fb-43d6-a7e9-ce057e499fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:49.695881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b77f12-75fb-43d6-a7e9-ce057e499fd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:49.696659 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b77f12-75fb-43d6-a7e9-ce057e499fd4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:49.696968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b77f12-75fb-43d6-a7e9-ce057e499fd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:49.698403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b77f12-75fb-43d6-a7e9-ce057e499fd4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:49.708048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 532/1049] 10.222.0.77 () {56 vars in 1115 bytes} [Wed May 11 06:42:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:49.714012 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e236e5-1d2e-47d0-a3a6-2aa32d35bc89 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:49.818768 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e236e5-1d2e-47d0-a3a6-2aa32d35bc89 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:49.852366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158aaefa-9fe8-4df0-b0c6-0e38a23ad896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:49.853160 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aaefa-9fe8-4df0-b0c6-0e38a23ad896 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:49.853436 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aaefa-9fe8-4df0-b0c6-0e38a23ad896 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:49.853708 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aaefa-9fe8-4df0-b0c6-0e38a23ad896 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:49.864208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158aaefa-9fe8-4df0-b0c6-0e38a23ad896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:49.865655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158aaefa-9fe8-4df0-b0c6-0e38a23ad896 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:49.890991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-158aaefa-9fe8-4df0-b0c6-0e38a23ad896 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:49.890991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:49.890991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:49.890991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:49.890991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:49.890991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:49.890991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:49.890991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:49.890991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:49.890991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:49.890991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:49.890991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:49.890991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:49.890991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:49.890991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:49.891972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:49.891972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:49.891972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:49.891972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:49.891972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:49.891972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:49.891972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:49.891972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:49.891972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:49.891972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:49.891972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:49.891972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:49.891972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:49.891972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:49.891972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:49.891972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:49.891972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:49.897933 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:49.897933 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:49.897933 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:49.897933 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:49.897933 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 518/1050] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:49.898238 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158aaefa-9fe8-4df0-b0c6-0e38a23ad896 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:49.898452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fe27d-ebf5-414e-bd82-eebd6fb92f30 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:49.898628 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fe27d-ebf5-414e-bd82-eebd6fb92f30 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:49.898910 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fe27d-ebf5-414e-bd82-eebd6fb92f30 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:49.900303 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 533/1051] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:49.905583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632e12f-d4d9-4e14-8f64-326607de194c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:49.905875 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632e12f-d4d9-4e14-8f64-326607de194c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:49.906149 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632e12f-d4d9-4e14-8f64-326607de194c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:49.923258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f632e12f-d4d9-4e14-8f64-326607de194c None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:49.924470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f632e12f-d4d9-4e14-8f64-326607de194c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:49.991778 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 534/1052] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:50.001955 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158aaefa-9fe8-4df0-b0c6-0e38a23ad896 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:50.014174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632e12f-d4d9-4e14-8f64-326607de194c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:50.034625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2222e8-ee81-4b20-a051-134c8caf177c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:50.035382 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2222e8-ee81-4b20-a051-134c8caf177c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:50.035687 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2222e8-ee81-4b20-a051-134c8caf177c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:50.035949 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2222e8-ee81-4b20-a051-134c8caf177c None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:50.036673 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2222e8-ee81-4b20-a051-134c8caf177c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:50.036980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2222e8-ee81-4b20-a051-134c8caf177c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:50.038347 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2222e8-ee81-4b20-a051-134c8caf177c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:50.049861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 519/1053] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:50.055311 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2222e8-ee81-4b20-a051-134c8caf177c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:50.112692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632e12f-d4d9-4e14-8f64-326607de194c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:50.147347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea4f73-c1e8-4124-a6cc-dc360cbcec0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:50.148150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea4f73-c1e8-4124-a6cc-dc360cbcec0c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:50.148423 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea4f73-c1e8-4124-a6cc-dc360cbcec0c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:50.148691 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea4f73-c1e8-4124-a6cc-dc360cbcec0c None admin] PATH_INFO: `/v3/services/image` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:50.149348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea4f73-c1e8-4124-a6cc-dc360cbcec0c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:50.150718 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea4f73-c1e8-4124-a6cc-dc360cbcec0c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:50.151879 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2222e8-ee81-4b20-a051-134c8caf177c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:50.162107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-68ea4f73-c1e8-4124-a6cc-dc360cbcec0c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 06:42:50.162107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:50.162107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:42:50.162107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:42:50.162107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:42:50.162107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:42:50.162107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:42:50.162107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:50.162107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 06:42:50.162107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:50.162107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:42:50.162107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:50.162107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:50.162107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:50.162107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:50.162107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:50.162107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:50.163191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:50.163191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:50.163191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:50.163191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:50.163191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:50.163191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:50.163191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:42:50.163191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:42:50.163191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:42:50.163191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:42:50.163191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:50.163191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:50.163191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:50.163191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:50.163191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:50.163191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:50.164061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:50.164061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:50.164061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:50.164061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:50.164061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:50.164061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:50.164061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:50.164061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:50.164061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:50.164061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:50.164061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:42:50.164061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:42:50.164061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 06:42:50.164061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:50.164061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 535/1054] 10.222.0.77 () {56 vars in 1105 bytes} [Wed May 11 06:42:50 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:50.169381 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea4f73-c1e8-4124-a6cc-dc360cbcec0c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:50.188136 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947ca64-73a3-47eb-a989-088c62de9d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:50.188943 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947ca64-73a3-47eb-a989-088c62de9d18 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:50.189220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947ca64-73a3-47eb-a989-088c62de9d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:50.189485 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947ca64-73a3-47eb-a989-088c62de9d18 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:50.197381 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947ca64-73a3-47eb-a989-088c62de9d18 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:50.198830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947ca64-73a3-47eb-a989-088c62de9d18 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:50.217229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-6947ca64-73a3-47eb-a989-088c62de9d18 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 06:42:50.217229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:50.217229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:50.217229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:50.217229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:50.217229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:50.217229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:50.217229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:50.217229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:50.217229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:50.217229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:50.217229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:50.217229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:42:50.217229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:42:50.217229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:42:50.217229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:42:50.218251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:50.218251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:50.218251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:42:50.218251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:50.218251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:42:50.218251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:50.218251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:50.218251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:50.218251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:50.218251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:50.218251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:50.218251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:50.218251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:50.218251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:50.218251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:50.218251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:50.218251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:50.218251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:50.219257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:50.219257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:50.219257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:42:50.219257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:42:50.219257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:42:50.219257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:42:50.219257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:42:50.219257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:42:50.219257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 06:42:50.219257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:50.219257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 520/1055] 10.222.0.77 () {56 vars in 1093 bytes} [Wed May 11 06:42:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:50.224501 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947ca64-73a3-47eb-a989-088c62de9d18 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:50.278628 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea4f73-c1e8-4124-a6cc-dc360cbcec0c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:50.313061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a282b0-adbc-47e6-9603-e86ab810c040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:50.313751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a282b0-adbc-47e6-9603-e86ab810c040 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:50.314044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a282b0-adbc-47e6-9603-e86ab810c040 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:50.314289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a282b0-adbc-47e6-9603-e86ab810c040 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:50.315010 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a282b0-adbc-47e6-9603-e86ab810c040 None admin] RBAC: Adding query filter params (name=image) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:50.315328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a282b0-adbc-47e6-9603-e86ab810c040 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:50.317245 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a282b0-adbc-47e6-9603-e86ab810c040 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:50.324907 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 536/1056] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:50.325509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947ca64-73a3-47eb-a989-088c62de9d18 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:50.330509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a282b0-adbc-47e6-9603-e86ab810c040 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:50.359629 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d069f-6da4-44d6-b528-a5354ce494cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:50.360302 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d069f-6da4-44d6-b528-a5354ce494cf None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:50.360584 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d069f-6da4-44d6-b528-a5354ce494cf None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:50.360845 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d069f-6da4-44d6-b528-a5354ce494cf None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:50.361697 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d069f-6da4-44d6-b528-a5354ce494cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:50.362004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d069f-6da4-44d6-b528-a5354ce494cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:50.363581 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d069f-6da4-44d6-b528-a5354ce494cf None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:50.380611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 521/1057] 10.222.0.77 () {56 vars in 1133 bytes} [Wed May 11 06:42:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:50.386028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d069f-6da4-44d6-b528-a5354ce494cf None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:50.427402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a282b0-adbc-47e6-9603-e86ab810c040 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:50.461127 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a987191-f149-4cd2-bbe4-bb7590e31ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:50.461811 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a987191-f149-4cd2-bbe4-bb7590e31ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:50.462106 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a987191-f149-4cd2-bbe4-bb7590e31ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:50.462373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a987191-f149-4cd2-bbe4-bb7590e31ed1 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:50.463120 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a987191-f149-4cd2-bbe4-bb7590e31ed1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:50.463427 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a987191-f149-4cd2-bbe4-bb7590e31ed1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:50.464809 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a987191-f149-4cd2-bbe4-bb7590e31ed1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:50.474297 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 537/1058] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:50.475454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a987191-f149-4cd2-bbe4-bb7590e31ed1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:50.484794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d069f-6da4-44d6-b528-a5354ce494cf None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:50.518327 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ef965-a052-4fac-91bd-5e2d8d997972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:50.519165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ef965-a052-4fac-91bd-5e2d8d997972 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:50.519442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ef965-a052-4fac-91bd-5e2d8d997972 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:50.519766 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ef965-a052-4fac-91bd-5e2d8d997972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:50.530363 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ef965-a052-4fac-91bd-5e2d8d997972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:50.531911 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ef965-a052-4fac-91bd-5e2d8d997972 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:50.550590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-eb7ef965-a052-4fac-91bd-5e2d8d997972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:50.550590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:50.550590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:50.550590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:50.550590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:50.550590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:50.550590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:50.550590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:50.550590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:50.550590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:50.550590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:50.550590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:50.550590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:50.550590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:50.550590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:50.551887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:50.551887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:50.551887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:50.551887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:50.551887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:50.551887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:50.551887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:50.551887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:50.551887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:50.551887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:50.551887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:50.551887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:50.551887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:50.551887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:50.551887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:50.551887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:50.551887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:50.552851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:50.552851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:50.552851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:50.552851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:50.555325 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 522/1059] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:50.557850 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ef965-a052-4fac-91bd-5e2d8d997972 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:50.579684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a987191-f149-4cd2-bbe4-bb7590e31ed1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:50.611536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c349840-1a48-4e8a-9e5b-1875252ac0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:50.612206 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c349840-1a48-4e8a-9e5b-1875252ac0cb None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:50.612485 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c349840-1a48-4e8a-9e5b-1875252ac0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:50.612755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c349840-1a48-4e8a-9e5b-1875252ac0cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:50.613522 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c349840-1a48-4e8a-9e5b-1875252ac0cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:50.615000 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c349840-1a48-4e8a-9e5b-1875252ac0cb None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:50.636097 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 538/1060] 10.222.0.77 () {60 vars in 1144 bytes} [Wed May 11 06:42:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:42:50.655826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ef965-a052-4fac-91bd-5e2d8d997972 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:50.699056 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6cb6e-f365-455a-b53a-1c263a9a0957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:50.699749 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6cb6e-f365-455a-b53a-1c263a9a0957 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:50.700027 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6cb6e-f365-455a-b53a-1c263a9a0957 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:50.700299 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6cb6e-f365-455a-b53a-1c263a9a0957 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:50.701035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6cb6e-f365-455a-b53a-1c263a9a0957 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:50.701343 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6cb6e-f365-455a-b53a-1c263a9a0957 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:50.702765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6cb6e-f365-455a-b53a-1c263a9a0957 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:50.720119 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 523/1061] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:50.721617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c349840-1a48-4e8a-9e5b-1875252ac0cb None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:50.725005 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ca68d-43d4-494f-a82d-ed0db2406845 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:50.725602 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ca68d-43d4-494f-a82d-ed0db2406845 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:50.725890 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ca68d-43d4-494f-a82d-ed0db2406845 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:50.727642 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 524/1062] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:42:50.732815 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c338bc1-fc4f-4823-83d5-cdc0f2f4914c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:50.733097 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c338bc1-fc4f-4823-83d5-cdc0f2f4914c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:50.733367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c338bc1-fc4f-4823-83d5-cdc0f2f4914c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:50.752132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3c338bc1-fc4f-4823-83d5-cdc0f2f4914c None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:50.753360 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3c338bc1-fc4f-4823-83d5-cdc0f2f4914c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:50.821354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 525/1063] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:42:50.834088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c349840-1a48-4e8a-9e5b-1875252ac0cb None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:50.844674 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c338bc1-fc4f-4823-83d5-cdc0f2f4914c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:50.868080 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8121dd5-e637-4216-b98d-16f0968a2d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:50.868869 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8121dd5-e637-4216-b98d-16f0968a2d7b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:50.869149 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8121dd5-e637-4216-b98d-16f0968a2d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:50.869467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8121dd5-e637-4216-b98d-16f0968a2d7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:50.876346 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8121dd5-e637-4216-b98d-16f0968a2d7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:50.877802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8121dd5-e637-4216-b98d-16f0968a2d7b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:50.894953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b8121dd5-e637-4216-b98d-16f0968a2d7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:50.894953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:50.894953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:50.894953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:50.894953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:50.894953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:50.894953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:50.894953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:50.894953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:50.894953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:50.894953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:50.894953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:50.894953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:42:50.894953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:42:50.894953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:42:50.896030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:42:50.896030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:50.896030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:50.896030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:50.896030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:50.896030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:50.896030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:50.896030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:50.896030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:50.896030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:50.896030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:50.896030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:50.896030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:50.896030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:50.896030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:50.896030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:50.896030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:50.897125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:42:50.897125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:42:50.897125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:42:50.897125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:42:50.897125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:42:50.897125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:42:50.897125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:50.897125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:50.897125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 539/1064] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:50.903459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8121dd5-e637-4216-b98d-16f0968a2d7b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:50.949396 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c338bc1-fc4f-4823-83d5-cdc0f2f4914c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:50.981980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402ce0a-1473-427c-bfe1-ece05fc8ac7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:50.982787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402ce0a-1473-427c-bfe1-ece05fc8ac7c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:50.983109 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402ce0a-1473-427c-bfe1-ece05fc8ac7c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:50.983369 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402ce0a-1473-427c-bfe1-ece05fc8ac7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:50.993188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402ce0a-1473-427c-bfe1-ece05fc8ac7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:42:50.996977 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8121dd5-e637-4216-b98d-16f0968a2d7b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:51.001923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-2402ce0a-1473-427c-bfe1-ece05fc8ac7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:42:51.001923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:51.001923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:51.001923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:51.001923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:51.001923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:51.001923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:51.001923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:51.001923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:51.001923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:51.001923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:51.001923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:51.001923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:42:51.001923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:42:51.001923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:42:51.001923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:42:51.002861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:42:51.002861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:42:51.002861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:42:51.002861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:42:51.002861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:51.002861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:51.002861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:51.002861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:51.002861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:51.002861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:51.002861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:51.002861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:51.002861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:51.002861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:51.002861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:51.002861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:51.003784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:51.003784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:51.003784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:51.003784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:51.003784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:42:51.003784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:42:51.003784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:42:51.003784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:42:51.003784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:42:51.003784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:42:51.003784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:42:51.003784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:51.007280 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 526/1065] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:42:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:51.009102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402ce0a-1473-427c-bfe1-ece05fc8ac7c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:51.030176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af84b6-a93d-4f58-97e9-1fcd1d145f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:51.030850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af84b6-a93d-4f58-97e9-1fcd1d145f9e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:51.031159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af84b6-a93d-4f58-97e9-1fcd1d145f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:51.031436 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af84b6-a93d-4f58-97e9-1fcd1d145f9e None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:51.032221 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af84b6-a93d-4f58-97e9-1fcd1d145f9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:51.032527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af84b6-a93d-4f58-97e9-1fcd1d145f9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:51.033959 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af84b6-a93d-4f58-97e9-1fcd1d145f9e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:51.045472 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 540/1066] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:42:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:51.051155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af84b6-a93d-4f58-97e9-1fcd1d145f9e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:51.105995 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402ce0a-1473-427c-bfe1-ece05fc8ac7c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:51.137917 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b51b8-fc5b-4bf4-82d1-979b97288daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:51.138507 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b51b8-fc5b-4bf4-82d1-979b97288daf None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:51.138791 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b51b8-fc5b-4bf4-82d1-979b97288daf None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:51.139094 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b51b8-fc5b-4bf4-82d1-979b97288daf None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:51.139843 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b51b8-fc5b-4bf4-82d1-979b97288daf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:51.140148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b51b8-fc5b-4bf4-82d1-979b97288daf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:51.141532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b51b8-fc5b-4bf4-82d1-979b97288daf None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:51.146554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af84b6-a93d-4f58-97e9-1fcd1d145f9e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:51.149745 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 527/1067] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:42:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:51.155462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b51b8-fc5b-4bf4-82d1-979b97288daf None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:51.182137 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a5e45-276d-4522-8124-3867f211216f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:51.183642 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a5e45-276d-4522-8124-3867f211216f None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:51.183935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a5e45-276d-4522-8124-3867f211216f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:51.184212 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a5e45-276d-4522-8124-3867f211216f None admin] PATH_INFO: `/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/edf9d57de89a4701ba1a5b079d0ad348/roles/4e9d3c690fdb4f48878128cd834eb431` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:51.187206 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a5e45-276d-4522-8124-3867f211216f None admin] RBAC: Authorizing `identity:create_grant(project_id=0f573a9de6904664ace6287072a8a7dc, user_id=edf9d57de89a4701ba1a5b079d0ad348, role_id=4e9d3c690fdb4f48878128cd834eb431)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:51.189598 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a5e45-276d-4522-8124-3867f211216f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:51.215006 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 541/1068] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:42:51 2022] PUT /identity/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/edf9d57de89a4701ba1a5b079d0ad348/roles/4e9d3c690fdb4f48878128cd834eb431 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:42:51.255251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b51b8-fc5b-4bf4-82d1-979b97288daf None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:51.290775 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fb479-fa8f-429b-b3b1-0e14e37c0ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:51.291723 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fb479-fa8f-429b-b3b1-0e14e37c0ece None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:51.292062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fb479-fa8f-429b-b3b1-0e14e37c0ece None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:51.292337 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fb479-fa8f-429b-b3b1-0e14e37c0ece None admin] PATH_INFO: `/v3/users/9214ea63b19643ee87e92848f6176b60` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:51.307987 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fb479-fa8f-429b-b3b1-0e14e37c0ece None admin] RBAC: Authorizing `identity:get_user(user_id=9214ea63b19643ee87e92848f6176b60)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:51.309482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fb479-fa8f-429b-b3b1-0e14e37c0ece None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:51.311317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 528/1069] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:42:51 2022] GET /identity/v3/users/9214ea63b19643ee87e92848f6176b60 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:51.317286 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a5e45-276d-4522-8124-3867f211216f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:51.428086 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a5e45-276d-4522-8124-3867f211216f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:51.462224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27666f-fea3-4fa9-8c46-9ec2e8951ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:51.462938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27666f-fea3-4fa9-8c46-9ec2e8951ecd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:51.463259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27666f-fea3-4fa9-8c46-9ec2e8951ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:51.463529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27666f-fea3-4fa9-8c46-9ec2e8951ecd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:51.530907 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27666f-fea3-4fa9-8c46-9ec2e8951ecd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:51.532400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27666f-fea3-4fa9-8c46-9ec2e8951ecd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:51.629859 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 542/1070] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:42:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 06:42:51.635788 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fb479-fa8f-429b-b3b1-0e14e37c0ece None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:51.732936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fb479-fa8f-429b-b3b1-0e14e37c0ece None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:51.766637 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfde33e-2173-4ba2-bb4d-1a69e6806a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:51.767545 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfde33e-2173-4ba2-bb4d-1a69e6806a4c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:51.767826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfde33e-2173-4ba2-bb4d-1a69e6806a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:51.768096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfde33e-2173-4ba2-bb4d-1a69e6806a4c None admin] PATH_INFO: `/v3/projects/41272ca7974246959a474801cbbec5db` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:51.769295 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfde33e-2173-4ba2-bb4d-1a69e6806a4c None admin] RBAC: Authorizing `identity:get_project(project_id=41272ca7974246959a474801cbbec5db)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:51.770820 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfde33e-2173-4ba2-bb4d-1a69e6806a4c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:51.772860 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 529/1071] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:42:51 2022] GET /identity/v3/projects/41272ca7974246959a474801cbbec5db => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:51.779052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27666f-fea3-4fa9-8c46-9ec2e8951ecd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:51.877052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27666f-fea3-4fa9-8c46-9ec2e8951ecd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:51.911837 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0cd8e-a026-4387-bac4-cb706dbfed87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:51.912510 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0cd8e-a026-4387-bac4-cb706dbfed87 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:51.912765 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0cd8e-a026-4387-bac4-cb706dbfed87 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:51.913044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0cd8e-a026-4387-bac4-cb706dbfed87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:51.913988 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0cd8e-a026-4387-bac4-cb706dbfed87 None admin] RBAC: Adding query filter params (role.id=5debd8ad07a74bedbf2efd53b11cd7cd, scope.project.id=41272ca7974246959a474801cbbec5db, user.id=9214ea63b19643ee87e92848f6176b60) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:51.914300 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0cd8e-a026-4387-bac4-cb706dbfed87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:51.915752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0cd8e-a026-4387-bac4-cb706dbfed87 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:51.921565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 543/1072] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:42:51 2022] GET /identity/v3/role_assignments?user.id=9214ea63b19643ee87e92848f6176b60&scope.project.id=41272ca7974246959a474801cbbec5db&role.id=5debd8ad07a74bedbf2efd53b11cd7cd => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:52.883007 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e19cd6-fcae-49ad-8ee3-a432b5033626 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:52.883642 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e19cd6-fcae-49ad-8ee3-a432b5033626 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:52.883642 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e19cd6-fcae-49ad-8ee3-a432b5033626 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:52.885066 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 530/1073] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:52.890271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff19ca3-dc05-44a5-8886-6550e96f75f5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:52.890678 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff19ca3-dc05-44a5-8886-6550e96f75f5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:52.890776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff19ca3-dc05-44a5-8886-6550e96f75f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:52.907706 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-aff19ca3-dc05-44a5-8886-6550e96f75f5 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:52.908873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-aff19ca3-dc05-44a5-8886-6550e96f75f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:52.975051 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 544/1074] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:42:52.997249 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e19cd6-fcae-49ad-8ee3-a432b5033626 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:53.101131 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e19cd6-fcae-49ad-8ee3-a432b5033626 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:53.135191 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8d7d0-50f8-4363-9e4a-1de6b199a957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:53.135772 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8d7d0-50f8-4363-9e4a-1de6b199a957 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:53.136053 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8d7d0-50f8-4363-9e4a-1de6b199a957 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:53.136323 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8d7d0-50f8-4363-9e4a-1de6b199a957 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:53.199815 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8d7d0-50f8-4363-9e4a-1de6b199a957 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:53.201271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8d7d0-50f8-4363-9e4a-1de6b199a957 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:53.314245 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 531/1075] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:42:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:42:53.315678 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff19ca3-dc05-44a5-8886-6550e96f75f5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:53.396395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a3c8e-0c03-4bc1-a9bf-e5ae8368d47e None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:53.396742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a3c8e-0c03-4bc1-a9bf-e5ae8368d47e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:53.396950 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a3c8e-0c03-4bc1-a9bf-e5ae8368d47e None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:53.398367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 532/1076] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:53.403421 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32b9a7-c27f-4bc2-81e8-43f82a3d22a1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:53.403674 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32b9a7-c27f-4bc2-81e8-43f82a3d22a1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:53.403973 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32b9a7-c27f-4bc2-81e8-43f82a3d22a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:53.412940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff19ca3-dc05-44a5-8886-6550e96f75f5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:53.420879 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ee32b9a7-c27f-4bc2-81e8-43f82a3d22a1 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:53.422087 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ee32b9a7-c27f-4bc2-81e8-43f82a3d22a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:53.446251 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88914622-b24d-43fe-97d1-c41e89117ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:53.447215 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88914622-b24d-43fe-97d1-c41e89117ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:53.447498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88914622-b24d-43fe-97d1-c41e89117ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:53.447768 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88914622-b24d-43fe-97d1-c41e89117ad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:53.457580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88914622-b24d-43fe-97d1-c41e89117ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:53.459088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88914622-b24d-43fe-97d1-c41e89117ad0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:53.478124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-88914622-b24d-43fe-97d1-c41e89117ad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:53.478124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:53.478124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:53.478124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:53.478124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:53.478124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:53.478124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:53.478124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:53.478124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:53.478124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:53.478124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:53.478124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:53.478124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:53.478124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:53.478124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:53.479234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:53.479234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:53.479234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:53.479234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:53.479234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:53.479234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:53.479234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:53.479234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:53.479234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:53.479234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:53.479234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:53.479234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:53.479234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:53.479234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:53.479234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:53.479234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:53.479234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:53.480170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:53.480170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:53.480170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:53.480170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:53.485660 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 545/1077] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:53.487106 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88914622-b24d-43fe-97d1-c41e89117ad0 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:53.495775 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 533/1078] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:42:53.518470 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32b9a7-c27f-4bc2-81e8-43f82a3d22a1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:53.582063 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88914622-b24d-43fe-97d1-c41e89117ad0 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:53.611775 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32b9a7-c27f-4bc2-81e8-43f82a3d22a1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:53.616124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa38ae7-e4af-4be7-8506-03932cbd082b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:53.616993 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa38ae7-e4af-4be7-8506-03932cbd082b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:53.617445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa38ae7-e4af-4be7-8506-03932cbd082b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:53.617888 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa38ae7-e4af-4be7-8506-03932cbd082b None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:53.618780 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa38ae7-e4af-4be7-8506-03932cbd082b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:53.619297 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa38ae7-e4af-4be7-8506-03932cbd082b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:53.620853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa38ae7-e4af-4be7-8506-03932cbd082b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:53.632129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 546/1079] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:53.659369 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60552c-34fe-4e5e-9756-df8b5ad97966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:53.660631 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60552c-34fe-4e5e-9756-df8b5ad97966 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:53.661134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60552c-34fe-4e5e-9756-df8b5ad97966 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:53.661592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60552c-34fe-4e5e-9756-df8b5ad97966 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:53.675608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60552c-34fe-4e5e-9756-df8b5ad97966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:42:53.684480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-9f60552c-34fe-4e5e-9756-df8b5ad97966 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:42:53.684480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:53.684480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:53.684480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:53.684480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:53.684480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:53.684480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:53.684480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:53.684480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:53.684480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:53.684480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:53.684480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:53.684480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:42:53.684480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:42:53.684480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:42:53.684480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:42:53.685529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:42:53.685529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:42:53.685529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:42:53.685529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:42:53.685529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:53.685529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:53.685529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:53.685529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:53.685529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:53.685529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:53.685529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:53.685529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:53.685529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:53.685529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:53.685529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:53.685529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:53.686474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:53.686474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:53.686474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:53.686474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:53.686474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:42:53.686474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:42:53.686474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:42:53.686474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:42:53.686474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:42:53.686474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:42:53.686474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:42:53.686474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:53.693865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 534/1080] 10.222.0.77 () {56 vars in 1120 bytes} [Wed May 11 06:42:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:42:53.695574 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa38ae7-e4af-4be7-8506-03932cbd082b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:53.822514 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa38ae7-e4af-4be7-8506-03932cbd082b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:53.861994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77969c13-5081-462b-b1a3-6dd2ebb5949f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:53.862841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77969c13-5081-462b-b1a3-6dd2ebb5949f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:53.863144 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77969c13-5081-462b-b1a3-6dd2ebb5949f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:53.863450 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77969c13-5081-462b-b1a3-6dd2ebb5949f None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:53.864348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77969c13-5081-462b-b1a3-6dd2ebb5949f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:53.864650 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77969c13-5081-462b-b1a3-6dd2ebb5949f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:53.865998 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77969c13-5081-462b-b1a3-6dd2ebb5949f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:53.874947 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 547/1081] 10.222.0.77 () {56 vars in 1115 bytes} [Wed May 11 06:42:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:53.882434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60552c-34fe-4e5e-9756-df8b5ad97966 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:53.993943 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60552c-34fe-4e5e-9756-df8b5ad97966 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:54.025259 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcbf3e-f0b9-4d25-a45c-06ddaeac33b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:54.026025 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcbf3e-f0b9-4d25-a45c-06ddaeac33b8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:54.026298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcbf3e-f0b9-4d25-a45c-06ddaeac33b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:54.026567 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcbf3e-f0b9-4d25-a45c-06ddaeac33b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:54.037290 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcbf3e-f0b9-4d25-a45c-06ddaeac33b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:54.038734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcbf3e-f0b9-4d25-a45c-06ddaeac33b8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:54.055878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-5cfcbf3e-f0b9-4d25-a45c-06ddaeac33b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:54.055878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:54.055878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:54.055878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:54.055878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:54.055878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:54.055878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:54.055878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:54.055878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:54.055878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:54.055878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:54.055878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:54.055878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:54.055878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:54.055878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:54.056851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:54.056851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:54.056851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:54.056851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:54.056851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:54.056851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:54.056851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:54.056851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:54.056851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:54.056851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:54.056851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:54.056851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:54.056851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:54.056851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:54.056851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:54.056851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:54.056851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:54.057996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:54.057996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:54.057996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:54.057996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:54.057996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 535/1082] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:54.062986 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77969c13-5081-462b-b1a3-6dd2ebb5949f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:54.149651 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdbcfe-09d4-459f-822b-8f3ce2f367cc None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:54.149930 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdbcfe-09d4-459f-822b-8f3ce2f367cc None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:54.150199 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdbcfe-09d4-459f-822b-8f3ce2f367cc None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:54.151599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 536/1083] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:54.157049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c57f06-789f-4fa8-a48c-f3adfa0f6031 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:54.157331 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c57f06-789f-4fa8-a48c-f3adfa0f6031 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:54.157603 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c57f06-789f-4fa8-a48c-f3adfa0f6031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:54.166727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77969c13-5081-462b-b1a3-6dd2ebb5949f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:54.176411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f8c57f06-789f-4fa8-a48c-f3adfa0f6031 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:54.177703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f8c57f06-789f-4fa8-a48c-f3adfa0f6031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:54.201884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6891e-05f6-46e2-b8b0-2e3ab387178a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:54.202574 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6891e-05f6-46e2-b8b0-2e3ab387178a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:54.202854 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6891e-05f6-46e2-b8b0-2e3ab387178a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:54.203184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6891e-05f6-46e2-b8b0-2e3ab387178a None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:54.203947 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6891e-05f6-46e2-b8b0-2e3ab387178a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:54.204250 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6891e-05f6-46e2-b8b0-2e3ab387178a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:54.205677 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6891e-05f6-46e2-b8b0-2e3ab387178a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:54.219832 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 548/1084] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:54.225537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6891e-05f6-46e2-b8b0-2e3ab387178a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:54.256148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 537/1085] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:42:54.278928 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c57f06-789f-4fa8-a48c-f3adfa0f6031 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:54.337406 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6891e-05f6-46e2-b8b0-2e3ab387178a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:54.373031 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6605417-071a-4174-a25f-86e64fa5203c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:54.373828 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6605417-071a-4174-a25f-86e64fa5203c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:54.373935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c57f06-789f-4fa8-a48c-f3adfa0f6031 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:54.374175 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6605417-071a-4174-a25f-86e64fa5203c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:54.374450 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6605417-071a-4174-a25f-86e64fa5203c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:54.381853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6605417-071a-4174-a25f-86e64fa5203c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:54.383513 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6605417-071a-4174-a25f-86e64fa5203c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:54.401048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c6605417-071a-4174-a25f-86e64fa5203c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 06:42:54.401048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:54.401048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:54.401048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:54.401048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:54.401048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:54.401048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:54.401048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:54.401048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:54.401048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:54.401048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:54.401048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:54.401048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:42:54.401048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:42:54.401048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:42:54.401048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:42:54.402184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:54.402184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:54.402184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:42:54.402184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:54.402184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:42:54.402184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:42:54.402184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:54.402184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:54.402184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:54.402184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:54.402184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:54.402184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:54.402184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:54.402184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:54.402184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:54.402184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:54.402184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:54.402184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:54.403223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:54.403223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:54.403223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:42:54.403223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:42:54.403223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:42:54.403223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:42:54.403223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:42:54.403223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:42:54.403223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 06:42:54.403223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:54.403223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 549/1086] 10.222.0.77 () {56 vars in 1093 bytes} [Wed May 11 06:42:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:54.409139 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6605417-071a-4174-a25f-86e64fa5203c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:54.409859 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b705d5-19fa-4f52-9d24-99b47401f073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:54.410833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b705d5-19fa-4f52-9d24-99b47401f073 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:54.411146 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b705d5-19fa-4f52-9d24-99b47401f073 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:54.411389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b705d5-19fa-4f52-9d24-99b47401f073 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:54.423986 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b705d5-19fa-4f52-9d24-99b47401f073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:42:54.431555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-d1b705d5-19fa-4f52-9d24-99b47401f073 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:42:54.431555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:54.431555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:54.431555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:54.431555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:54.431555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:54.431555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:54.431555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:54.431555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:54.431555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:54.431555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:54.431555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:54.431555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:42:54.431555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:42:54.431555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:42:54.431555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:42:54.432695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:42:54.432695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:42:54.432695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:42:54.432695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:42:54.432695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:54.432695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:54.432695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:54.432695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:54.432695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:54.432695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:54.432695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:54.432695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:54.432695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:54.432695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:54.432695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:54.432695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:54.433569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:54.433569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:54.433569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:54.433569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:54.433569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:42:54.433569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:42:54.433569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:42:54.433569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:42:54.433569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:42:54.433569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:42:54.433569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:42:54.433569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:54.433569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 538/1087] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:42:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:54.440092 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b705d5-19fa-4f52-9d24-99b47401f073 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:54.521113 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6605417-071a-4174-a25f-86e64fa5203c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:54.542401 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b705d5-19fa-4f52-9d24-99b47401f073 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:54.559762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623f989-7a56-43c1-a4c7-cd24b72f670f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:54.560442 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623f989-7a56-43c1-a4c7-cd24b72f670f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:54.560727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623f989-7a56-43c1-a4c7-cd24b72f670f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:54.561001 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623f989-7a56-43c1-a4c7-cd24b72f670f None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:54.561849 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623f989-7a56-43c1-a4c7-cd24b72f670f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:54.562162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623f989-7a56-43c1-a4c7-cd24b72f670f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:54.563640 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623f989-7a56-43c1-a4c7-cd24b72f670f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:54.576882 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd147f2-0b44-4f01-ad57-d2c17a0dd6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:54.577545 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd147f2-0b44-4f01-ad57-d2c17a0dd6fd None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:54.578277 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd147f2-0b44-4f01-ad57-d2c17a0dd6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:54.578556 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd147f2-0b44-4f01-ad57-d2c17a0dd6fd None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:54.579299 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd147f2-0b44-4f01-ad57-d2c17a0dd6fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:54.579601 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd147f2-0b44-4f01-ad57-d2c17a0dd6fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:54.580955 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd147f2-0b44-4f01-ad57-d2c17a0dd6fd None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:54.585858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 550/1088] 10.222.0.77 () {56 vars in 1133 bytes} [Wed May 11 06:42:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:54.586879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623f989-7a56-43c1-a4c7-cd24b72f670f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:54.589171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 539/1089] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:42:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:54.594759 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd147f2-0b44-4f01-ad57-d2c17a0dd6fd None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:54.683360 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623f989-7a56-43c1-a4c7-cd24b72f670f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:54.686378 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd147f2-0b44-4f01-ad57-d2c17a0dd6fd None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:54.715125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b24fe-4773-4648-b4b9-f27084067de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:54.715773 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b24fe-4773-4648-b4b9-f27084067de5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:54.716083 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b24fe-4773-4648-b4b9-f27084067de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:54.716351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b24fe-4773-4648-b4b9-f27084067de5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:54.721357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa2878-b7fc-4f52-9a70-76fe640f42a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:54.722221 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa2878-b7fc-4f52-9a70-76fe640f42a6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:54.722495 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa2878-b7fc-4f52-9a70-76fe640f42a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:54.722874 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa2878-b7fc-4f52-9a70-76fe640f42a6 None admin] PATH_INFO: `/v3/users/9214ea63b19643ee87e92848f6176b60` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:54.724130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa2878-b7fc-4f52-9a70-76fe640f42a6 None admin] RBAC: Authorizing `identity:get_user(user_id=9214ea63b19643ee87e92848f6176b60)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:54.725581 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa2878-b7fc-4f52-9a70-76fe640f42a6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:54.727250 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 540/1090] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:42:54 2022] GET /identity/v3/users/9214ea63b19643ee87e92848f6176b60 => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:54.732881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa2878-b7fc-4f52-9a70-76fe640f42a6 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:54.780603 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b24fe-4773-4648-b4b9-f27084067de5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:54.781976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b24fe-4773-4648-b4b9-f27084067de5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:54.825538 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa2878-b7fc-4f52-9a70-76fe640f42a6 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:54.857489 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bba740-e076-4fee-bba6-95cdba80a51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:54.858359 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bba740-e076-4fee-bba6-95cdba80a51c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:54.858644 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bba740-e076-4fee-bba6-95cdba80a51c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:54.858922 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bba740-e076-4fee-bba6-95cdba80a51c None admin] PATH_INFO: `/v3/projects/41272ca7974246959a474801cbbec5db` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:54.860177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bba740-e076-4fee-bba6-95cdba80a51c None admin] RBAC: Authorizing `identity:get_project(project_id=41272ca7974246959a474801cbbec5db)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:54.861645 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bba740-e076-4fee-bba6-95cdba80a51c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:54.863478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 541/1091] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:42:54 2022] GET /identity/v3/projects/41272ca7974246959a474801cbbec5db => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:42:54.869419 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bba740-e076-4fee-bba6-95cdba80a51c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:54.877481 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 551/1092] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:42:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:42:54.883124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b24fe-4773-4648-b4b9-f27084067de5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:54.967602 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bba740-e076-4fee-bba6-95cdba80a51c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:54.980268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b24fe-4773-4648-b4b9-f27084067de5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:55.002441 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac0a0f-1269-46d7-b07d-14d7ea412d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:55.003360 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac0a0f-1269-46d7-b07d-14d7ea412d30 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:55.003640 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac0a0f-1269-46d7-b07d-14d7ea412d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:55.003974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac0a0f-1269-46d7-b07d-14d7ea412d30 None admin] PATH_INFO: `/v3/projects/41272ca7974246959a474801cbbec5db/users/9214ea63b19643ee87e92848f6176b60/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:55.006010 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac0a0f-1269-46d7-b07d-14d7ea412d30 None admin] RBAC: Authorizing `identity:create_grant(project_id=41272ca7974246959a474801cbbec5db, user_id=9214ea63b19643ee87e92848f6176b60, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:55.007475 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac0a0f-1269-46d7-b07d-14d7ea412d30 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:55.015233 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee679bf-60e8-4f89-b59f-2d2679c753b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:55.016045 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee679bf-60e8-4f89-b59f-2d2679c753b2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:55.016328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee679bf-60e8-4f89-b59f-2d2679c753b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:55.016604 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee679bf-60e8-4f89-b59f-2d2679c753b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:55.021743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 542/1093] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:42:54 2022] PUT /identity/v3/projects/41272ca7974246959a474801cbbec5db/users/9214ea63b19643ee87e92848f6176b60/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:42:55.026825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee679bf-60e8-4f89-b59f-2d2679c753b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:55.028342 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee679bf-60e8-4f89-b59f-2d2679c753b2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:55.049299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-fee679bf-60e8-4f89-b59f-2d2679c753b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:55.049299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:55.049299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:55.049299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:55.049299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:55.049299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:55.049299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:55.049299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:55.049299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:55.049299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:55.049299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:55.049299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:55.049299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:42:55.049299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:42:55.049299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:42:55.050368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:42:55.050368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:55.050368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:55.050368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:55.050368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:55.050368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:55.050368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:55.050368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:55.050368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:55.050368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:55.050368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:55.050368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:55.050368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:55.050368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:55.050368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:55.050368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:55.050368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:55.051444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:42:55.051444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:42:55.051444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:42:55.051444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:55.051444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 552/1094] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:55.056620 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac0a0f-1269-46d7-b07d-14d7ea412d30 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:55.160828 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac0a0f-1269-46d7-b07d-14d7ea412d30 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:55.196988 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42263e4f-5114-44d7-a36d-0521d511d2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:55.198687 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42263e4f-5114-44d7-a36d-0521d511d2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:55.198687 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42263e4f-5114-44d7-a36d-0521d511d2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:55.198687 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42263e4f-5114-44d7-a36d-0521d511d2a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:55.201519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42263e4f-5114-44d7-a36d-0521d511d2a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:55.201519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42263e4f-5114-44d7-a36d-0521d511d2a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:55.201519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42263e4f-5114-44d7-a36d-0521d511d2a8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:55.213426 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 543/1095] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:55.219205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee679bf-60e8-4f89-b59f-2d2679c753b2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:55.319614 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee679bf-60e8-4f89-b59f-2d2679c753b2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:55.353417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33319ee-70de-4a62-9a0c-d9183ce7e048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:55.354209 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33319ee-70de-4a62-9a0c-d9183ce7e048 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:55.354496 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33319ee-70de-4a62-9a0c-d9183ce7e048 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:55.354771 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33319ee-70de-4a62-9a0c-d9183ce7e048 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:55.361434 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33319ee-70de-4a62-9a0c-d9183ce7e048 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:55.362884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33319ee-70de-4a62-9a0c-d9183ce7e048 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:55.376394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b33319ee-70de-4a62-9a0c-d9183ce7e048 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:55.376394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:55.376394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:55.376394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:55.376394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:55.376394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:55.376394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:55.376394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:55.376394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:55.376394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:55.376394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:55.376394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:55.376394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:42:55.376394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:42:55.376394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:42:55.377341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:42:55.377341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:55.377341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:55.377341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:55.377341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:55.377341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:55.377341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:55.377341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:55.377341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:42:55.377341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:55.377341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:55.377341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:55.377341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:55.377341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:55.377341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:55.377341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:55.377341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:55.378253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:42:55.378253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:42:55.378253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:42:55.378253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:42:55.378253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:42:55.378253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:42:55.378253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:42:55.378253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:42:55.378253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 553/1096] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:42:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:55.383808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42263e4f-5114-44d7-a36d-0521d511d2a8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:55.482182 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42263e4f-5114-44d7-a36d-0521d511d2a8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:55.522777 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a2184-0ae4-48c5-ac0a-bb2e4e0c4b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:55.523475 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a2184-0ae4-48c5-ac0a-bb2e4e0c4b7f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:55.523755 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a2184-0ae4-48c5-ac0a-bb2e4e0c4b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:55.524019 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a2184-0ae4-48c5-ac0a-bb2e4e0c4b7f None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:55.524805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a2184-0ae4-48c5-ac0a-bb2e4e0c4b7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:55.525114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a2184-0ae4-48c5-ac0a-bb2e4e0c4b7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:55.526540 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a2184-0ae4-48c5-ac0a-bb2e4e0c4b7f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:55.538391 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 544/1097] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:42:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:55.544718 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33319ee-70de-4a62-9a0c-d9183ce7e048 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:55.645227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33319ee-70de-4a62-9a0c-d9183ce7e048 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:55.682915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83972b4d-6ac9-49be-822f-294b70404658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:55.683799 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83972b4d-6ac9-49be-822f-294b70404658 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:55.684080 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83972b4d-6ac9-49be-822f-294b70404658 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:55.684353 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83972b4d-6ac9-49be-822f-294b70404658 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:55.685194 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83972b4d-6ac9-49be-822f-294b70404658 None admin] RBAC: Adding query filter params (role.id=4e9d3c690fdb4f48878128cd834eb431, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=edf9d57de89a4701ba1a5b079d0ad348) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:55.685504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83972b4d-6ac9-49be-822f-294b70404658 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:55.686942 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83972b4d-6ac9-49be-822f-294b70404658 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:55.693382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 554/1098] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:42:55 2022] GET /identity/v3/role_assignments?user.id=edf9d57de89a4701ba1a5b079d0ad348&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=4e9d3c690fdb4f48878128cd834eb431 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:57.212598 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57cee3-aaa7-4fa4-9713-f02f50b9bd7d None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:57.213447 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57cee3-aaa7-4fa4-9713-f02f50b9bd7d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:57.213447 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57cee3-aaa7-4fa4-9713-f02f50b9bd7d None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:57.215615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 545/1099] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:42:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:57.223703 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd7c66-0a19-4f19-a9bf-90a1568a4d0b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:57.224163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd7c66-0a19-4f19-a9bf-90a1568a4d0b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:57.224256 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd7c66-0a19-4f19-a9bf-90a1568a4d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:57.242449 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ebbd7c66-0a19-4f19-a9bf-90a1568a4d0b None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:57.243663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ebbd7c66-0a19-4f19-a9bf-90a1568a4d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:57.311720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 555/1100] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:42:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:42:57.335536 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57cee3-aaa7-4fa4-9713-f02f50b9bd7d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:57.437239 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57cee3-aaa7-4fa4-9713-f02f50b9bd7d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:57.470446 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40412389-b212-4be7-a07e-8a1b2993b65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:57.471205 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40412389-b212-4be7-a07e-8a1b2993b65c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:57.471482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40412389-b212-4be7-a07e-8a1b2993b65c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:57.471748 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40412389-b212-4be7-a07e-8a1b2993b65c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:57.481372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40412389-b212-4be7-a07e-8a1b2993b65c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:42:57.488898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-40412389-b212-4be7-a07e-8a1b2993b65c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:42:57.488898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:42:57.488898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:42:57.488898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:42:57.488898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:42:57.488898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:42:57.488898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:42:57.488898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:42:57.488898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:42:57.488898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:42:57.488898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:42:57.488898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:42:57.488898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:42:57.488898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:42:57.488898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:42:57.488898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:42:57.489972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:42:57.489972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:42:57.489972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:42:57.489972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:42:57.489972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:42:57.489972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:42:57.489972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:42:57.489972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:42:57.489972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:42:57.489972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:42:57.489972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:42:57.489972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:42:57.489972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:42:57.489972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:42:57.489972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:42:57.489972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:42:57.491036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:42:57.491036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:42:57.491036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:42:57.491036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:42:57.491036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:42:57.491036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:42:57.491036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:42:57.491036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:42:57.491036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:42:57.491036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:42:57.491036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:42:57.491036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:42:57.491036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 546/1101] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:42:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:42:57.498283 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd7c66-0a19-4f19-a9bf-90a1568a4d0b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:57.601807 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd7c66-0a19-4f19-a9bf-90a1568a4d0b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:57.645384 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a670ac1-ed23-4312-b010-f0c04be8de57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:57.646044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a670ac1-ed23-4312-b010-f0c04be8de57 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:57.646324 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a670ac1-ed23-4312-b010-f0c04be8de57 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:57.646599 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a670ac1-ed23-4312-b010-f0c04be8de57 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:57.647384 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a670ac1-ed23-4312-b010-f0c04be8de57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:57.647694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a670ac1-ed23-4312-b010-f0c04be8de57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:57.649055 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a670ac1-ed23-4312-b010-f0c04be8de57 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:57.657837 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 556/1102] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:42:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:57.664069 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40412389-b212-4be7-a07e-8a1b2993b65c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:57.763005 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40412389-b212-4be7-a07e-8a1b2993b65c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:57.798418 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94895068-33bc-480a-8463-9603f6634fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:57.799313 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94895068-33bc-480a-8463-9603f6634fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:57.799593 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94895068-33bc-480a-8463-9603f6634fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:57.799865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94895068-33bc-480a-8463-9603f6634fe6 None admin] PATH_INFO: `/v3/users/9214ea63b19643ee87e92848f6176b60` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:57.801239 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94895068-33bc-480a-8463-9603f6634fe6 None admin] RBAC: Authorizing `identity:get_user(user_id=9214ea63b19643ee87e92848f6176b60)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:57.802680 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94895068-33bc-480a-8463-9603f6634fe6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:57.804344 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 547/1103] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:42:57 2022] GET /identity/v3/users/9214ea63b19643ee87e92848f6176b60 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:57.810830 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a670ac1-ed23-4312-b010-f0c04be8de57 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:57.939465 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a670ac1-ed23-4312-b010-f0c04be8de57 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:57.974915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8aea6-a421-486b-94d9-95fb820812c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:57.975586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8aea6-a421-486b-94d9-95fb820812c2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:57.975861 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8aea6-a421-486b-94d9-95fb820812c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:57.976118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8aea6-a421-486b-94d9-95fb820812c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:58.044357 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d8aea6-a421-486b-94d9-95fb820812c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:58.046576 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d8aea6-a421-486b-94d9-95fb820812c2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:58.150275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 557/1104] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:42:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:42:58.156460 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94895068-33bc-480a-8463-9603f6634fe6 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:58.268367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94895068-33bc-480a-8463-9603f6634fe6 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:58.301549 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8f547-85cc-49fe-b188-d21c382fa6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:58.302344 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8f547-85cc-49fe-b188-d21c382fa6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:58.302620 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8f547-85cc-49fe-b188-d21c382fa6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:58.302902 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8f547-85cc-49fe-b188-d21c382fa6f4 None admin] PATH_INFO: `/v3/projects/41272ca7974246959a474801cbbec5db` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:58.304151 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8f547-85cc-49fe-b188-d21c382fa6f4 None admin] RBAC: Authorizing `identity:get_project(project_id=41272ca7974246959a474801cbbec5db)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:58.305599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8f547-85cc-49fe-b188-d21c382fa6f4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:58.307316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 548/1105] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:42:58 2022] GET /identity/v3/projects/41272ca7974246959a474801cbbec5db => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:58.313526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8aea6-a421-486b-94d9-95fb820812c2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:58.410536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8aea6-a421-486b-94d9-95fb820812c2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:58.445354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1414c77-7038-44c5-97e9-72ab310d2a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:58.445998 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1414c77-7038-44c5-97e9-72ab310d2a9b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:58.446277 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1414c77-7038-44c5-97e9-72ab310d2a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:58.446548 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1414c77-7038-44c5-97e9-72ab310d2a9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:58.447401 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1414c77-7038-44c5-97e9-72ab310d2a9b None admin] RBAC: Adding query filter params (role.id=5debd8ad07a74bedbf2efd53b11cd7cd, scope.project.id=41272ca7974246959a474801cbbec5db, user.id=9214ea63b19643ee87e92848f6176b60) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:58.447711 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1414c77-7038-44c5-97e9-72ab310d2a9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:58.449130 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1414c77-7038-44c5-97e9-72ab310d2a9b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:58.455099 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 558/1106] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:42:58 2022] GET /identity/v3/role_assignments?user.id=9214ea63b19643ee87e92848f6176b60&scope.project.id=41272ca7974246959a474801cbbec5db&role.id=5debd8ad07a74bedbf2efd53b11cd7cd => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:00.671401 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90653f0-3830-4c02-a7a6-dc231e999a90 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:00.672304 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90653f0-3830-4c02-a7a6-dc231e999a90 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:00.672304 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90653f0-3830-4c02-a7a6-dc231e999a90 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:00.674370 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 549/1107] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:43:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:43:00.680875 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f298c-68b0-4a76-9c96-17bc0617a831 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:00.681618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f298c-68b0-4a76-9c96-17bc0617a831 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:00.681760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f298c-68b0-4a76-9c96-17bc0617a831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:00.703517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bd4f298c-68b0-4a76-9c96-17bc0617a831 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:43:00.704716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bd4f298c-68b0-4a76-9c96-17bc0617a831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:43:00.776843 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 559/1108] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:43:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:43:00.811357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90653f0-3830-4c02-a7a6-dc231e999a90 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:00.934373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90653f0-3830-4c02-a7a6-dc231e999a90 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:00.968374 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bbfb7-d39f-41c5-a7c0-b6274fe5c544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:00.969156 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bbfb7-d39f-41c5-a7c0-b6274fe5c544 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:00.969431 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bbfb7-d39f-41c5-a7c0-b6274fe5c544 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:00.969704 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bbfb7-d39f-41c5-a7c0-b6274fe5c544 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:00.971042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941bbfb7-d39f-41c5-a7c0-b6274fe5c544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:00.972510 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941bbfb7-d39f-41c5-a7c0-b6274fe5c544 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:00.974117 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 550/1109] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:43:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:00.980069 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f298c-68b0-4a76-9c96-17bc0617a831 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:01.082808 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f298c-68b0-4a76-9c96-17bc0617a831 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:01.117459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67168891-c892-44b5-aafa-765718fb96ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:01.118118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67168891-c892-44b5-aafa-765718fb96ae None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:01.118396 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67168891-c892-44b5-aafa-765718fb96ae None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:01.118669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67168891-c892-44b5-aafa-765718fb96ae None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:01.119421 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67168891-c892-44b5-aafa-765718fb96ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:01.120860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67168891-c892-44b5-aafa-765718fb96ae None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:01.148506 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 560/1110] 10.222.0.77 () {60 vars in 1132 bytes} [Wed May 11 06:43:00 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:43:03.393004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0272721-dcd5-4ae4-91e3-9e11cfc0af9f None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:03.393541 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0272721-dcd5-4ae4-91e3-9e11cfc0af9f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:03.393541 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0272721-dcd5-4ae4-91e3-9e11cfc0af9f None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:03.394946 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 551/1111] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:43:03.401455 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80761107-48f9-4aea-90b7-a4942fcb331b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:03.402217 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80761107-48f9-4aea-90b7-a4942fcb331b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:03.402361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80761107-48f9-4aea-90b7-a4942fcb331b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:03.424297 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-80761107-48f9-4aea-90b7-a4942fcb331b None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:43:03.425492 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-80761107-48f9-4aea-90b7-a4942fcb331b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:43:03.496279 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 561/1112] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:43:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:43:03.520603 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0272721-dcd5-4ae4-91e3-9e11cfc0af9f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:03.635675 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0272721-dcd5-4ae4-91e3-9e11cfc0af9f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:03.669457 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be11c6b-6987-4189-919d-cd028ecf2dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:03.670301 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be11c6b-6987-4189-919d-cd028ecf2dcf None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:03.670583 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be11c6b-6987-4189-919d-cd028ecf2dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:03.670851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be11c6b-6987-4189-919d-cd028ecf2dcf None admin] PATH_INFO: `/v3/roles/ae6b211774c34f47a3ac4853538f62ad` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:03.672530 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be11c6b-6987-4189-919d-cd028ecf2dcf None admin] RBAC: Authorizing `identity:get_role(role_id=ae6b211774c34f47a3ac4853538f62ad)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:03.673912 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be11c6b-6987-4189-919d-cd028ecf2dcf None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:03.675355 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 552/1113] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:43:03 2022] GET /identity/v3/roles/ae6b211774c34f47a3ac4853538f62ad => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:03.682125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80761107-48f9-4aea-90b7-a4942fcb331b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:03.792513 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80761107-48f9-4aea-90b7-a4942fcb331b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:03.826849 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c2d02-f2d4-42ab-88fc-46547c946f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:03.827823 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c2d02-f2d4-42ab-88fc-46547c946f8f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:03.828103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c2d02-f2d4-42ab-88fc-46547c946f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:03.828420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c2d02-f2d4-42ab-88fc-46547c946f8f None admin] PATH_INFO: `/v3/users/c1460f07fd67407b80d2b3ea4de0767c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:03.843424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c2d02-f2d4-42ab-88fc-46547c946f8f None admin] RBAC: Authorizing `identity:get_user(user_id=c1460f07fd67407b80d2b3ea4de0767c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:03.844874 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c2d02-f2d4-42ab-88fc-46547c946f8f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:03.846508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 562/1114] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:43:03 2022] GET /identity/v3/users/c1460f07fd67407b80d2b3ea4de0767c => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:03.853274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be11c6b-6987-4189-919d-cd028ecf2dcf None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:03.966424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be11c6b-6987-4189-919d-cd028ecf2dcf None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:04.000072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7bc00-0580-4eb4-acfa-678bebe8ed3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:04.000710 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7bc00-0580-4eb4-acfa-678bebe8ed3d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:04.000986 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7bc00-0580-4eb4-acfa-678bebe8ed3d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:04.001254 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7bc00-0580-4eb4-acfa-678bebe8ed3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:04.065691 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7bc00-0580-4eb4-acfa-678bebe8ed3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:04.067177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7bc00-0580-4eb4-acfa-678bebe8ed3d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:04.161102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 553/1115] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:43:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:43:04.168078 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c2d02-f2d4-42ab-88fc-46547c946f8f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:04.279727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c2d02-f2d4-42ab-88fc-46547c946f8f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:04.314011 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fa833-7cfe-44e4-99fb-32a6ea624f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:04.314887 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fa833-7cfe-44e4-99fb-32a6ea624f9a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:04.315185 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fa833-7cfe-44e4-99fb-32a6ea624f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:04.315455 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fa833-7cfe-44e4-99fb-32a6ea624f9a None admin] PATH_INFO: `/v3/projects/41272ca7974246959a474801cbbec5db` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:04.316727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4fa833-7cfe-44e4-99fb-32a6ea624f9a None admin] RBAC: Authorizing `identity:get_project(project_id=41272ca7974246959a474801cbbec5db)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:04.318251 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4fa833-7cfe-44e4-99fb-32a6ea624f9a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:04.320341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 563/1116] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:43:04 2022] GET /identity/v3/projects/41272ca7974246959a474801cbbec5db => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:04.330074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7bc00-0580-4eb4-acfa-678bebe8ed3d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:04.429461 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7bc00-0580-4eb4-acfa-678bebe8ed3d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:04.463417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8f26e-f2a5-418b-937e-c49f38f1e9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:04.464053 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8f26e-f2a5-418b-937e-c49f38f1e9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:04.464334 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8f26e-f2a5-418b-937e-c49f38f1e9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:04.464600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8f26e-f2a5-418b-937e-c49f38f1e9d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:04.465428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8f26e-f2a5-418b-937e-c49f38f1e9d3 None admin] RBAC: Adding query filter params (role.id=ae6b211774c34f47a3ac4853538f62ad, scope.project.id=41272ca7974246959a474801cbbec5db, user.id=c1460f07fd67407b80d2b3ea4de0767c) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:43:04.465735 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8f26e-f2a5-418b-937e-c49f38f1e9d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:04.467183 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8f26e-f2a5-418b-937e-c49f38f1e9d3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:04.472660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 554/1117] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:43:04 2022] GET /identity/v3/role_assignments?user.id=c1460f07fd67407b80d2b3ea4de0767c&scope.project.id=41272ca7974246959a474801cbbec5db&role.id=ae6b211774c34f47a3ac4853538f62ad => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:06.655964 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e98fb-98c9-4752-8f10-ea73b2ddc919 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:06.656831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e98fb-98c9-4752-8f10-ea73b2ddc919 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:06.656831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e98fb-98c9-4752-8f10-ea73b2ddc919 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:06.659086 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 564/1118] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:43:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:43:06.667437 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26150c-c010-4783-813d-4fde2e452386 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:06.667889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26150c-c010-4783-813d-4fde2e452386 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:06.667983 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26150c-c010-4783-813d-4fde2e452386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:06.693810 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ce26150c-c010-4783-813d-4fde2e452386 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:43:06.695559 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ce26150c-c010-4783-813d-4fde2e452386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:43:06.760559 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 555/1119] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:43:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:43:06.787162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e98fb-98c9-4752-8f10-ea73b2ddc919 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:06.892577 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e98fb-98c9-4752-8f10-ea73b2ddc919 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:06.926437 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6683c-6c63-47f2-a12a-3437fad92465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:06.927258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6683c-6c63-47f2-a12a-3437fad92465 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:06.927540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6683c-6c63-47f2-a12a-3437fad92465 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:06.927817 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6683c-6c63-47f2-a12a-3437fad92465 None admin] PATH_INFO: `/v3/roles/ae6b211774c34f47a3ac4853538f62ad` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:06.929328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6683c-6c63-47f2-a12a-3437fad92465 None admin] RBAC: Authorizing `identity:get_role(role_id=ae6b211774c34f47a3ac4853538f62ad)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:06.930710 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6683c-6c63-47f2-a12a-3437fad92465 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:06.932131 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 565/1120] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:43:06 2022] GET /identity/v3/roles/ae6b211774c34f47a3ac4853538f62ad => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:06.938851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26150c-c010-4783-813d-4fde2e452386 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:07.049813 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26150c-c010-4783-813d-4fde2e452386 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:07.084273 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f61954-d452-4a7c-a59c-abf6b52fb0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:07.085128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f61954-d452-4a7c-a59c-abf6b52fb0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:07.085397 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f61954-d452-4a7c-a59c-abf6b52fb0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:07.085659 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f61954-d452-4a7c-a59c-abf6b52fb0a9 None admin] PATH_INFO: `/v3/users/c1460f07fd67407b80d2b3ea4de0767c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:07.086999 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f61954-d452-4a7c-a59c-abf6b52fb0a9 None admin] RBAC: Authorizing `identity:get_user(user_id=c1460f07fd67407b80d2b3ea4de0767c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:07.088423 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f61954-d452-4a7c-a59c-abf6b52fb0a9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:07.090029 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 556/1121] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:43:06 2022] GET /identity/v3/users/c1460f07fd67407b80d2b3ea4de0767c => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:07.099170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6683c-6c63-47f2-a12a-3437fad92465 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:07.204460 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6683c-6c63-47f2-a12a-3437fad92465 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:07.238205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f55037-afdc-464a-807b-f2c96a23c1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:07.239119 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f55037-afdc-464a-807b-f2c96a23c1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:07.239402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f55037-afdc-464a-807b-f2c96a23c1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:07.239672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f55037-afdc-464a-807b-f2c96a23c1c5 None admin] PATH_INFO: `/v3/projects/41272ca7974246959a474801cbbec5db` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:07.240964 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f55037-afdc-464a-807b-f2c96a23c1c5 None admin] RBAC: Authorizing `identity:get_project(project_id=41272ca7974246959a474801cbbec5db)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:07.242394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f55037-afdc-464a-807b-f2c96a23c1c5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:07.244097 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 566/1122] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:43:07 2022] GET /identity/v3/projects/41272ca7974246959a474801cbbec5db => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:07.250230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f61954-d452-4a7c-a59c-abf6b52fb0a9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:07.357681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f61954-d452-4a7c-a59c-abf6b52fb0a9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:07.400905 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dce7b-875a-4479-8845-763bb2a00e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:07.401787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dce7b-875a-4479-8845-763bb2a00e00 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:07.402068 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dce7b-875a-4479-8845-763bb2a00e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:07.402337 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dce7b-875a-4479-8845-763bb2a00e00 None admin] PATH_INFO: `/v3/projects/41272ca7974246959a474801cbbec5db/users/c1460f07fd67407b80d2b3ea4de0767c/roles/ae6b211774c34f47a3ac4853538f62ad` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:07.404954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964dce7b-875a-4479-8845-763bb2a00e00 None admin] RBAC: Authorizing `identity:create_grant(project_id=41272ca7974246959a474801cbbec5db, user_id=c1460f07fd67407b80d2b3ea4de0767c, role_id=ae6b211774c34f47a3ac4853538f62ad)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:07.406386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964dce7b-875a-4479-8845-763bb2a00e00 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:07.422926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 557/1123] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:43:07 2022] PUT /identity/v3/projects/41272ca7974246959a474801cbbec5db/users/c1460f07fd67407b80d2b3ea4de0767c/roles/ae6b211774c34f47a3ac4853538f62ad => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:43:09.595294 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d536b-71a9-4f3a-82fd-f6f3ebd56e8a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:09.596150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d536b-71a9-4f3a-82fd-f6f3ebd56e8a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:09.596150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d536b-71a9-4f3a-82fd-f6f3ebd56e8a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:09.598259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 567/1124] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:43:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:43:09.606744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0296885-63eb-4d50-a02a-5e7fec276960 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:09.607502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0296885-63eb-4d50-a02a-5e7fec276960 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:09.607682 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0296885-63eb-4d50-a02a-5e7fec276960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:09.633768 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b0296885-63eb-4d50-a02a-5e7fec276960 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:43:09.634992 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b0296885-63eb-4d50-a02a-5e7fec276960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:43:09.702545 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 558/1125] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:43:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:43:09.726255 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d536b-71a9-4f3a-82fd-f6f3ebd56e8a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:09.838375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d536b-71a9-4f3a-82fd-f6f3ebd56e8a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:09.872104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32858c5f-5939-4a68-b3bb-7c88d9312a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:09.872892 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32858c5f-5939-4a68-b3bb-7c88d9312a7c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:09.873165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32858c5f-5939-4a68-b3bb-7c88d9312a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:09.873441 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32858c5f-5939-4a68-b3bb-7c88d9312a7c None admin] PATH_INFO: `/v3/roles/ae6b211774c34f47a3ac4853538f62ad` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:09.875105 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32858c5f-5939-4a68-b3bb-7c88d9312a7c None admin] RBAC: Authorizing `identity:get_role(role_id=ae6b211774c34f47a3ac4853538f62ad)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:09.876474 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32858c5f-5939-4a68-b3bb-7c88d9312a7c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:09.877832 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 568/1126] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:43:09 2022] GET /identity/v3/roles/ae6b211774c34f47a3ac4853538f62ad => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:09.887203 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0296885-63eb-4d50-a02a-5e7fec276960 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:09.994996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0296885-63eb-4d50-a02a-5e7fec276960 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:10.028832 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d5168-8bf8-4825-a269-d5197986b0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:10.029695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5168-8bf8-4825-a269-d5197986b0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:10.029978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5168-8bf8-4825-a269-d5197986b0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:10.030253 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5168-8bf8-4825-a269-d5197986b0e8 None admin] PATH_INFO: `/v3/users/c1460f07fd67407b80d2b3ea4de0767c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:10.031509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d5168-8bf8-4825-a269-d5197986b0e8 None admin] RBAC: Authorizing `identity:get_user(user_id=c1460f07fd67407b80d2b3ea4de0767c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:10.032951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d5168-8bf8-4825-a269-d5197986b0e8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:10.034585 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 559/1127] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:43:09 2022] GET /identity/v3/users/c1460f07fd67407b80d2b3ea4de0767c => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:10.041341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32858c5f-5939-4a68-b3bb-7c88d9312a7c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:10.143289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32858c5f-5939-4a68-b3bb-7c88d9312a7c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:10.177113 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436e26a-434b-4ff7-bfc1-4ffe1a048586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:10.177746 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436e26a-434b-4ff7-bfc1-4ffe1a048586 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:10.178028 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436e26a-434b-4ff7-bfc1-4ffe1a048586 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:10.178297 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436e26a-434b-4ff7-bfc1-4ffe1a048586 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:10.244326 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436e26a-434b-4ff7-bfc1-4ffe1a048586 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:10.245768 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436e26a-434b-4ff7-bfc1-4ffe1a048586 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:10.344047 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 569/1128] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:43:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:43:10.350372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d5168-8bf8-4825-a269-d5197986b0e8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:10.448857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d5168-8bf8-4825-a269-d5197986b0e8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:10.481825 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b9a85-26e9-40d4-8dae-bb1ca13e5e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:10.482666 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b9a85-26e9-40d4-8dae-bb1ca13e5e67 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:10.482944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b9a85-26e9-40d4-8dae-bb1ca13e5e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:10.483247 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b9a85-26e9-40d4-8dae-bb1ca13e5e67 None admin] PATH_INFO: `/v3/projects/41272ca7974246959a474801cbbec5db` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:10.484496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b9a85-26e9-40d4-8dae-bb1ca13e5e67 None admin] RBAC: Authorizing `identity:get_project(project_id=41272ca7974246959a474801cbbec5db)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:10.485938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b9a85-26e9-40d4-8dae-bb1ca13e5e67 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:10.487653 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 560/1129] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:43:10 2022] GET /identity/v3/projects/41272ca7974246959a474801cbbec5db => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:10.494610 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436e26a-434b-4ff7-bfc1-4ffe1a048586 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:10.608333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436e26a-434b-4ff7-bfc1-4ffe1a048586 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:10.642325 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a452e-3dae-4249-856c-c870beb7fdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:10.643011 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a452e-3dae-4249-856c-c870beb7fdc4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:10.643270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a452e-3dae-4249-856c-c870beb7fdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:10.643538 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a452e-3dae-4249-856c-c870beb7fdc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:10.644371 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a452e-3dae-4249-856c-c870beb7fdc4 None admin] RBAC: Adding query filter params (role.id=ae6b211774c34f47a3ac4853538f62ad, scope.project.id=41272ca7974246959a474801cbbec5db, user.id=c1460f07fd67407b80d2b3ea4de0767c) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:43:10.644684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a452e-3dae-4249-856c-c870beb7fdc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:10.646226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a452e-3dae-4249-856c-c870beb7fdc4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:10.652099 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 570/1130] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:43:10 2022] GET /identity/v3/role_assignments?user.id=c1460f07fd67407b80d2b3ea4de0767c&scope.project.id=41272ca7974246959a474801cbbec5db&role.id=ae6b211774c34f47a3ac4853538f62ad => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:12.877304 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a5577-b531-409d-9a46-dbe1f5e6553b None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:12.878159 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a5577-b531-409d-9a46-dbe1f5e6553b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:12.878159 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a5577-b531-409d-9a46-dbe1f5e6553b None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:12.880407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 561/1131] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:43:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:43:12.886923 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01d680-4a99-4dee-8c22-e5bd5b5f5638 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:12.887400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01d680-4a99-4dee-8c22-e5bd5b5f5638 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:12.887496 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01d680-4a99-4dee-8c22-e5bd5b5f5638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:12.908764 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5a01d680-4a99-4dee-8c22-e5bd5b5f5638 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:43:12.909949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5a01d680-4a99-4dee-8c22-e5bd5b5f5638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:43:12.986798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 571/1132] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:43:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:43:13.010878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a5577-b531-409d-9a46-dbe1f5e6553b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:13.113078 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a5577-b531-409d-9a46-dbe1f5e6553b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:13.161311 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aea397-8fd3-4e03-9334-933cd3bac37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:13.162087 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aea397-8fd3-4e03-9334-933cd3bac37d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:13.162366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aea397-8fd3-4e03-9334-933cd3bac37d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:13.162636 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aea397-8fd3-4e03-9334-933cd3bac37d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:13.163947 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aea397-8fd3-4e03-9334-933cd3bac37d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:13.165379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aea397-8fd3-4e03-9334-933cd3bac37d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:13.166948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 562/1133] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:43:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:13.172857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01d680-4a99-4dee-8c22-e5bd5b5f5638 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:13.273574 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01d680-4a99-4dee-8c22-e5bd5b5f5638 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:13.318448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7279ee2-dee8-4c39-987f-c25a5d94c624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:13.319164 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7279ee2-dee8-4c39-987f-c25a5d94c624 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:13.319792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7279ee2-dee8-4c39-987f-c25a5d94c624 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:13.320063 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7279ee2-dee8-4c39-987f-c25a5d94c624 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:13.320777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7279ee2-dee8-4c39-987f-c25a5d94c624 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:13.322225 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7279ee2-dee8-4c39-987f-c25a5d94c624 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:13.350630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 572/1134] 10.222.0.77 () {60 vars in 1141 bytes} [Wed May 11 06:43:13 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:43:15.579312 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74eb42-0958-488d-aa21-d0f259291054 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:15.580157 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74eb42-0958-488d-aa21-d0f259291054 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:15.580157 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74eb42-0958-488d-aa21-d0f259291054 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:15.582265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 563/1135] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:43:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:43:15.588672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754c3f1-65b0-4777-9ed6-031ff5ca0bce None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:15.589096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754c3f1-65b0-4777-9ed6-031ff5ca0bce None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:15.589231 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754c3f1-65b0-4777-9ed6-031ff5ca0bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:15.610884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f754c3f1-65b0-4777-9ed6-031ff5ca0bce None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:43:15.612107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f754c3f1-65b0-4777-9ed6-031ff5ca0bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:43:15.690434 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 573/1136] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:43:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:43:15.716068 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74eb42-0958-488d-aa21-d0f259291054 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:15.822701 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74eb42-0958-488d-aa21-d0f259291054 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:15.856781 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a67f2-665f-46d0-8e0b-bff0a337e0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:15.857494 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a67f2-665f-46d0-8e0b-bff0a337e0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:15.857769 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a67f2-665f-46d0-8e0b-bff0a337e0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:15.858037 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a67f2-665f-46d0-8e0b-bff0a337e0c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:15.859342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a67f2-665f-46d0-8e0b-bff0a337e0c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:15.860772 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a67f2-665f-46d0-8e0b-bff0a337e0c7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:15.862361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 564/1137] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:43:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:15.868486 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754c3f1-65b0-4777-9ed6-031ff5ca0bce None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:15.981439 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754c3f1-65b0-4777-9ed6-031ff5ca0bce None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:16.022359 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6649e0-598a-4bc9-a110-23941080a6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:16.023027 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6649e0-598a-4bc9-a110-23941080a6fe None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:16.023337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6649e0-598a-4bc9-a110-23941080a6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:16.023608 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6649e0-598a-4bc9-a110-23941080a6fe None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:16.024318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6649e0-598a-4bc9-a110-23941080a6fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:16.025757 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6649e0-598a-4bc9-a110-23941080a6fe None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:16.048363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 574/1138] 10.222.0.77 () {60 vars in 1132 bytes} [Wed May 11 06:43:15 2022] POST /identity/v3/users => generated 286 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:43:18.281589 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fd45d-6289-4611-a329-5535c04eb47f None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:18.282162 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fd45d-6289-4611-a329-5535c04eb47f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:18.282162 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fd45d-6289-4611-a329-5535c04eb47f None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:18.284264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 565/1139] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:43:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:43:18.290898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bc880-66f6-471c-9c7b-f59f4d9bd04c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:18.291641 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bc880-66f6-471c-9c7b-f59f4d9bd04c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:18.291791 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bc880-66f6-471c-9c7b-f59f4d9bd04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:18.313182 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-887bc880-66f6-471c-9c7b-f59f4d9bd04c None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:43:18.314374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-887bc880-66f6-471c-9c7b-f59f4d9bd04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:43:18.390291 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 575/1140] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:43:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:43:18.413977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fd45d-6289-4611-a329-5535c04eb47f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:18.541985 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fd45d-6289-4611-a329-5535c04eb47f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:18.575840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f55e59-d7f0-44f6-a36f-bdc87abe552b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:18.576622 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f55e59-d7f0-44f6-a36f-bdc87abe552b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:18.576899 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f55e59-d7f0-44f6-a36f-bdc87abe552b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:18.577171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f55e59-d7f0-44f6-a36f-bdc87abe552b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:18.587695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f55e59-d7f0-44f6-a36f-bdc87abe552b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:43:18.595231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-a0f55e59-d7f0-44f6-a36f-bdc87abe552b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:43:18.595231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:43:18.595231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:43:18.595231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:43:18.595231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:43:18.595231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:43:18.595231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:43:18.595231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:43:18.595231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:43:18.595231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:43:18.595231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:43:18.595231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:43:18.595231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:43:18.595231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:43:18.595231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:43:18.595231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:43:18.596354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:43:18.596354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:43:18.596354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:43:18.596354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:43:18.596354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:43:18.596354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:43:18.596354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:43:18.596354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:43:18.596354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:43:18.596354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:43:18.596354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:43:18.596354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:43:18.596354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:43:18.596354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:43:18.596354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:43:18.596354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:43:18.597512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:43:18.597512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:43:18.597512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:43:18.597512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:43:18.597512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:43:18.597512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:43:18.597512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:43:18.597512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:43:18.597512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:43:18.597512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:43:18.597512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:43:18.597512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:43:18.597512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 566/1141] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:43:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:43:18.603117 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bc880-66f6-471c-9c7b-f59f4d9bd04c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:18.702736 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bc880-66f6-471c-9c7b-f59f4d9bd04c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:18.746994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241e67d-2b2b-411c-b497-f4008008746c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:18.747703 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241e67d-2b2b-411c-b497-f4008008746c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:18.747985 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241e67d-2b2b-411c-b497-f4008008746c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:18.748254 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241e67d-2b2b-411c-b497-f4008008746c None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:18.748995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241e67d-2b2b-411c-b497-f4008008746c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:43:18.749299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241e67d-2b2b-411c-b497-f4008008746c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:18.750675 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241e67d-2b2b-411c-b497-f4008008746c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:18.759161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 576/1142] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:43:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:18.765672 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f55e59-d7f0-44f6-a36f-bdc87abe552b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:18.881773 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f55e59-d7f0-44f6-a36f-bdc87abe552b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:18.916457 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec827a6-a953-4c09-b99f-102739290976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:18.917310 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec827a6-a953-4c09-b99f-102739290976 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:18.917590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec827a6-a953-4c09-b99f-102739290976 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:18.917861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec827a6-a953-4c09-b99f-102739290976 None admin] PATH_INFO: `/v3/users/1eaf3d8a98114d61b9535eb454a0c5da` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:18.931873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec827a6-a953-4c09-b99f-102739290976 None admin] RBAC: Authorizing `identity:get_user(user_id=1eaf3d8a98114d61b9535eb454a0c5da)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:18.933325 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec827a6-a953-4c09-b99f-102739290976 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:18.934941 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 567/1143] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:43:18 2022] GET /identity/v3/users/1eaf3d8a98114d61b9535eb454a0c5da => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:18.940717 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241e67d-2b2b-411c-b497-f4008008746c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:19.038087 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241e67d-2b2b-411c-b497-f4008008746c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:19.071526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2752a8f-1fa7-4bc6-9760-e051e181f27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:19.072160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2752a8f-1fa7-4bc6-9760-e051e181f27c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:19.072436 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2752a8f-1fa7-4bc6-9760-e051e181f27c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:19.072706 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2752a8f-1fa7-4bc6-9760-e051e181f27c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:19.144750 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2752a8f-1fa7-4bc6-9760-e051e181f27c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:19.146231 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2752a8f-1fa7-4bc6-9760-e051e181f27c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:19.249020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 577/1144] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:43:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:43:19.257417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec827a6-a953-4c09-b99f-102739290976 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:19.355549 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec827a6-a953-4c09-b99f-102739290976 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:19.395692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa8e72-5672-409a-834d-be336fe0b890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:19.396901 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa8e72-5672-409a-834d-be336fe0b890 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:19.397343 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa8e72-5672-409a-834d-be336fe0b890 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:19.397758 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa8e72-5672-409a-834d-be336fe0b890 None admin] PATH_INFO: `/v3/projects/6ecbd511ccd14b73a4541f4e7dfe8343` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:19.399822 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa8e72-5672-409a-834d-be336fe0b890 None admin] RBAC: Authorizing `identity:get_project(project_id=6ecbd511ccd14b73a4541f4e7dfe8343)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:19.402126 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa8e72-5672-409a-834d-be336fe0b890 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:19.404874 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 568/1145] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:43:19 2022] GET /identity/v3/projects/6ecbd511ccd14b73a4541f4e7dfe8343 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:19.411402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2752a8f-1fa7-4bc6-9760-e051e181f27c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:19.517459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2752a8f-1fa7-4bc6-9760-e051e181f27c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:19.552371 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4ec48-b5da-45e3-b215-9962cf4b22b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:19.553005 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4ec48-b5da-45e3-b215-9962cf4b22b4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:19.553280 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4ec48-b5da-45e3-b215-9962cf4b22b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:19.553543 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4ec48-b5da-45e3-b215-9962cf4b22b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:19.554369 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4ec48-b5da-45e3-b215-9962cf4b22b4 None admin] RBAC: Adding query filter params (role.id=5debd8ad07a74bedbf2efd53b11cd7cd, scope.project.id=6ecbd511ccd14b73a4541f4e7dfe8343, user.id=1eaf3d8a98114d61b9535eb454a0c5da) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:43:19.554677 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4ec48-b5da-45e3-b215-9962cf4b22b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:19.556148 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4ec48-b5da-45e3-b215-9962cf4b22b4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:19.561712 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 578/1146] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:43:19 2022] GET /identity/v3/role_assignments?user.id=1eaf3d8a98114d61b9535eb454a0c5da&scope.project.id=6ecbd511ccd14b73a4541f4e7dfe8343&role.id=5debd8ad07a74bedbf2efd53b11cd7cd => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:21.741975 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43953d5e-71be-4ead-9abf-6c32fe03cd0c None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:21.742876 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43953d5e-71be-4ead-9abf-6c32fe03cd0c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:21.742876 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43953d5e-71be-4ead-9abf-6c32fe03cd0c None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:21.747059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 569/1147] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:43:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:43:21.755925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623c3ba-5850-4bc9-af45-c5be07407397 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:21.756341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623c3ba-5850-4bc9-af45-c5be07407397 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:21.756514 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623c3ba-5850-4bc9-af45-c5be07407397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:21.779130 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f623c3ba-5850-4bc9-af45-c5be07407397 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:43:21.780333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f623c3ba-5850-4bc9-af45-c5be07407397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:43:21.847608 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 579/1148] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:43:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:43:21.870694 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43953d5e-71be-4ead-9abf-6c32fe03cd0c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:21.989684 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43953d5e-71be-4ead-9abf-6c32fe03cd0c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:22.026986 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63ef6d-ed06-4b21-97e7-d3e100ff1ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:22.027714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63ef6d-ed06-4b21-97e7-d3e100ff1ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:22.027993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63ef6d-ed06-4b21-97e7-d3e100ff1ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:22.028268 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63ef6d-ed06-4b21-97e7-d3e100ff1ce6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:22.039278 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63ef6d-ed06-4b21-97e7-d3e100ff1ce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:43:22.046819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-3a63ef6d-ed06-4b21-97e7-d3e100ff1ce6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:43:22.046819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:43:22.046819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:43:22.046819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:43:22.046819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:43:22.046819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:43:22.046819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:43:22.046819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:43:22.046819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:43:22.046819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:43:22.046819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:43:22.046819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:43:22.046819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:43:22.046819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:43:22.046819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:43:22.046819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:43:22.047927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:43:22.047927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:43:22.047927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:43:22.047927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:43:22.047927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:43:22.047927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:43:22.047927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:43:22.047927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:43:22.047927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:43:22.047927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:43:22.047927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:43:22.047927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:43:22.047927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:43:22.047927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:43:22.047927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:43:22.047927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:43:22.049429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:43:22.049429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:43:22.049429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:43:22.049429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:43:22.049429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:43:22.049429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:43:22.049429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:43:22.049429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:43:22.049429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:43:22.049429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:43:22.049429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:43:22.049429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:43:22.049429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 570/1149] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:43:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:43:22.055549 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623c3ba-5850-4bc9-af45-c5be07407397 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:22.158761 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623c3ba-5850-4bc9-af45-c5be07407397 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:22.193203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24361619-0429-450f-b029-66e7f3074930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:22.193862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24361619-0429-450f-b029-66e7f3074930 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:22.194455 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24361619-0429-450f-b029-66e7f3074930 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:22.194759 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24361619-0429-450f-b029-66e7f3074930 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:22.195532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24361619-0429-450f-b029-66e7f3074930 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:43:22.195822 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24361619-0429-450f-b029-66e7f3074930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:22.197199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24361619-0429-450f-b029-66e7f3074930 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:22.205161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 580/1150] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:43:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:22.211459 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63ef6d-ed06-4b21-97e7-d3e100ff1ce6 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:22.313425 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63ef6d-ed06-4b21-97e7-d3e100ff1ce6 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:22.348593 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e0250-cfd0-4cd1-9b26-c44befa334ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:22.349445 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e0250-cfd0-4cd1-9b26-c44befa334ed None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:22.349715 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e0250-cfd0-4cd1-9b26-c44befa334ed None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:22.349988 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e0250-cfd0-4cd1-9b26-c44befa334ed None admin] PATH_INFO: `/v3/users/1eaf3d8a98114d61b9535eb454a0c5da` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:22.351223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e0250-cfd0-4cd1-9b26-c44befa334ed None admin] RBAC: Authorizing `identity:get_user(user_id=1eaf3d8a98114d61b9535eb454a0c5da)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:22.352662 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e0250-cfd0-4cd1-9b26-c44befa334ed None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:22.354283 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 571/1151] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:43:22 2022] GET /identity/v3/users/1eaf3d8a98114d61b9535eb454a0c5da => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:22.363379 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24361619-0429-450f-b029-66e7f3074930 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:22.467887 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24361619-0429-450f-b029-66e7f3074930 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:22.502439 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295320c7-0916-4793-88dc-8062a9626057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:22.503408 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295320c7-0916-4793-88dc-8062a9626057 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:22.503682 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295320c7-0916-4793-88dc-8062a9626057 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:22.503952 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295320c7-0916-4793-88dc-8062a9626057 None admin] PATH_INFO: `/v3/projects/6ecbd511ccd14b73a4541f4e7dfe8343` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:22.505271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295320c7-0916-4793-88dc-8062a9626057 None admin] RBAC: Authorizing `identity:get_project(project_id=6ecbd511ccd14b73a4541f4e7dfe8343)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:22.506738 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295320c7-0916-4793-88dc-8062a9626057 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:22.508435 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 581/1152] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:43:22 2022] GET /identity/v3/projects/6ecbd511ccd14b73a4541f4e7dfe8343 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:22.514363 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e0250-cfd0-4cd1-9b26-c44befa334ed None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:22.614999 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e0250-cfd0-4cd1-9b26-c44befa334ed None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:22.646051 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5e3ef-9c7d-44d5-acfb-bc68403a9096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:22.646923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5e3ef-9c7d-44d5-acfb-bc68403a9096 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:22.647232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5e3ef-9c7d-44d5-acfb-bc68403a9096 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:22.647506 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5e3ef-9c7d-44d5-acfb-bc68403a9096 None admin] PATH_INFO: `/v3/projects/6ecbd511ccd14b73a4541f4e7dfe8343/users/1eaf3d8a98114d61b9535eb454a0c5da/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:22.649477 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e5e3ef-9c7d-44d5-acfb-bc68403a9096 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ecbd511ccd14b73a4541f4e7dfe8343, user_id=1eaf3d8a98114d61b9535eb454a0c5da, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:22.650910 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e5e3ef-9c7d-44d5-acfb-bc68403a9096 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:22.666311 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 572/1153] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:43:22 2022] PUT /identity/v3/projects/6ecbd511ccd14b73a4541f4e7dfe8343/users/1eaf3d8a98114d61b9535eb454a0c5da/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:43:24.831507 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5be15f-139a-4db5-aa31-4545a56f9ea4 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:24.832100 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5be15f-139a-4db5-aa31-4545a56f9ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:24.832100 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5be15f-139a-4db5-aa31-4545a56f9ea4 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:24.833561 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 582/1154] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:43:24.839089 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e81c7c-caee-4fe4-9f13-71b66492ae16 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:24.839509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e81c7c-caee-4fe4-9f13-71b66492ae16 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:24.839647 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e81c7c-caee-4fe4-9f13-71b66492ae16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:24.857925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a1e81c7c-caee-4fe4-9f13-71b66492ae16 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:43:24.859138 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a1e81c7c-caee-4fe4-9f13-71b66492ae16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:43:24.924291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 573/1155] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:43:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:43:24.947717 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5be15f-139a-4db5-aa31-4545a56f9ea4 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:25.060880 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5be15f-139a-4db5-aa31-4545a56f9ea4 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:25.104891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33d50a-41cf-4972-8fd6-baa7f524250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:25.105620 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33d50a-41cf-4972-8fd6-baa7f524250b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:25.105902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33d50a-41cf-4972-8fd6-baa7f524250b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:25.106174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33d50a-41cf-4972-8fd6-baa7f524250b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:25.117170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33d50a-41cf-4972-8fd6-baa7f524250b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:43:25.124755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-9d33d50a-41cf-4972-8fd6-baa7f524250b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:43:25.124755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:43:25.124755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:43:25.124755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:43:25.124755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:43:25.124755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:43:25.124755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:43:25.124755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:43:25.124755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:43:25.124755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:43:25.124755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:43:25.124755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:43:25.124755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:43:25.124755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:43:25.124755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:43:25.124755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:43:25.125845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:43:25.125845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:43:25.125845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:43:25.125845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:43:25.125845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:43:25.125845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:43:25.125845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:43:25.125845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:43:25.125845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:43:25.125845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:43:25.125845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:43:25.125845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:43:25.125845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:43:25.125845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:43:25.125845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:43:25.125845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:43:25.126850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:43:25.126850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:43:25.126850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:43:25.126850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:43:25.126850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:43:25.126850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:43:25.126850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:43:25.126850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:43:25.126850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:43:25.126850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:43:25.126850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:43:25.126850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:43:25.126850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 583/1156] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:43:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:43:25.132236 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e81c7c-caee-4fe4-9f13-71b66492ae16 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:25.245322 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e81c7c-caee-4fe4-9f13-71b66492ae16 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:25.278553 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a986cbd-fa39-4a4e-b14c-633dfbb5354a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:25.279253 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a986cbd-fa39-4a4e-b14c-633dfbb5354a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:25.279534 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a986cbd-fa39-4a4e-b14c-633dfbb5354a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:25.279812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a986cbd-fa39-4a4e-b14c-633dfbb5354a None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:25.280537 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a986cbd-fa39-4a4e-b14c-633dfbb5354a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:43:25.280846 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a986cbd-fa39-4a4e-b14c-633dfbb5354a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:25.282251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a986cbd-fa39-4a4e-b14c-633dfbb5354a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:25.290994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 574/1157] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:43:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:43:25.298514 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33d50a-41cf-4972-8fd6-baa7f524250b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:25.407099 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33d50a-41cf-4972-8fd6-baa7f524250b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:25.440559 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07743f2-860a-4d23-ac8a-837d57d3d201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:25.441422 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07743f2-860a-4d23-ac8a-837d57d3d201 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:25.441750 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07743f2-860a-4d23-ac8a-837d57d3d201 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:25.442019 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07743f2-860a-4d23-ac8a-837d57d3d201 None admin] PATH_INFO: `/v3/users/1eaf3d8a98114d61b9535eb454a0c5da` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:25.443365 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07743f2-860a-4d23-ac8a-837d57d3d201 None admin] RBAC: Authorizing `identity:get_user(user_id=1eaf3d8a98114d61b9535eb454a0c5da)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:25.445142 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07743f2-860a-4d23-ac8a-837d57d3d201 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:25.446760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 584/1158] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:43:25 2022] GET /identity/v3/users/1eaf3d8a98114d61b9535eb454a0c5da => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:25.453329 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a986cbd-fa39-4a4e-b14c-633dfbb5354a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:25.555792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a986cbd-fa39-4a4e-b14c-633dfbb5354a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:25.589801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1824c93-2f3b-4cc0-a315-6ee7bee9e7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:25.590434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1824c93-2f3b-4cc0-a315-6ee7bee9e7ae None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:25.590720 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1824c93-2f3b-4cc0-a315-6ee7bee9e7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:25.591000 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1824c93-2f3b-4cc0-a315-6ee7bee9e7ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:25.656386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1824c93-2f3b-4cc0-a315-6ee7bee9e7ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:25.657886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1824c93-2f3b-4cc0-a315-6ee7bee9e7ae None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:25.762639 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 575/1159] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:43:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:43:25.771550 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07743f2-860a-4d23-ac8a-837d57d3d201 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:25.875094 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07743f2-860a-4d23-ac8a-837d57d3d201 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:25.908121 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c082a74-b1c4-45b9-a362-895cd97c624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:25.908905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c082a74-b1c4-45b9-a362-895cd97c624b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:25.909183 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c082a74-b1c4-45b9-a362-895cd97c624b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:25.909455 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c082a74-b1c4-45b9-a362-895cd97c624b None admin] PATH_INFO: `/v3/projects/6ecbd511ccd14b73a4541f4e7dfe8343` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:25.910678 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c082a74-b1c4-45b9-a362-895cd97c624b None admin] RBAC: Authorizing `identity:get_project(project_id=6ecbd511ccd14b73a4541f4e7dfe8343)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:25.912136 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c082a74-b1c4-45b9-a362-895cd97c624b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:25.913828 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 585/1160] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:43:25 2022] GET /identity/v3/projects/6ecbd511ccd14b73a4541f4e7dfe8343 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:25.920571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1824c93-2f3b-4cc0-a315-6ee7bee9e7ae None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:26.048810 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1824c93-2f3b-4cc0-a315-6ee7bee9e7ae None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:26.092453 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227053e-8033-499c-8028-50bea8c53a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:26.093104 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227053e-8033-499c-8028-50bea8c53a78 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:26.093379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227053e-8033-499c-8028-50bea8c53a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:26.093644 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227053e-8033-499c-8028-50bea8c53a78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:26.094501 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227053e-8033-499c-8028-50bea8c53a78 None admin] RBAC: Adding query filter params (role.id=5debd8ad07a74bedbf2efd53b11cd7cd, scope.project.id=6ecbd511ccd14b73a4541f4e7dfe8343, user.id=1eaf3d8a98114d61b9535eb454a0c5da) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:43:26.094803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227053e-8033-499c-8028-50bea8c53a78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:26.096271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227053e-8033-499c-8028-50bea8c53a78 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:26.102374 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 576/1161] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:43:25 2022] GET /identity/v3/role_assignments?user.id=1eaf3d8a98114d61b9535eb454a0c5da&scope.project.id=6ecbd511ccd14b73a4541f4e7dfe8343&role.id=5debd8ad07a74bedbf2efd53b11cd7cd => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:28.357491 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259100d-61a4-4d1f-b5c0-cf922b8edf20 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:28.358257 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259100d-61a4-4d1f-b5c0-cf922b8edf20 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:28.358388 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259100d-61a4-4d1f-b5c0-cf922b8edf20 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:28.360604 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 586/1162] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:43:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:43:28.369509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8cd2f-a9b5-4a46-9481-8cb386ef888f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:28.369946 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8cd2f-a9b5-4a46-9481-8cb386ef888f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:28.370071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8cd2f-a9b5-4a46-9481-8cb386ef888f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:28.391311 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-efe8cd2f-a9b5-4a46-9481-8cb386ef888f None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:43:28.392494 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-efe8cd2f-a9b5-4a46-9481-8cb386ef888f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:43:28.460008 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 577/1163] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:43:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:43:28.494302 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259100d-61a4-4d1f-b5c0-cf922b8edf20 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:28.611743 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259100d-61a4-4d1f-b5c0-cf922b8edf20 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:28.649406 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983903c4-b4d1-4d75-8040-faa88ddf04ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:28.650039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983903c4-b4d1-4d75-8040-faa88ddf04ae None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:28.650318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983903c4-b4d1-4d75-8040-faa88ddf04ae None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:28.650593 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983903c4-b4d1-4d75-8040-faa88ddf04ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:28.716013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983903c4-b4d1-4d75-8040-faa88ddf04ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:28.717494 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983903c4-b4d1-4d75-8040-faa88ddf04ae None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:28.812230 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 587/1164] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:43:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:43:28.818624 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8cd2f-a9b5-4a46-9481-8cb386ef888f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:28.914159 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8cd2f-a9b5-4a46-9481-8cb386ef888f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:28.948067 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e0a33-0666-466b-b5b2-10b771965829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:28.948848 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e0a33-0666-466b-b5b2-10b771965829 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:28.949120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e0a33-0666-466b-b5b2-10b771965829 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:28.949388 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e0a33-0666-466b-b5b2-10b771965829 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:28.956305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e0a33-0666-466b-b5b2-10b771965829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:28.957778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e0a33-0666-466b-b5b2-10b771965829 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:28.972028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-4d3e0a33-0666-466b-b5b2-10b771965829 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 11 06:43:28.972028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:43:28.972028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 11 06:43:28.972028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 11 06:43:28.972028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:43:28.972028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:43:28.972028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:43:28.972028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:43:28.972028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 11 06:43:28.972028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:43:28.972028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:43:28.972028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:43:28.972028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:43:28.972028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:43:28.972028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:43:28.972028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:43:28.972028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:43:28.973362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:43:28.973362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:43:28.973362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:43:28.973362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:43:28.973362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:43:28.973362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:43:28.973362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:43:28.973362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:43:28.973362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:43:28.973362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:43:28.973362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:43:28.973362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:43:28.973362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:43:28.973362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:43:28.973362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:43:28.973362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:43:28.974472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:43:28.974472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:43:28.974472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:43:28.974472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:43:28.974472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:43:28.974472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:43:28.974472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:43:28.974472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:43:28.974472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:43:28.974472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:43:28.974472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 11 06:43:28.974472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:43:28.974472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 11 06:43:28.974472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:43:28.974472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 578/1165] 10.222.0.77 () {56 vars in 1117 bytes} [Wed May 11 06:43:28 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:43:28.979463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983903c4-b4d1-4d75-8040-faa88ddf04ae None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:29.077146 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983903c4-b4d1-4d75-8040-faa88ddf04ae None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:29.112600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e86d98-37a1-4f88-b838-5f58a0c480a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:29.113261 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e86d98-37a1-4f88-b838-5f58a0c480a8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:29.113541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e86d98-37a1-4f88-b838-5f58a0c480a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:29.113850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e86d98-37a1-4f88-b838-5f58a0c480a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:29.114577 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e86d98-37a1-4f88-b838-5f58a0c480a8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:43:29.114884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e86d98-37a1-4f88-b838-5f58a0c480a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:29.116298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e86d98-37a1-4f88-b838-5f58a0c480a8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:29.124392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 588/1166] 10.222.0.77 () {56 vars in 1115 bytes} [Wed May 11 06:43:28 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:31.338457 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0612bf5-60af-4626-8099-6fe21a3143ca None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:31.339351 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0612bf5-60af-4626-8099-6fe21a3143ca None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:31.339351 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0612bf5-60af-4626-8099-6fe21a3143ca None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:31.341787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 579/1167] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:43:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:43:31.348042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc2e05-cf2a-4283-aaaa-12e37c3372ad None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:31.348505 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc2e05-cf2a-4283-aaaa-12e37c3372ad None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:31.348603 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc2e05-cf2a-4283-aaaa-12e37c3372ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:31.366662 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7efc2e05-cf2a-4283-aaaa-12e37c3372ad None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:43:31.367889 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7efc2e05-cf2a-4283-aaaa-12e37c3372ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:43:31.434416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 589/1168] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:43:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:43:31.460767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0612bf5-60af-4626-8099-6fe21a3143ca None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:31.572775 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0612bf5-60af-4626-8099-6fe21a3143ca None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:31.605949 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46b10a-8049-49ce-a9eb-697d98ba0fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:31.606583 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46b10a-8049-49ce-a9eb-697d98ba0fcd None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:31.606858 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46b10a-8049-49ce-a9eb-697d98ba0fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:31.607211 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46b10a-8049-49ce-a9eb-697d98ba0fcd None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:31.607941 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46b10a-8049-49ce-a9eb-697d98ba0fcd None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:31.609286 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46b10a-8049-49ce-a9eb-697d98ba0fcd None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:31.626359 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 580/1169] 10.222.0.77 () {60 vars in 1138 bytes} [Wed May 11 06:43:31 2022] POST /identity/v3/domains => generated 267 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:43:33.840063 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c900c80-e061-4b48-b8b1-4c3af00e5fe9 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:33.840957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c900c80-e061-4b48-b8b1-4c3af00e5fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:33.840957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c900c80-e061-4b48-b8b1-4c3af00e5fe9 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:33.843139 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 590/1170] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:43:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:43:33.849396 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00599e3f-8596-4ff2-b692-ebd0509ff35e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:33.849853 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00599e3f-8596-4ff2-b692-ebd0509ff35e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:33.849961 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00599e3f-8596-4ff2-b692-ebd0509ff35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:33.872299 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-00599e3f-8596-4ff2-b692-ebd0509ff35e None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:43:33.873495 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-00599e3f-8596-4ff2-b692-ebd0509ff35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:43:33.941571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 581/1171] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:43:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:43:33.965570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c900c80-e061-4b48-b8b1-4c3af00e5fe9 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:34.080069 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c900c80-e061-4b48-b8b1-4c3af00e5fe9 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:34.123440 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713a360-63c0-43ca-8d95-958d249f610c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:34.124235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713a360-63c0-43ca-8d95-958d249f610c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:34.124512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713a360-63c0-43ca-8d95-958d249f610c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:34.124781 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713a360-63c0-43ca-8d95-958d249f610c None admin] PATH_INFO: `/v3/domains/4191dfd9ce6046bfb9ed958701ed5266` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:34.139091 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713a360-63c0-43ca-8d95-958d249f610c None admin] RBAC: Authorizing `identity:get_domain(domain_id=4191dfd9ce6046bfb9ed958701ed5266)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:34.140540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713a360-63c0-43ca-8d95-958d249f610c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:34.142329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 591/1172] 10.222.0.77 () {56 vars in 1183 bytes} [Wed May 11 06:43:33 2022] GET /identity/v3/domains/4191dfd9ce6046bfb9ed958701ed5266 => generated 267 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:34.148499 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00599e3f-8596-4ff2-b692-ebd0509ff35e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:34.245716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00599e3f-8596-4ff2-b692-ebd0509ff35e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:34.279255 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a11b4-5cff-42ac-84ab-e3b81fcd62bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:34.279896 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a11b4-5cff-42ac-84ab-e3b81fcd62bc None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:34.280170 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a11b4-5cff-42ac-84ab-e3b81fcd62bc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:34.280438 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a11b4-5cff-42ac-84ab-e3b81fcd62bc None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:34.281159 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a11b4-5cff-42ac-84ab-e3b81fcd62bc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:34.282579 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a11b4-5cff-42ac-84ab-e3b81fcd62bc None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:34.311114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 582/1173] 10.222.0.77 () {60 vars in 1141 bytes} [Wed May 11 06:43:34 2022] POST /identity/v3/projects => generated 361 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:43:36.543307 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc139145-5ae1-49eb-9dd2-060a037dbe82 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:36.543937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc139145-5ae1-49eb-9dd2-060a037dbe82 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:36.543937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc139145-5ae1-49eb-9dd2-060a037dbe82 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:36.545260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 592/1174] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:43:36.551757 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2174d-66d6-4cd8-8050-a95038f7568c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:36.552486 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2174d-66d6-4cd8-8050-a95038f7568c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:36.552642 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2174d-66d6-4cd8-8050-a95038f7568c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:36.575762 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-11f2174d-66d6-4cd8-8050-a95038f7568c None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:43:36.577120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-11f2174d-66d6-4cd8-8050-a95038f7568c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:43:36.644239 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 583/1175] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:43:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:43:36.669073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc139145-5ae1-49eb-9dd2-060a037dbe82 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:36.772260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc139145-5ae1-49eb-9dd2-060a037dbe82 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:36.805978 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c900977-9e7f-4b5b-b7f3-5696d42adb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:36.806776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c900977-9e7f-4b5b-b7f3-5696d42adb8d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:36.807083 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c900977-9e7f-4b5b-b7f3-5696d42adb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:36.807318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c900977-9e7f-4b5b-b7f3-5696d42adb8d None admin] PATH_INFO: `/v3/domains/4191dfd9ce6046bfb9ed958701ed5266` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:36.808648 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c900977-9e7f-4b5b-b7f3-5696d42adb8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=4191dfd9ce6046bfb9ed958701ed5266)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:36.810088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c900977-9e7f-4b5b-b7f3-5696d42adb8d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:36.811717 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 593/1176] 10.222.0.77 () {56 vars in 1183 bytes} [Wed May 11 06:43:36 2022] GET /identity/v3/domains/4191dfd9ce6046bfb9ed958701ed5266 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:36.818119 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2174d-66d6-4cd8-8050-a95038f7568c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:36.926568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2174d-66d6-4cd8-8050-a95038f7568c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:36.962785 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5b388-20e0-4bb3-9c96-e874d4004db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:36.963461 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5b388-20e0-4bb3-9c96-e874d4004db7 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:36.963733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5b388-20e0-4bb3-9c96-e874d4004db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:36.963998 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5b388-20e0-4bb3-9c96-e874d4004db7 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:36.964699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5b388-20e0-4bb3-9c96-e874d4004db7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:36.966129 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5b388-20e0-4bb3-9c96-e874d4004db7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:36.992322 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 584/1177] 10.222.0.77 () {60 vars in 1132 bytes} [Wed May 11 06:43:36 2022] POST /identity/v3/users => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:43:39.235556 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcfd42-995b-4f08-a8cf-9eec0868a460 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:39.236167 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcfd42-995b-4f08-a8cf-9eec0868a460 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:39.236167 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcfd42-995b-4f08-a8cf-9eec0868a460 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:39.237489 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 594/1178] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:43:39.244096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caffd3c-da5f-4f44-a6c3-93d549306753 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:39.244852 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caffd3c-da5f-4f44-a6c3-93d549306753 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:39.245009 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caffd3c-da5f-4f44-a6c3-93d549306753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:39.272131 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-4caffd3c-da5f-4f44-a6c3-93d549306753 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:43:39.273320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4caffd3c-da5f-4f44-a6c3-93d549306753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:43:39.342645 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 585/1179] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:43:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:43:39.368242 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcfd42-995b-4f08-a8cf-9eec0868a460 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:39.487751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcfd42-995b-4f08-a8cf-9eec0868a460 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:39.528860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8c799-1c44-491b-a276-2e03641af620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:39.530045 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8c799-1c44-491b-a276-2e03641af620 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:39.530413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8c799-1c44-491b-a276-2e03641af620 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:39.530790 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8c799-1c44-491b-a276-2e03641af620 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:39.543824 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8c799-1c44-491b-a276-2e03641af620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:43:39.551501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-0fd8c799-1c44-491b-a276-2e03641af620 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:43:39.551501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:43:39.551501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:43:39.551501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:43:39.551501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:43:39.551501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:43:39.551501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:43:39.551501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:43:39.551501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:43:39.551501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:43:39.551501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:43:39.551501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:43:39.551501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:43:39.551501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:43:39.551501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:43:39.551501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:43:39.552629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:43:39.552629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:43:39.552629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:43:39.552629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:43:39.552629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:43:39.552629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:43:39.552629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:43:39.552629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:43:39.552629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:43:39.552629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:43:39.552629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:43:39.552629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:43:39.552629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:43:39.552629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:43:39.552629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:43:39.552629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:43:39.553558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:43:39.553558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:43:39.553558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:43:39.553558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:43:39.553558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:43:39.553558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:43:39.553558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:43:39.553558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:43:39.553558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:43:39.553558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:43:39.553558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:43:39.553558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:43:39.553558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 595/1180] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:43:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:43:39.560804 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caffd3c-da5f-4f44-a6c3-93d549306753 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:39.668807 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caffd3c-da5f-4f44-a6c3-93d549306753 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:39.705332 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f42005-862e-4219-acb8-79741027448a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:39.705993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f42005-862e-4219-acb8-79741027448a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:39.706275 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f42005-862e-4219-acb8-79741027448a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:39.706556 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f42005-862e-4219-acb8-79741027448a None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:39.707371 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f42005-862e-4219-acb8-79741027448a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:43:39.707682 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f42005-862e-4219-acb8-79741027448a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:39.709055 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f42005-862e-4219-acb8-79741027448a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:39.716996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 586/1181] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:43:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:39.722861 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8c799-1c44-491b-a276-2e03641af620 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:39.821932 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8c799-1c44-491b-a276-2e03641af620 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:39.855564 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d73767-27fe-4d88-9403-16c32d833dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:39.856428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d73767-27fe-4d88-9403-16c32d833dea None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:39.856712 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d73767-27fe-4d88-9403-16c32d833dea None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:39.856986 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d73767-27fe-4d88-9403-16c32d833dea None admin] PATH_INFO: `/v3/users/0c29c2ff6ffd41fb9de5d105a4b8676f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:39.871128 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d73767-27fe-4d88-9403-16c32d833dea None admin] RBAC: Authorizing `identity:get_user(user_id=0c29c2ff6ffd41fb9de5d105a4b8676f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:39.872578 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d73767-27fe-4d88-9403-16c32d833dea None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:39.874210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 596/1182] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:43:39 2022] GET /identity/v3/users/0c29c2ff6ffd41fb9de5d105a4b8676f => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:39.880091 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f42005-862e-4219-acb8-79741027448a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:39.979493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f42005-862e-4219-acb8-79741027448a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:40.013018 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ebfc3-25ac-4b43-8340-177834ece4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:40.013647 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ebfc3-25ac-4b43-8340-177834ece4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:40.013932 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ebfc3-25ac-4b43-8340-177834ece4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:40.014204 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ebfc3-25ac-4b43-8340-177834ece4d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:40.081942 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ebfc3-25ac-4b43-8340-177834ece4d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:40.083378 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ebfc3-25ac-4b43-8340-177834ece4d3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:40.187274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 587/1183] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:43:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:43:40.193667 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d73767-27fe-4d88-9403-16c32d833dea None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:40.294497 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d73767-27fe-4d88-9403-16c32d833dea None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:40.328426 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295e613-093a-4b22-ac43-4f6387a03956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:40.329390 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295e613-093a-4b22-ac43-4f6387a03956 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:40.333656 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295e613-093a-4b22-ac43-4f6387a03956 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:40.334119 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295e613-093a-4b22-ac43-4f6387a03956 None admin] PATH_INFO: `/v3/projects/6e318efef42c43f48b1853bee709c639` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:40.335636 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295e613-093a-4b22-ac43-4f6387a03956 None admin] RBAC: Authorizing `identity:get_project(project_id=6e318efef42c43f48b1853bee709c639)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:40.337508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295e613-093a-4b22-ac43-4f6387a03956 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:40.339280 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 597/1184] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:43:40 2022] GET /identity/v3/projects/6e318efef42c43f48b1853bee709c639 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:40.345602 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ebfc3-25ac-4b43-8340-177834ece4d3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:40.459317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ebfc3-25ac-4b43-8340-177834ece4d3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:40.492471 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed74d6-f550-44fa-82d7-ef5fd36dd9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:40.493117 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed74d6-f550-44fa-82d7-ef5fd36dd9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:40.493396 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed74d6-f550-44fa-82d7-ef5fd36dd9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:40.493662 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed74d6-f550-44fa-82d7-ef5fd36dd9c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:40.494485 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed74d6-f550-44fa-82d7-ef5fd36dd9c1 None admin] RBAC: Adding query filter params (role.id=5debd8ad07a74bedbf2efd53b11cd7cd, scope.project.id=6e318efef42c43f48b1853bee709c639, user.id=0c29c2ff6ffd41fb9de5d105a4b8676f) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:43:40.494793 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed74d6-f550-44fa-82d7-ef5fd36dd9c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:40.496265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed74d6-f550-44fa-82d7-ef5fd36dd9c1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:40.501704 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 588/1185] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:43:40 2022] GET /identity/v3/role_assignments?user.id=0c29c2ff6ffd41fb9de5d105a4b8676f&scope.project.id=6e318efef42c43f48b1853bee709c639&role.id=5debd8ad07a74bedbf2efd53b11cd7cd => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:42.675200 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ec0c8-5ef5-4d9b-9f15-c2e68ae19955 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:42.676191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ec0c8-5ef5-4d9b-9f15-c2e68ae19955 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:42.676191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ec0c8-5ef5-4d9b-9f15-c2e68ae19955 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:42.678429 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 598/1186] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:43:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:43:42.683974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092fc3f-20b0-456f-afad-28da0ac21677 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:42.684402 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092fc3f-20b0-456f-afad-28da0ac21677 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:42.684500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092fc3f-20b0-456f-afad-28da0ac21677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:42.702449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3092fc3f-20b0-456f-afad-28da0ac21677 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:43:42.703671 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3092fc3f-20b0-456f-afad-28da0ac21677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:43:42.773053 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 589/1187] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:43:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:43:42.795018 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ec0c8-5ef5-4d9b-9f15-c2e68ae19955 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:42.912127 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ec0c8-5ef5-4d9b-9f15-c2e68ae19955 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:42.945192 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd028f0c-84a9-47e3-bfb4-c00c9d54f8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:42.945911 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd028f0c-84a9-47e3-bfb4-c00c9d54f8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:42.946185 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd028f0c-84a9-47e3-bfb4-c00c9d54f8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:42.946458 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd028f0c-84a9-47e3-bfb4-c00c9d54f8e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:42.956060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd028f0c-84a9-47e3-bfb4-c00c9d54f8e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:43:42.963579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-fd028f0c-84a9-47e3-bfb4-c00c9d54f8e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:43:42.963579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:43:42.963579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:43:42.963579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:43:42.963579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:43:42.963579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:43:42.963579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:43:42.963579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:43:42.963579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:43:42.963579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:43:42.963579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:43:42.963579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:43:42.963579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:43:42.963579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:43:42.963579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:43:42.963579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:43:42.964632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:43:42.964632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:43:42.964632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:43:42.964632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:43:42.964632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:43:42.964632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:43:42.964632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:43:42.964632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:43:42.964632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:43:42.964632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:43:42.964632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:43:42.964632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:43:42.964632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:43:42.964632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:43:42.964632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:43:42.964632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:43:42.965506 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:43:42.965506 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:43:42.965506 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:43:42.965506 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:43:42.965506 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:43:42.965506 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:43:42.965506 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:43:42.965506 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:43:42.965506 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:43:42.965506 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:43:42.965506 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:43:42.965506 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:43:42.965506 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 599/1188] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:43:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:43:42.973344 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092fc3f-20b0-456f-afad-28da0ac21677 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:43.074384 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092fc3f-20b0-456f-afad-28da0ac21677 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:43.115690 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdab7ee-1d0e-4279-979a-52d14471e000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:43.116353 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdab7ee-1d0e-4279-979a-52d14471e000 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:43.116626 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdab7ee-1d0e-4279-979a-52d14471e000 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:43.116898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdab7ee-1d0e-4279-979a-52d14471e000 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:43.117640 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdab7ee-1d0e-4279-979a-52d14471e000 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:43:43.117940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdab7ee-1d0e-4279-979a-52d14471e000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:43.119330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdab7ee-1d0e-4279-979a-52d14471e000 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:43.127369 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 590/1189] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:43:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:43.135326 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd028f0c-84a9-47e3-bfb4-c00c9d54f8e3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:43.235664 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd028f0c-84a9-47e3-bfb4-c00c9d54f8e3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:43.268486 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d2670-a404-4b78-b4f9-12277418c5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:43.269334 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d2670-a404-4b78-b4f9-12277418c5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:43.269567 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d2670-a404-4b78-b4f9-12277418c5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:43.269859 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d2670-a404-4b78-b4f9-12277418c5c8 None admin] PATH_INFO: `/v3/users/0c29c2ff6ffd41fb9de5d105a4b8676f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:43.271140 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d2670-a404-4b78-b4f9-12277418c5c8 None admin] RBAC: Authorizing `identity:get_user(user_id=0c29c2ff6ffd41fb9de5d105a4b8676f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:43.272566 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d2670-a404-4b78-b4f9-12277418c5c8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:43.274191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 600/1190] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:43:43 2022] GET /identity/v3/users/0c29c2ff6ffd41fb9de5d105a4b8676f => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:43.280087 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdab7ee-1d0e-4279-979a-52d14471e000 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:43.392329 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdab7ee-1d0e-4279-979a-52d14471e000 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:43.430618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2fe03-e24e-48ce-be83-c6ace7912a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:43.431516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2fe03-e24e-48ce-be83-c6ace7912a65 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:43.431790 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2fe03-e24e-48ce-be83-c6ace7912a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:43.432061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2fe03-e24e-48ce-be83-c6ace7912a65 None admin] PATH_INFO: `/v3/projects/6e318efef42c43f48b1853bee709c639` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:43.433370 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2fe03-e24e-48ce-be83-c6ace7912a65 None admin] RBAC: Authorizing `identity:get_project(project_id=6e318efef42c43f48b1853bee709c639)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:43.434813 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2fe03-e24e-48ce-be83-c6ace7912a65 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:43.436553 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 591/1191] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:43:43 2022] GET /identity/v3/projects/6e318efef42c43f48b1853bee709c639 => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:43.442668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d2670-a404-4b78-b4f9-12277418c5c8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:43.547213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d2670-a404-4b78-b4f9-12277418c5c8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:43.580419 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403a12c-4b59-46b1-8afc-dedf751aec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:43.581299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403a12c-4b59-46b1-8afc-dedf751aec03 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:43.581568 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403a12c-4b59-46b1-8afc-dedf751aec03 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:43.581836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403a12c-4b59-46b1-8afc-dedf751aec03 None admin] PATH_INFO: `/v3/projects/6e318efef42c43f48b1853bee709c639/users/0c29c2ff6ffd41fb9de5d105a4b8676f/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:43.584088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403a12c-4b59-46b1-8afc-dedf751aec03 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e318efef42c43f48b1853bee709c639, user_id=0c29c2ff6ffd41fb9de5d105a4b8676f, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:43.585511 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403a12c-4b59-46b1-8afc-dedf751aec03 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:43.600979 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 601/1192] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:43:43 2022] PUT /identity/v3/projects/6e318efef42c43f48b1853bee709c639/users/0c29c2ff6ffd41fb9de5d105a4b8676f/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:43:45.760394 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07eb86-28d8-4ff7-a84f-ffcf6b00074c None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:45.760981 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07eb86-28d8-4ff7-a84f-ffcf6b00074c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:45.760981 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07eb86-28d8-4ff7-a84f-ffcf6b00074c None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:45.762294 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 592/1193] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:43:45.768830 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a0d2a-0819-4453-9de3-8190770faa42 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:45.769512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a0d2a-0819-4453-9de3-8190770faa42 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:45.769656 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a0d2a-0819-4453-9de3-8190770faa42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:45.789270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-fc8a0d2a-0819-4453-9de3-8190770faa42 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:43:45.790465 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fc8a0d2a-0819-4453-9de3-8190770faa42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:43:45.862057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 602/1194] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:43:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:43:45.885983 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07eb86-28d8-4ff7-a84f-ffcf6b00074c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:45.992672 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07eb86-28d8-4ff7-a84f-ffcf6b00074c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:46.026573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6853512-fbd8-4cee-b6dc-14489fe50e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:46.027310 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6853512-fbd8-4cee-b6dc-14489fe50e61 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:46.027590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6853512-fbd8-4cee-b6dc-14489fe50e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:46.027855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6853512-fbd8-4cee-b6dc-14489fe50e61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:46.037969 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6853512-fbd8-4cee-b6dc-14489fe50e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:43:46.045462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-f6853512-fbd8-4cee-b6dc-14489fe50e61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:43:46.045462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:43:46.045462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:43:46.045462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:43:46.045462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:43:46.045462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:43:46.045462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:43:46.045462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:43:46.045462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:43:46.045462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:43:46.045462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:43:46.045462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:43:46.045462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:43:46.045462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:43:46.045462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:43:46.045462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:43:46.046555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:43:46.046555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:43:46.046555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:43:46.046555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:43:46.046555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:43:46.046555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:43:46.046555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:43:46.046555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:43:46.046555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:43:46.046555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:43:46.046555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:43:46.046555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:43:46.046555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:43:46.046555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:43:46.046555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:43:46.046555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:43:46.047474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:43:46.047474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:43:46.047474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:43:46.047474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:43:46.047474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:43:46.047474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:43:46.047474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:43:46.047474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:43:46.047474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:43:46.047474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:43:46.047474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:43:46.047474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:43:46.047474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 593/1195] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:43:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:43:46.053536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a0d2a-0819-4453-9de3-8190770faa42 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:46.162940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a0d2a-0819-4453-9de3-8190770faa42 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:46.208210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891e432-5e1a-4411-9d6b-6047c3d147cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:46.208877 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891e432-5e1a-4411-9d6b-6047c3d147cf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:46.209161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891e432-5e1a-4411-9d6b-6047c3d147cf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:46.209434 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891e432-5e1a-4411-9d6b-6047c3d147cf None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:46.210181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891e432-5e1a-4411-9d6b-6047c3d147cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:43:46.210486 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891e432-5e1a-4411-9d6b-6047c3d147cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:46.211888 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891e432-5e1a-4411-9d6b-6047c3d147cf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:46.219925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 603/1196] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:43:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:46.226009 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6853512-fbd8-4cee-b6dc-14489fe50e61 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:46.343326 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6853512-fbd8-4cee-b6dc-14489fe50e61 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:46.380057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659df00-e99b-4be2-ab96-9540317b8171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:46.380921 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659df00-e99b-4be2-ab96-9540317b8171 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:46.381195 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659df00-e99b-4be2-ab96-9540317b8171 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:46.381465 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659df00-e99b-4be2-ab96-9540317b8171 None admin] PATH_INFO: `/v3/users/0c29c2ff6ffd41fb9de5d105a4b8676f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:46.382681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659df00-e99b-4be2-ab96-9540317b8171 None admin] RBAC: Authorizing `identity:get_user(user_id=0c29c2ff6ffd41fb9de5d105a4b8676f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:46.384167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659df00-e99b-4be2-ab96-9540317b8171 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:46.385780 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 594/1197] 10.222.0.77 () {56 vars in 1177 bytes} [Wed May 11 06:43:46 2022] GET /identity/v3/users/0c29c2ff6ffd41fb9de5d105a4b8676f => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:46.394497 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891e432-5e1a-4411-9d6b-6047c3d147cf None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:46.498001 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891e432-5e1a-4411-9d6b-6047c3d147cf None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:46.532965 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c952d-2902-4909-9aa3-2cad43cbbdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:46.533610 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c952d-2902-4909-9aa3-2cad43cbbdcf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:46.533887 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c952d-2902-4909-9aa3-2cad43cbbdcf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:46.534165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c952d-2902-4909-9aa3-2cad43cbbdcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:46.608350 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c952d-2902-4909-9aa3-2cad43cbbdcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:46.609726 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c952d-2902-4909-9aa3-2cad43cbbdcf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:46.705529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 604/1198] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:43:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:43:46.711981 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659df00-e99b-4be2-ab96-9540317b8171 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:46.815059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659df00-e99b-4be2-ab96-9540317b8171 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:46.850448 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7244d-f717-4ca5-b9f8-fef5f536e3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:46.851333 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7244d-f717-4ca5-b9f8-fef5f536e3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:46.851615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7244d-f717-4ca5-b9f8-fef5f536e3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:46.851890 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7244d-f717-4ca5-b9f8-fef5f536e3c3 None admin] PATH_INFO: `/v3/projects/6e318efef42c43f48b1853bee709c639` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:46.853407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7244d-f717-4ca5-b9f8-fef5f536e3c3 None admin] RBAC: Authorizing `identity:get_project(project_id=6e318efef42c43f48b1853bee709c639)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:46.854862 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7244d-f717-4ca5-b9f8-fef5f536e3c3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:46.856586 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 595/1199] 10.222.0.77 () {56 vars in 1186 bytes} [Wed May 11 06:43:46 2022] GET /identity/v3/projects/6e318efef42c43f48b1853bee709c639 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:43:46.862943 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c952d-2902-4909-9aa3-2cad43cbbdcf None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:46.963247 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c952d-2902-4909-9aa3-2cad43cbbdcf None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:46.998085 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d3cde-377d-4f9b-9638-198b08ca0474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:46.998727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d3cde-377d-4f9b-9638-198b08ca0474 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:46.999002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d3cde-377d-4f9b-9638-198b08ca0474 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:46.999312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d3cde-377d-4f9b-9638-198b08ca0474 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:47.000135 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d3cde-377d-4f9b-9638-198b08ca0474 None admin] RBAC: Adding query filter params (role.id=5debd8ad07a74bedbf2efd53b11cd7cd, scope.project.id=6e318efef42c43f48b1853bee709c639, user.id=0c29c2ff6ffd41fb9de5d105a4b8676f) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:43:47.000451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d3cde-377d-4f9b-9638-198b08ca0474 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:47.001910 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d3cde-377d-4f9b-9638-198b08ca0474 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:47.007910 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 605/1200] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:43:46 2022] GET /identity/v3/role_assignments?user.id=0c29c2ff6ffd41fb9de5d105a4b8676f&scope.project.id=6e318efef42c43f48b1853bee709c639&role.id=5debd8ad07a74bedbf2efd53b11cd7cd => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:44:47.216455 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c0911-3386-4d36-9d8c-26bab38157e0 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:47.217092 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c0911-3386-4d36-9d8c-26bab38157e0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:47.217092 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c0911-3386-4d36-9d8c-26bab38157e0 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:47.218862 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 596/1201] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:44:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:44:47.225432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a956e-7795-423a-94ab-17d2b059da49 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:47.226119 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a956e-7795-423a-94ab-17d2b059da49 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:47.226119 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a956e-7795-423a-94ab-17d2b059da49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:47.247432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d90a956e-7795-423a-94ab-17d2b059da49 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:44:47.248775 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d90a956e-7795-423a-94ab-17d2b059da49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:47.328304 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 606/1202] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:44:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:44:47.353724 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c0911-3386-4d36-9d8c-26bab38157e0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:47.474848 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c0911-3386-4d36-9d8c-26bab38157e0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:47.531479 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed642c70-41e3-4d24-9d17-1802b625dfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:47.532585 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed642c70-41e3-4d24-9d17-1802b625dfbb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:47.532889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed642c70-41e3-4d24-9d17-1802b625dfbb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:47.533230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed642c70-41e3-4d24-9d17-1802b625dfbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:47.545557 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed642c70-41e3-4d24-9d17-1802b625dfbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:47.547142 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed642c70-41e3-4d24-9d17-1802b625dfbb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:47.568102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-ed642c70-41e3-4d24-9d17-1802b625dfbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:44:47.568102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:44:47.568102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:44:47.568102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:44:47.568102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:44:47.568102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:44:47.568102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:44:47.568102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:44:47.568102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:44:47.568102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:44:47.568102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:44:47.568102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:44:47.568102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:44:47.568102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:44:47.568102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:44:47.569293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:44:47.569293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:44:47.569293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:44:47.569293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:44:47.569293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:44:47.569293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:44:47.569293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:44:47.569293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:44:47.569293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:44:47.569293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:44:47.569293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:44:47.569293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:44:47.569293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:44:47.569293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:44:47.569293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:44:47.569293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:44:47.569293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:44:47.575579 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:44:47.575579 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:44:47.575579 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:44:47.575579 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:44:47.575579 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 597/1203] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:44:47.576156 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a956e-7795-423a-94ab-17d2b059da49 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:47.687812 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a956e-7795-423a-94ab-17d2b059da49 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:47.727183 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbac23-5fc9-40a3-9e80-c04e3aaf4fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:47.727878 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbac23-5fc9-40a3-9e80-c04e3aaf4fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:47.728314 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbac23-5fc9-40a3-9e80-c04e3aaf4fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:47.728653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbac23-5fc9-40a3-9e80-c04e3aaf4fc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:47.729390 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbac23-5fc9-40a3-9e80-c04e3aaf4fc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:44:47.729697 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbac23-5fc9-40a3-9e80-c04e3aaf4fc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:47.731132 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbac23-5fc9-40a3-9e80-c04e3aaf4fc9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:47.746285 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 607/1204] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:44:47.753039 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed642c70-41e3-4d24-9d17-1802b625dfbb None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:47.876812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed642c70-41e3-4d24-9d17-1802b625dfbb None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:47.916103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba1315-bbab-4188-9e10-057a0695c9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:47.916796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba1315-bbab-4188-9e10-057a0695c9dd None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:47.917047 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba1315-bbab-4188-9e10-057a0695c9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:47.917325 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba1315-bbab-4188-9e10-057a0695c9dd None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:47.918393 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba1315-bbab-4188-9e10-057a0695c9dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:47.919890 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba1315-bbab-4188-9e10-057a0695c9dd None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:47.955289 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 598/1205] 10.222.0.77 () {60 vars in 1132 bytes} [Wed May 11 06:44:47 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:44:50.500333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96e34a-326b-4b54-8e23-d0f6a388d596 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:50.500904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96e34a-326b-4b54-8e23-d0f6a388d596 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:50.500904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96e34a-326b-4b54-8e23-d0f6a388d596 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:50.502282 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 608/1206] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:44:50.508414 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473aa02f-1cc7-4806-b9d4-6f83c8a6a839 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:50.508894 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473aa02f-1cc7-4806-b9d4-6f83c8a6a839 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:50.508993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473aa02f-1cc7-4806-b9d4-6f83c8a6a839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:50.528704 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-473aa02f-1cc7-4806-b9d4-6f83c8a6a839 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:44:50.530035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-473aa02f-1cc7-4806-b9d4-6f83c8a6a839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:50.611093 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 599/1207] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:44:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) May 11 06:44:50.636106 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96e34a-326b-4b54-8e23-d0f6a388d596 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:50.752079 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96e34a-326b-4b54-8e23-d0f6a388d596 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:50.788856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542ff4d-909d-4c2d-885b-42cbfd7218e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:50.789676 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542ff4d-909d-4c2d-885b-42cbfd7218e4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:50.789952 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542ff4d-909d-4c2d-885b-42cbfd7218e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:50.790222 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542ff4d-909d-4c2d-885b-42cbfd7218e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:50.802870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542ff4d-909d-4c2d-885b-42cbfd7218e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:44:50.812260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-0542ff4d-909d-4c2d-885b-42cbfd7218e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:44:50.812260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:44:50.812260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:44:50.812260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:44:50.812260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:44:50.812260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:44:50.812260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:44:50.812260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:44:50.812260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:44:50.812260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:44:50.812260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:44:50.812260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:44:50.812260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:44:50.812260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:44:50.812260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:44:50.812260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:44:50.813498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:44:50.813498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:44:50.813498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:44:50.813498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:44:50.813498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:44:50.813498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:44:50.813498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:44:50.813498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:44:50.813498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:44:50.813498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:44:50.813498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:44:50.813498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:44:50.813498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:44:50.813498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:44:50.813498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:44:50.813498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:44:50.814392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:44:50.814392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:44:50.814392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:44:50.814392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:44:50.814392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:44:50.814392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:44:50.814392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:44:50.814392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:44:50.814392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:44:50.814392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:44:50.814392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:44:50.814392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:44:50.814392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 609/1208] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:44:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:44:50.820726 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473aa02f-1cc7-4806-b9d4-6f83c8a6a839 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:50.929153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473aa02f-1cc7-4806-b9d4-6f83c8a6a839 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:50.966109 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bdb50-c25f-448e-bd9b-957568d128be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:50.966980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bdb50-c25f-448e-bd9b-957568d128be None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:50.967366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bdb50-c25f-448e-bd9b-957568d128be None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:50.967736 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bdb50-c25f-448e-bd9b-957568d128be None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:50.968587 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bdb50-c25f-448e-bd9b-957568d128be None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:44:50.968901 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bdb50-c25f-448e-bd9b-957568d128be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:50.970307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bdb50-c25f-448e-bd9b-957568d128be None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:50.979245 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 600/1209] 10.222.0.77 () {56 vars in 1103 bytes} [Wed May 11 06:44:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:44:50.985178 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542ff4d-909d-4c2d-885b-42cbfd7218e4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:51.090267 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542ff4d-909d-4c2d-885b-42cbfd7218e4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:51.126748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2637b-c3ea-4b29-85b6-640ec7e05c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:51.127647 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2637b-c3ea-4b29-85b6-640ec7e05c2d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:51.127927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2637b-c3ea-4b29-85b6-640ec7e05c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:51.128195 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2637b-c3ea-4b29-85b6-640ec7e05c2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:51.146160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2637b-c3ea-4b29-85b6-640ec7e05c2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:51.146160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2637b-c3ea-4b29-85b6-640ec7e05c2d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:51.166723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-20d2637b-c3ea-4b29-85b6-640ec7e05c2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:44:51.166723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:44:51.166723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:44:51.166723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:44:51.166723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:44:51.166723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:44:51.166723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:44:51.166723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:44:51.166723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:44:51.166723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:44:51.166723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:44:51.166723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:44:51.166723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:44:51.166723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:44:51.166723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:44:51.167975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:44:51.167975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:44:51.167975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:44:51.167975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:44:51.167975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:44:51.167975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:44:51.167975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:44:51.167975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:44:51.167975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:44:51.167975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:44:51.167975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:44:51.167975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:44:51.167975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:44:51.167975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:44:51.167975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:44:51.167975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:44:51.167975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:44:51.169151 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:44:51.169151 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:44:51.169151 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:44:51.169151 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:44:51.171114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 610/1210] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:44:51.175227 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bdb50-c25f-448e-bd9b-957568d128be None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:51.288068 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bdb50-c25f-448e-bd9b-957568d128be None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:51.324238 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7aa1ba-7d9d-4a58-a436-a1345d5ccb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:51.325049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7aa1ba-7d9d-4a58-a436-a1345d5ccb93 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:51.325366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7aa1ba-7d9d-4a58-a436-a1345d5ccb93 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:51.325601 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7aa1ba-7d9d-4a58-a436-a1345d5ccb93 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:51.326467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7aa1ba-7d9d-4a58-a436-a1345d5ccb93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:44:51.326843 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7aa1ba-7d9d-4a58-a436-a1345d5ccb93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:51.328497 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7aa1ba-7d9d-4a58-a436-a1345d5ccb93 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:51.342167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 601/1211] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:44:51.348193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2637b-c3ea-4b29-85b6-640ec7e05c2d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:51.457216 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2637b-c3ea-4b29-85b6-640ec7e05c2d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:51.494087 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab282a-7e9c-4c9b-8eb7-b140e4ef128c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:51.494992 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab282a-7e9c-4c9b-8eb7-b140e4ef128c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:51.495281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab282a-7e9c-4c9b-8eb7-b140e4ef128c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:51.495555 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab282a-7e9c-4c9b-8eb7-b140e4ef128c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:51.504304 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab282a-7e9c-4c9b-8eb7-b140e4ef128c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:51.505860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab282a-7e9c-4c9b-8eb7-b140e4ef128c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:51.523570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-54ab282a-7e9c-4c9b-8eb7-b140e4ef128c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 06:44:51.523570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:44:51.523570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:44:51.523570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:44:51.523570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:44:51.523570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:44:51.523570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:44:51.523570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:44:51.523570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:44:51.523570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:44:51.523570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:44:51.523570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:44:51.523570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:44:51.523570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:44:51.523570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:44:51.523570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:44:51.524862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:44:51.524862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:44:51.524862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:44:51.524862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:44:51.524862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:44:51.524862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:44:51.524862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:44:51.524862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:44:51.524862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:44:51.524862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:44:51.524862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:44:51.524862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:44:51.524862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:44:51.524862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:44:51.524862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:44:51.524862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:44:51.524862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:44:51.524862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:44:51.530672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:44:51.530672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:44:51.530672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:44:51.530672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:44:51.530672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:44:51.530672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:44:51.530672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:44:51.530672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:44:51.530672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 06:44:51.530672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:44:51.530672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 611/1212] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:44:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:44:51.532563 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7aa1ba-7d9d-4a58-a436-a1345d5ccb93 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:51.639884 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7aa1ba-7d9d-4a58-a436-a1345d5ccb93 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:51.674214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790eecff-625c-48f4-9f40-8467476c8f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:51.674893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790eecff-625c-48f4-9f40-8467476c8f2b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:51.675227 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790eecff-625c-48f4-9f40-8467476c8f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:51.675495 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790eecff-625c-48f4-9f40-8467476c8f2b None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:51.676410 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790eecff-625c-48f4-9f40-8467476c8f2b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:44:51.676717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790eecff-625c-48f4-9f40-8467476c8f2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:51.678161 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790eecff-625c-48f4-9f40-8467476c8f2b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:51.697009 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 602/1213] 10.222.0.77 () {56 vars in 1143 bytes} [Wed May 11 06:44:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:44:51.702845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab282a-7e9c-4c9b-8eb7-b140e4ef128c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:51.809346 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab282a-7e9c-4c9b-8eb7-b140e4ef128c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:51.847619 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e249c0-9f9b-440a-af94-b62162f706bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:51.848430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e249c0-9f9b-440a-af94-b62162f706bb None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:51.848816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e249c0-9f9b-440a-af94-b62162f706bb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:51.849187 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e249c0-9f9b-440a-af94-b62162f706bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:51.923400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e249c0-9f9b-440a-af94-b62162f706bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:51.924888 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e249c0-9f9b-440a-af94-b62162f706bb None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:52.028389 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 612/1214] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:44:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:44:52.034316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790eecff-625c-48f4-9f40-8467476c8f2b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:52.153254 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790eecff-625c-48f4-9f40-8467476c8f2b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:52.190712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a067b-027b-4812-a950-a72cbf00eea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:52.191605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a067b-027b-4812-a950-a72cbf00eea5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:52.191908 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a067b-027b-4812-a950-a72cbf00eea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:52.192632 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a067b-027b-4812-a950-a72cbf00eea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:52.203580 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a067b-027b-4812-a950-a72cbf00eea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:52.205386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a067b-027b-4812-a950-a72cbf00eea5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:52.223230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-634a067b-027b-4812-a950-a72cbf00eea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:44:52.223230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:44:52.223230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:44:52.223230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:44:52.223230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:44:52.223230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:44:52.223230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:44:52.223230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:44:52.223230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:44:52.223230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:44:52.223230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:44:52.223230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:44:52.223230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:44:52.223230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:44:52.223230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:44:52.224533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:44:52.224533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:44:52.224533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:44:52.224533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:44:52.224533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:44:52.224533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:44:52.224533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:44:52.224533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:44:52.224533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:44:52.224533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:44:52.224533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:44:52.224533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:44:52.224533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:44:52.224533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:44:52.224533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:44:52.224533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:44:52.224533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:44:52.225630 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:44:52.225630 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:44:52.225630 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:44:52.225630 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:44:52.232715 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 603/1215] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:44:52.232909 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e249c0-9f9b-440a-af94-b62162f706bb None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:52.339105 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e249c0-9f9b-440a-af94-b62162f706bb None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:52.374985 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a85e93-7981-49ae-80f6-44082e35b43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:52.375726 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a85e93-7981-49ae-80f6-44082e35b43e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:52.376044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a85e93-7981-49ae-80f6-44082e35b43e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:52.376233 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a85e93-7981-49ae-80f6-44082e35b43e None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:52.376992 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a85e93-7981-49ae-80f6-44082e35b43e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:44:52.377301 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a85e93-7981-49ae-80f6-44082e35b43e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:52.378772 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a85e93-7981-49ae-80f6-44082e35b43e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:52.391531 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 613/1216] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:44:52.397898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a067b-027b-4812-a950-a72cbf00eea5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:52.499388 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a067b-027b-4812-a950-a72cbf00eea5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:52.539970 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f4c4d-6369-4e8c-866f-2677b0c5d73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:52.540921 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f4c4d-6369-4e8c-866f-2677b0c5d73c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:52.541343 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f4c4d-6369-4e8c-866f-2677b0c5d73c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:52.541699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f4c4d-6369-4e8c-866f-2677b0c5d73c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:52.549201 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f4c4d-6369-4e8c-866f-2677b0c5d73c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:52.550833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f4c4d-6369-4e8c-866f-2677b0c5d73c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:52.564760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-3e1f4c4d-6369-4e8c-866f-2677b0c5d73c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:44:52.564760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:44:52.564760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:44:52.564760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:44:52.564760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:44:52.564760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:44:52.564760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:44:52.564760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:44:52.564760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:44:52.564760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:44:52.564760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:44:52.564760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:44:52.564760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:44:52.564760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:44:52.564760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:44:52.568096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:44:52.568096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:44:52.568096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:44:52.568096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:44:52.568096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:44:52.568096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:44:52.568096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:44:52.568096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:44:52.568096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:44:52.568096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:44:52.568096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:44:52.568096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:44:52.568096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:44:52.568096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:44:52.568096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:44:52.568096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:44:52.568096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:44:52.569236 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:44:52.569236 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:44:52.569236 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:44:52.569236 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:44:52.569236 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:44:52.569236 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:44:52.569236 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:44:52.569236 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:44:52.571524 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 604/1217] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:44:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:44:52.572768 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a85e93-7981-49ae-80f6-44082e35b43e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:52.700858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a85e93-7981-49ae-80f6-44082e35b43e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:52.736339 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc9c20-97ce-4347-8cac-ad2e816e9304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:52.737030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc9c20-97ce-4347-8cac-ad2e816e9304 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:52.737315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc9c20-97ce-4347-8cac-ad2e816e9304 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:52.737556 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc9c20-97ce-4347-8cac-ad2e816e9304 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:52.738351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc9c20-97ce-4347-8cac-ad2e816e9304 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:44:52.738685 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc9c20-97ce-4347-8cac-ad2e816e9304 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:52.740152 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc9c20-97ce-4347-8cac-ad2e816e9304 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:52.760787 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 614/1218] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:44:52.762027 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f4c4d-6369-4e8c-866f-2677b0c5d73c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:52.870624 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f4c4d-6369-4e8c-866f-2677b0c5d73c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:52.904591 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762ccd9-c221-403a-be91-7f1925ed1563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:52.905286 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762ccd9-c221-403a-be91-7f1925ed1563 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:52.905628 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762ccd9-c221-403a-be91-7f1925ed1563 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:52.905908 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762ccd9-c221-403a-be91-7f1925ed1563 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:52.906820 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762ccd9-c221-403a-be91-7f1925ed1563 None admin] RBAC: Adding query filter params (role.id=46d109e3a1bd4f13b0d145cde46c75a9, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=d46e2703839e498da8f3e2c3fda1d61c) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:44:52.907166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762ccd9-c221-403a-be91-7f1925ed1563 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:52.913679 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762ccd9-c221-403a-be91-7f1925ed1563 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:52.917160 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 605/1219] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:44:52 2022] GET /identity/v3/role_assignments?user.id=d46e2703839e498da8f3e2c3fda1d61c&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=46d109e3a1bd4f13b0d145cde46c75a9 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:44:55.124345 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6c60c-66f3-4d21-8cae-58543acf2ad6 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:55.124930 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6c60c-66f3-4d21-8cae-58543acf2ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:55.124930 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6c60c-66f3-4d21-8cae-58543acf2ad6 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:55.126528 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 615/1220] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:44:55.131646 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a6a0d-5d08-462f-9611-4cbcdf0b9179 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:55.132198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a6a0d-5d08-462f-9611-4cbcdf0b9179 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:55.132198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a6a0d-5d08-462f-9611-4cbcdf0b9179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:55.148923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-865a6a0d-5d08-462f-9611-4cbcdf0b9179 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:44:55.150120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-865a6a0d-5d08-462f-9611-4cbcdf0b9179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:55.216409 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 606/1221] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:44:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:44:55.238914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6c60c-66f3-4d21-8cae-58543acf2ad6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:55.352889 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6c60c-66f3-4d21-8cae-58543acf2ad6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:55.392170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fc49b-57e0-4767-a2ba-7ea357cdabe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:55.393133 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fc49b-57e0-4767-a2ba-7ea357cdabe4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:55.393420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fc49b-57e0-4767-a2ba-7ea357cdabe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:55.393772 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fc49b-57e0-4767-a2ba-7ea357cdabe4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:55.405323 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7fc49b-57e0-4767-a2ba-7ea357cdabe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:44:55.415948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-4e7fc49b-57e0-4767-a2ba-7ea357cdabe4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:44:55.415948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:44:55.415948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:44:55.415948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:44:55.415948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:44:55.415948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:44:55.415948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:44:55.415948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:44:55.415948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:44:55.415948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:44:55.415948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:44:55.415948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:44:55.415948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:44:55.415948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:44:55.415948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:44:55.415948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:44:55.417193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:44:55.417193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:44:55.417193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:44:55.417193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:44:55.417193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:44:55.417193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:44:55.417193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:44:55.417193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:44:55.417193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:44:55.417193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:44:55.417193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:44:55.417193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:44:55.417193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:44:55.417193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:44:55.417193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:44:55.417193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:44:55.418226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:44:55.418226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:44:55.418226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:44:55.418226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:44:55.418226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:44:55.418226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:44:55.418226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:44:55.418226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:44:55.418226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:44:55.418226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:44:55.418226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:44:55.418226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:44:55.418226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 616/1222] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:44:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:44:55.423538 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a6a0d-5d08-462f-9611-4cbcdf0b9179 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:55.529688 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a6a0d-5d08-462f-9611-4cbcdf0b9179 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:55.570681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c5493-4ec6-461c-9d4d-22e466992406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:55.571402 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c5493-4ec6-461c-9d4d-22e466992406 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:55.571678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c5493-4ec6-461c-9d4d-22e466992406 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:55.571944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c5493-4ec6-461c-9d4d-22e466992406 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:55.572693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c5493-4ec6-461c-9d4d-22e466992406 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:44:55.572998 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c5493-4ec6-461c-9d4d-22e466992406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:55.574368 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c5493-4ec6-461c-9d4d-22e466992406 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:55.582409 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 607/1223] 10.222.0.77 () {56 vars in 1103 bytes} [Wed May 11 06:44:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:44:55.588324 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fc49b-57e0-4767-a2ba-7ea357cdabe4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:55.687995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fc49b-57e0-4767-a2ba-7ea357cdabe4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:55.723629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa0d02-aedb-4536-ba5b-a86ac000f821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:55.724437 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa0d02-aedb-4536-ba5b-a86ac000f821 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:55.724719 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa0d02-aedb-4536-ba5b-a86ac000f821 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:55.724993 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa0d02-aedb-4536-ba5b-a86ac000f821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:55.735634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa0d02-aedb-4536-ba5b-a86ac000f821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:55.737085 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa0d02-aedb-4536-ba5b-a86ac000f821 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:55.753289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-4dfa0d02-aedb-4536-ba5b-a86ac000f821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:44:55.753289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:44:55.753289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:44:55.753289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:44:55.753289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:44:55.753289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:44:55.753289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:44:55.753289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:44:55.753289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:44:55.753289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:44:55.753289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:44:55.753289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:44:55.753289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:44:55.753289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:44:55.753289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:44:55.754344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:44:55.754344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:44:55.754344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:44:55.754344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:44:55.754344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:44:55.754344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:44:55.754344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:44:55.754344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:44:55.754344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:44:55.754344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:44:55.754344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:44:55.754344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:44:55.754344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:44:55.754344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:44:55.754344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:44:55.754344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:44:55.754344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:44:55.755435 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:44:55.755435 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:44:55.755435 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:44:55.755435 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:44:55.755435 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 617/1224] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:44:55.760502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c5493-4ec6-461c-9d4d-22e466992406 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:55.859645 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c5493-4ec6-461c-9d4d-22e466992406 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:55.893920 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca06fe-dedd-40cd-a399-ab45e2caf8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:55.894584 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca06fe-dedd-40cd-a399-ab45e2caf8db None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:55.894857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca06fe-dedd-40cd-a399-ab45e2caf8db None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:55.895155 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca06fe-dedd-40cd-a399-ab45e2caf8db None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:55.895870 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca06fe-dedd-40cd-a399-ab45e2caf8db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:44:55.896177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca06fe-dedd-40cd-a399-ab45e2caf8db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:55.897555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca06fe-dedd-40cd-a399-ab45e2caf8db None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:55.909212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 608/1225] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:44:55.915251 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa0d02-aedb-4536-ba5b-a86ac000f821 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:56.016545 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa0d02-aedb-4536-ba5b-a86ac000f821 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:56.049250 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38782db2-0ef8-4939-aa87-ed6b2d542482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:56.050127 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38782db2-0ef8-4939-aa87-ed6b2d542482 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:56.050408 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38782db2-0ef8-4939-aa87-ed6b2d542482 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:56.050710 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38782db2-0ef8-4939-aa87-ed6b2d542482 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:56.059394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38782db2-0ef8-4939-aa87-ed6b2d542482 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:56.061213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38782db2-0ef8-4939-aa87-ed6b2d542482 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:56.077737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-38782db2-0ef8-4939-aa87-ed6b2d542482 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 06:44:56.077737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:44:56.077737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:44:56.077737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:44:56.077737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:44:56.077737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:44:56.077737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:44:56.077737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:44:56.077737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:44:56.077737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:44:56.077737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:44:56.077737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:44:56.077737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:44:56.077737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:44:56.077737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:44:56.077737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:44:56.079089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:44:56.079089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:44:56.079089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:44:56.079089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:44:56.079089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:44:56.079089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:44:56.079089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:44:56.079089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:44:56.079089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:44:56.079089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:44:56.079089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:44:56.079089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:44:56.079089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:44:56.079089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:44:56.079089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:44:56.079089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:44:56.079089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:44:56.079089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:44:56.080338 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:44:56.080338 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:44:56.080338 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:44:56.080338 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:44:56.080338 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:44:56.080338 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:44:56.080338 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:44:56.080338 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:44:56.080338 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 06:44:56.080338 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:44:56.081239 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 618/1226] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:44:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:44:56.088182 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca06fe-dedd-40cd-a399-ab45e2caf8db None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:56.191413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca06fe-dedd-40cd-a399-ab45e2caf8db None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:56.224930 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943500a-ca64-47b1-adeb-a9577a3e0833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:56.225604 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943500a-ca64-47b1-adeb-a9577a3e0833 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:56.225885 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943500a-ca64-47b1-adeb-a9577a3e0833 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:56.226186 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943500a-ca64-47b1-adeb-a9577a3e0833 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:56.227056 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943500a-ca64-47b1-adeb-a9577a3e0833 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:44:56.227365 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943500a-ca64-47b1-adeb-a9577a3e0833 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:56.228797 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943500a-ca64-47b1-adeb-a9577a3e0833 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:56.246786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 609/1227] 10.222.0.77 () {56 vars in 1143 bytes} [Wed May 11 06:44:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:44:56.253092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38782db2-0ef8-4939-aa87-ed6b2d542482 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:56.359364 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38782db2-0ef8-4939-aa87-ed6b2d542482 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:56.393033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d3661-f2d2-4017-ba3e-5a5b00ce4250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:56.393828 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d3661-f2d2-4017-ba3e-5a5b00ce4250 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:56.394102 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d3661-f2d2-4017-ba3e-5a5b00ce4250 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:56.394370 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d3661-f2d2-4017-ba3e-5a5b00ce4250 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:56.405017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d3661-f2d2-4017-ba3e-5a5b00ce4250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:56.406468 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d3661-f2d2-4017-ba3e-5a5b00ce4250 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:56.422792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f38d3661-f2d2-4017-ba3e-5a5b00ce4250 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:44:56.422792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:44:56.422792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:44:56.422792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:44:56.422792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:44:56.422792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:44:56.422792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:44:56.422792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:44:56.422792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:44:56.422792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:44:56.422792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:44:56.422792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:44:56.422792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:44:56.422792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:44:56.422792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:44:56.423927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:44:56.423927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:44:56.423927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:44:56.423927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:44:56.423927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:44:56.423927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:44:56.423927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:44:56.423927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:44:56.423927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:44:56.423927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:44:56.423927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:44:56.423927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:44:56.423927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:44:56.423927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:44:56.423927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:44:56.423927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:44:56.423927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:44:56.424974 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:44:56.424974 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:44:56.424974 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:44:56.424974 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:44:56.424974 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 619/1228] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:44:56.430257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943500a-ca64-47b1-adeb-a9577a3e0833 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:56.554371 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943500a-ca64-47b1-adeb-a9577a3e0833 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:56.588868 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f10b8-bdca-43dd-abfb-bf70c45acc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:56.589540 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f10b8-bdca-43dd-abfb-bf70c45acc10 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:56.589817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f10b8-bdca-43dd-abfb-bf70c45acc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:56.590087 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f10b8-bdca-43dd-abfb-bf70c45acc10 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:56.590809 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f10b8-bdca-43dd-abfb-bf70c45acc10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:44:56.591148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f10b8-bdca-43dd-abfb-bf70c45acc10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:56.592700 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f10b8-bdca-43dd-abfb-bf70c45acc10 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:56.606450 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 610/1229] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:44:56.611971 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d3661-f2d2-4017-ba3e-5a5b00ce4250 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:56.723172 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d3661-f2d2-4017-ba3e-5a5b00ce4250 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:56.759558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2ec6c-213a-46aa-afc0-ed76cdfaf730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:56.760597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2ec6c-213a-46aa-afc0-ed76cdfaf730 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:56.760882 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2ec6c-213a-46aa-afc0-ed76cdfaf730 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:56.761163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2ec6c-213a-46aa-afc0-ed76cdfaf730 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:56.769434 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2ec6c-213a-46aa-afc0-ed76cdfaf730 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:56.771508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2ec6c-213a-46aa-afc0-ed76cdfaf730 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:56.789184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ece2ec6c-213a-46aa-afc0-ed76cdfaf730 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:44:56.789184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:44:56.789184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:44:56.789184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:44:56.789184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:44:56.789184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:44:56.789184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:44:56.789184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:44:56.789184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:44:56.789184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:44:56.789184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:44:56.789184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:44:56.789184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:44:56.789184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:44:56.789184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:44:56.790393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:44:56.790393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:44:56.790393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:44:56.790393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:44:56.790393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:44:56.790393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:44:56.790393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:44:56.790393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:44:56.790393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:44:56.790393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:44:56.790393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:44:56.790393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:44:56.790393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:44:56.790393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:44:56.790393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:44:56.790393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:44:56.790393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:44:56.791724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:44:56.791724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:44:56.791724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:44:56.791724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:44:56.791724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:44:56.791724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:44:56.791724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:44:56.791724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:44:56.796033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 620/1230] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:44:56.796432 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f10b8-bdca-43dd-abfb-bf70c45acc10 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:56.906459 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f10b8-bdca-43dd-abfb-bf70c45acc10 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:56.949383 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d73fce-c2fc-4c45-8a7e-e40b11ac8a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:56.950162 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d73fce-c2fc-4c45-8a7e-e40b11ac8a73 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:56.950514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d73fce-c2fc-4c45-8a7e-e40b11ac8a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:56.950830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d73fce-c2fc-4c45-8a7e-e40b11ac8a73 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:56.951802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d73fce-c2fc-4c45-8a7e-e40b11ac8a73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:44:56.952156 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d73fce-c2fc-4c45-8a7e-e40b11ac8a73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:56.953749 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d73fce-c2fc-4c45-8a7e-e40b11ac8a73 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:56.968441 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 611/1231] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:44:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:44:56.974554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2ec6c-213a-46aa-afc0-ed76cdfaf730 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:57.088658 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2ec6c-213a-46aa-afc0-ed76cdfaf730 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:57.127986 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45e25a-35ae-43d1-a92d-f6be77aec7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:57.128944 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45e25a-35ae-43d1-a92d-f6be77aec7f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:57.129223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45e25a-35ae-43d1-a92d-f6be77aec7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:57.129497 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45e25a-35ae-43d1-a92d-f6be77aec7f8 None admin] PATH_INFO: `/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/d46e2703839e498da8f3e2c3fda1d61c/roles/46d109e3a1bd4f13b0d145cde46c75a9` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:57.145853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45e25a-35ae-43d1-a92d-f6be77aec7f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f573a9de6904664ace6287072a8a7dc, user_id=d46e2703839e498da8f3e2c3fda1d61c, role_id=46d109e3a1bd4f13b0d145cde46c75a9)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:57.147835 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45e25a-35ae-43d1-a92d-f6be77aec7f8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:57.164929 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 621/1232] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:44:56 2022] PUT /identity/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/d46e2703839e498da8f3e2c3fda1d61c/roles/46d109e3a1bd4f13b0d145cde46c75a9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:44:59.464478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a16ff2-c90a-4140-8196-01059a285814 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:59.465016 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a16ff2-c90a-4140-8196-01059a285814 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:59.465106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a16ff2-c90a-4140-8196-01059a285814 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:59.466406 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 612/1233] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:44:59.474472 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec1e1f-c8da-4365-a2b8-94e1b8214407 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:59.475133 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec1e1f-c8da-4365-a2b8-94e1b8214407 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:59.475133 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec1e1f-c8da-4365-a2b8-94e1b8214407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:59.493768 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4dec1e1f-c8da-4365-a2b8-94e1b8214407 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:44:59.494980 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4dec1e1f-c8da-4365-a2b8-94e1b8214407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:59.575438 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 622/1234] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:44:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:44:59.598522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a16ff2-c90a-4140-8196-01059a285814 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:59.702562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a16ff2-c90a-4140-8196-01059a285814 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:59.736235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee3318-95f8-4933-92ca-6c0bc8a5a614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:59.737038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee3318-95f8-4933-92ca-6c0bc8a5a614 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:59.737318 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee3318-95f8-4933-92ca-6c0bc8a5a614 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:59.737594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee3318-95f8-4933-92ca-6c0bc8a5a614 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:59.748139 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee3318-95f8-4933-92ca-6c0bc8a5a614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:44:59.756500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-8fee3318-95f8-4933-92ca-6c0bc8a5a614 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:44:59.756500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:44:59.756500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:44:59.756500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:44:59.756500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:44:59.756500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:44:59.756500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:44:59.756500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:44:59.756500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:44:59.756500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:44:59.756500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:44:59.756500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:44:59.756500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:44:59.756500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:44:59.756500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:44:59.756500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:44:59.757638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:44:59.757638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:44:59.757638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:44:59.757638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:44:59.757638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:44:59.757638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:44:59.757638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:44:59.757638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:44:59.757638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:44:59.757638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:44:59.757638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:44:59.757638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:44:59.757638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:44:59.757638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:44:59.757638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:44:59.757638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:44:59.758509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:44:59.758509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:44:59.758509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:44:59.758509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:44:59.758509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:44:59.758509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:44:59.758509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:44:59.758509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:44:59.758509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:44:59.758509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:44:59.758509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:44:59.758509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:44:59.758509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 613/1235] 10.222.0.77 () {56 vars in 1102 bytes} [Wed May 11 06:44:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:44:59.764526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec1e1f-c8da-4365-a2b8-94e1b8214407 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:59.866017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec1e1f-c8da-4365-a2b8-94e1b8214407 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:59.899881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6ee1a-bb9d-47ea-a52d-05fee5f7ce09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:59.900556 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6ee1a-bb9d-47ea-a52d-05fee5f7ce09 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:59.900857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6ee1a-bb9d-47ea-a52d-05fee5f7ce09 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:59.901127 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6ee1a-bb9d-47ea-a52d-05fee5f7ce09 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:59.901878 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6ee1a-bb9d-47ea-a52d-05fee5f7ce09 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:44:59.902183 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6ee1a-bb9d-47ea-a52d-05fee5f7ce09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:59.903601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6ee1a-bb9d-47ea-a52d-05fee5f7ce09 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:59.911719 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 623/1236] 10.222.0.77 () {56 vars in 1103 bytes} [Wed May 11 06:44:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:44:59.917708 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee3318-95f8-4933-92ca-6c0bc8a5a614 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:00.018561 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee3318-95f8-4933-92ca-6c0bc8a5a614 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:00.052894 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca7390-a8bc-4d4f-9efa-d446a5fa8d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:00.053749 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca7390-a8bc-4d4f-9efa-d446a5fa8d24 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:00.054030 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca7390-a8bc-4d4f-9efa-d446a5fa8d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:00.054309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca7390-a8bc-4d4f-9efa-d446a5fa8d24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:00.066017 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca7390-a8bc-4d4f-9efa-d446a5fa8d24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:00.068179 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca7390-a8bc-4d4f-9efa-d446a5fa8d24 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:00.086801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-94ca7390-a8bc-4d4f-9efa-d446a5fa8d24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:45:00.086801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:00.086801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:45:00.086801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:45:00.086801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:45:00.086801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:45:00.086801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:45:00.086801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:45:00.086801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:45:00.086801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:45:00.086801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:45:00.086801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:45:00.086801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:45:00.086801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:45:00.086801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:45:00.087935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:45:00.087935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:45:00.087935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:45:00.087935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:45:00.087935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:45:00.087935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:45:00.087935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:45:00.087935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:45:00.087935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:45:00.087935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:45:00.087935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:45:00.087935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:45:00.087935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:45:00.087935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:45:00.087935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:45:00.087935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:45:00.087935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:45:00.089083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:45:00.089083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:45:00.089083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:45:00.089083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:45:00.089083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 614/1237] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:45:00.094135 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6ee1a-bb9d-47ea-a52d-05fee5f7ce09 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:00.196704 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6ee1a-bb9d-47ea-a52d-05fee5f7ce09 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:00.230868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78cacd-acce-4e77-b226-e489155dd992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:00.231565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78cacd-acce-4e77-b226-e489155dd992 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:00.231899 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78cacd-acce-4e77-b226-e489155dd992 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:00.232185 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78cacd-acce-4e77-b226-e489155dd992 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:00.232925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78cacd-acce-4e77-b226-e489155dd992 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:00.233236 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78cacd-acce-4e77-b226-e489155dd992 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:00.234646 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78cacd-acce-4e77-b226-e489155dd992 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:00.251424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 624/1238] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:45:00.252861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca7390-a8bc-4d4f-9efa-d446a5fa8d24 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:00.364398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca7390-a8bc-4d4f-9efa-d446a5fa8d24 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:00.401151 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dfbd7-3c8f-43fe-9e38-8e56eb0a2183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:00.402006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dfbd7-3c8f-43fe-9e38-8e56eb0a2183 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:00.402285 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dfbd7-3c8f-43fe-9e38-8e56eb0a2183 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:00.402558 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dfbd7-3c8f-43fe-9e38-8e56eb0a2183 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:00.411346 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246dfbd7-3c8f-43fe-9e38-8e56eb0a2183 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:00.412903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246dfbd7-3c8f-43fe-9e38-8e56eb0a2183 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:00.428194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-246dfbd7-3c8f-43fe-9e38-8e56eb0a2183 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 06:45:00.428194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:00.428194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:45:00.428194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:45:00.428194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:45:00.428194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:45:00.428194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:45:00.428194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:45:00.428194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:45:00.428194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:45:00.428194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:45:00.428194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:45:00.428194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:45:00.428194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:45:00.428194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:45:00.428194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:45:00.429387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:45:00.429387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:45:00.429387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:45:00.429387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:45:00.429387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:45:00.429387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:45:00.429387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:45:00.429387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:45:00.429387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:45:00.429387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:45:00.429387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:45:00.429387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:45:00.429387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:45:00.429387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:45:00.429387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:45:00.429387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:45:00.429387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:45:00.429387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:45:00.430711 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:45:00.430711 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:45:00.430711 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:45:00.430711 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:45:00.430711 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:45:00.430711 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:45:00.430711 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:45:00.430711 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:45:00.430711 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 06:45:00.430711 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:45:00.430711 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 615/1239] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:45:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:45:00.436689 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78cacd-acce-4e77-b226-e489155dd992 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:00.549032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78cacd-acce-4e77-b226-e489155dd992 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:00.591563 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085c17d-ddcf-405b-96b7-1e49b538015e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:00.592242 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085c17d-ddcf-405b-96b7-1e49b538015e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:00.592694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085c17d-ddcf-405b-96b7-1e49b538015e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:00.593039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085c17d-ddcf-405b-96b7-1e49b538015e None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:00.594175 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085c17d-ddcf-405b-96b7-1e49b538015e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:00.594623 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085c17d-ddcf-405b-96b7-1e49b538015e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:00.596549 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085c17d-ddcf-405b-96b7-1e49b538015e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:00.614072 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 625/1240] 10.222.0.77 () {56 vars in 1143 bytes} [Wed May 11 06:45:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:45:00.620479 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dfbd7-3c8f-43fe-9e38-8e56eb0a2183 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:00.724618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dfbd7-3c8f-43fe-9e38-8e56eb0a2183 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:00.762621 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60d83f-ec9d-4fbd-9070-21d7e00e80c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:00.763473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60d83f-ec9d-4fbd-9070-21d7e00e80c1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:00.763807 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60d83f-ec9d-4fbd-9070-21d7e00e80c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:00.764121 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60d83f-ec9d-4fbd-9070-21d7e00e80c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:00.830912 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60d83f-ec9d-4fbd-9070-21d7e00e80c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:00.832316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60d83f-ec9d-4fbd-9070-21d7e00e80c1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:00.932235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 616/1241] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:45:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:45:00.938312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085c17d-ddcf-405b-96b7-1e49b538015e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:01.042617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085c17d-ddcf-405b-96b7-1e49b538015e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:01.078099 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea261d1a-0240-4473-b81b-46402407490b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:01.078890 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea261d1a-0240-4473-b81b-46402407490b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:01.079205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea261d1a-0240-4473-b81b-46402407490b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:01.079519 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea261d1a-0240-4473-b81b-46402407490b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:01.090597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea261d1a-0240-4473-b81b-46402407490b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:01.092218 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea261d1a-0240-4473-b81b-46402407490b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:01.113118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ea261d1a-0240-4473-b81b-46402407490b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:45:01.113118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:01.113118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:45:01.113118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:45:01.113118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:45:01.113118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:45:01.113118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:45:01.113118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:45:01.113118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:45:01.113118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:45:01.113118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:45:01.113118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:45:01.113118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:45:01.113118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:45:01.113118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:45:01.114312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:45:01.114312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:45:01.114312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:45:01.114312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:45:01.114312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:45:01.114312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:45:01.114312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:45:01.114312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:45:01.114312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:45:01.114312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:45:01.114312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:45:01.114312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:45:01.114312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:45:01.114312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:45:01.114312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:45:01.114312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:45:01.114312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:45:01.115284 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:45:01.115284 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:45:01.115284 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:45:01.115284 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:45:01.115284 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 626/1242] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:45:01.120453 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60d83f-ec9d-4fbd-9070-21d7e00e80c1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:01.224626 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60d83f-ec9d-4fbd-9070-21d7e00e80c1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:01.259995 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ebc5a-6bdd-41e7-b409-333c1bcacad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:01.260761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ebc5a-6bdd-41e7-b409-333c1bcacad1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:01.261034 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ebc5a-6bdd-41e7-b409-333c1bcacad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:01.261336 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ebc5a-6bdd-41e7-b409-333c1bcacad1 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:01.262133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ebc5a-6bdd-41e7-b409-333c1bcacad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:01.262508 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ebc5a-6bdd-41e7-b409-333c1bcacad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:01.264028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ebc5a-6bdd-41e7-b409-333c1bcacad1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:01.276463 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 617/1243] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:45:01.284715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea261d1a-0240-4473-b81b-46402407490b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:01.397651 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea261d1a-0240-4473-b81b-46402407490b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:01.434583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92eb9b-7cc2-4ba1-8a88-e598bcd1ab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:01.435426 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92eb9b-7cc2-4ba1-8a88-e598bcd1ab3d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:01.435705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92eb9b-7cc2-4ba1-8a88-e598bcd1ab3d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:01.435974 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92eb9b-7cc2-4ba1-8a88-e598bcd1ab3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:01.444321 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92eb9b-7cc2-4ba1-8a88-e598bcd1ab3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:01.446145 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92eb9b-7cc2-4ba1-8a88-e598bcd1ab3d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:01.464802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-eb92eb9b-7cc2-4ba1-8a88-e598bcd1ab3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:45:01.464802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:01.464802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:45:01.464802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:45:01.464802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:45:01.464802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:45:01.464802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:45:01.464802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:45:01.464802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:45:01.464802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:45:01.464802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:45:01.464802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:45:01.464802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:45:01.464802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:45:01.464802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:45:01.465826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:45:01.465826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:45:01.465826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:45:01.465826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:45:01.465826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:45:01.465826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:45:01.465826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:45:01.465826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:45:01.465826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:45:01.465826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:45:01.465826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:45:01.465826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:45:01.465826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:45:01.465826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:45:01.465826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:45:01.465826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:45:01.465826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:45:01.471811 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:45:01.471811 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:45:01.471811 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:45:01.471811 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:45:01.471811 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:45:01.471811 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:45:01.471811 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:45:01.471811 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:45:01.471811 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 627/1244] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:45:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:45:01.472345 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ebc5a-6bdd-41e7-b409-333c1bcacad1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:01.585544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ebc5a-6bdd-41e7-b409-333c1bcacad1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:01.621039 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e30929-909e-49d1-8208-6e6c5ce37e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:01.621829 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e30929-909e-49d1-8208-6e6c5ce37e2d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:01.621957 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e30929-909e-49d1-8208-6e6c5ce37e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:01.622226 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e30929-909e-49d1-8208-6e6c5ce37e2d None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:01.623028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e30929-909e-49d1-8208-6e6c5ce37e2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:01.623337 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e30929-909e-49d1-8208-6e6c5ce37e2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:01.624772 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e30929-909e-49d1-8208-6e6c5ce37e2d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:01.636512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 618/1245] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:45:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:45:01.643075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92eb9b-7cc2-4ba1-8a88-e598bcd1ab3d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:01.747666 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92eb9b-7cc2-4ba1-8a88-e598bcd1ab3d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:01.782430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec983bb-393d-4659-965b-44d8bb021684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:01.783124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec983bb-393d-4659-965b-44d8bb021684 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:01.783489 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec983bb-393d-4659-965b-44d8bb021684 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:01.783742 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec983bb-393d-4659-965b-44d8bb021684 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:01.784592 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec983bb-393d-4659-965b-44d8bb021684 None admin] RBAC: Adding query filter params (role.id=46d109e3a1bd4f13b0d145cde46c75a9, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=d46e2703839e498da8f3e2c3fda1d61c) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:01.784943 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec983bb-393d-4659-965b-44d8bb021684 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:01.786472 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec983bb-393d-4659-965b-44d8bb021684 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:01.794083 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 628/1246] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:45:01 2022] GET /identity/v3/role_assignments?user.id=d46e2703839e498da8f3e2c3fda1d61c&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=46d109e3a1bd4f13b0d145cde46c75a9 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:45:04.145308 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffd3aa-cf0e-4ac7-a689-77cfec32408c None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:04.145906 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffd3aa-cf0e-4ac7-a689-77cfec32408c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:04.145906 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffd3aa-cf0e-4ac7-a689-77cfec32408c None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:04.147451 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 619/1247] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:45:04.152926 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77820477-5c5e-4a2c-a1a1-c3a5021a65ff None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:04.153431 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77820477-5c5e-4a2c-a1a1-c3a5021a65ff None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:04.153431 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77820477-5c5e-4a2c-a1a1-c3a5021a65ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:04.170799 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-77820477-5c5e-4a2c-a1a1-c3a5021a65ff None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:45:04.172119 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-77820477-5c5e-4a2c-a1a1-c3a5021a65ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:04.239995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 629/1248] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:45:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:45:04.264217 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffd3aa-cf0e-4ac7-a689-77cfec32408c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:04.377272 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffd3aa-cf0e-4ac7-a689-77cfec32408c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:04.411821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d48f5-f6a6-4b2a-94ce-dedb9f2e103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:04.412665 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d48f5-f6a6-4b2a-94ce-dedb9f2e103d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:04.412944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d48f5-f6a6-4b2a-94ce-dedb9f2e103d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:04.413213 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d48f5-f6a6-4b2a-94ce-dedb9f2e103d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:04.423621 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d48f5-f6a6-4b2a-94ce-dedb9f2e103d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:45:04.431754 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-6f8d48f5-f6a6-4b2a-94ce-dedb9f2e103d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:45:04.431754 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:04.431754 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:45:04.431754 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:45:04.431754 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:45:04.431754 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:45:04.431754 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:45:04.431754 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:45:04.431754 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:45:04.431754 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:45:04.431754 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:45:04.431754 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:45:04.431754 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:45:04.431754 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:45:04.431754 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:45:04.431754 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:45:04.435202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:45:04.435202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:45:04.435202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:45:04.435202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:45:04.435202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:45:04.435202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:45:04.435202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:45:04.435202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:45:04.435202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:45:04.435202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:45:04.435202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:45:04.435202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:45:04.435202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:45:04.435202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:45:04.435202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:45:04.435202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:45:04.436134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:45:04.436134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:45:04.436134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:45:04.436134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:45:04.436134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:45:04.436134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:45:04.436134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:45:04.436134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:45:04.436134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:45:04.436134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:45:04.436134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:45:04.436134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:45:04.436134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 620/1249] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:45:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:45:04.439608 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77820477-5c5e-4a2c-a1a1-c3a5021a65ff None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:04.547629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77820477-5c5e-4a2c-a1a1-c3a5021a65ff None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:04.592966 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b1ac1-b69b-4bc3-9948-08e50234bf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:04.593725 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b1ac1-b69b-4bc3-9948-08e50234bf14 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:04.594040 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b1ac1-b69b-4bc3-9948-08e50234bf14 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:04.594310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b1ac1-b69b-4bc3-9948-08e50234bf14 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:04.595231 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b1ac1-b69b-4bc3-9948-08e50234bf14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:04.595578 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b1ac1-b69b-4bc3-9948-08e50234bf14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:04.597049 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b1ac1-b69b-4bc3-9948-08e50234bf14 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:04.606110 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 630/1250] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:45:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:45:04.611920 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d48f5-f6a6-4b2a-94ce-dedb9f2e103d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:04.725400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d48f5-f6a6-4b2a-94ce-dedb9f2e103d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:04.762763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8244c2-2c64-4dbf-be50-d4b900d05b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:04.763612 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8244c2-2c64-4dbf-be50-d4b900d05b5a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:04.763886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8244c2-2c64-4dbf-be50-d4b900d05b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:04.764154 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8244c2-2c64-4dbf-be50-d4b900d05b5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:04.779189 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8244c2-2c64-4dbf-be50-d4b900d05b5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:04.781291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8244c2-2c64-4dbf-be50-d4b900d05b5a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:04.800594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-1b8244c2-2c64-4dbf-be50-d4b900d05b5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:45:04.800594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:04.800594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:45:04.800594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:45:04.800594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:45:04.800594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:45:04.800594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:45:04.800594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:45:04.800594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:45:04.800594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:45:04.800594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:45:04.800594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:45:04.800594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:45:04.800594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:45:04.800594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:45:04.801864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:45:04.801864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:45:04.801864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:45:04.801864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:45:04.801864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:45:04.801864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:45:04.801864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:45:04.801864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:45:04.801864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:45:04.801864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:45:04.801864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:45:04.801864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:45:04.801864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:45:04.801864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:45:04.801864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:45:04.801864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:45:04.801864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:45:04.803139 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:45:04.803139 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:45:04.803139 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:45:04.803139 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:45:04.803139 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 621/1251] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:45:04.808200 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b1ac1-b69b-4bc3-9948-08e50234bf14 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:04.917113 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b1ac1-b69b-4bc3-9948-08e50234bf14 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:04.958765 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89971a-6510-4e8b-8ecc-ac6625451f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:04.959544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89971a-6510-4e8b-8ecc-ac6625451f14 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:04.959883 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89971a-6510-4e8b-8ecc-ac6625451f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:04.960160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89971a-6510-4e8b-8ecc-ac6625451f14 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:04.960896 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89971a-6510-4e8b-8ecc-ac6625451f14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:04.961247 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89971a-6510-4e8b-8ecc-ac6625451f14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:04.962754 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89971a-6510-4e8b-8ecc-ac6625451f14 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:04.976632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 631/1252] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:45:04.982734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8244c2-2c64-4dbf-be50-d4b900d05b5a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:05.088561 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8244c2-2c64-4dbf-be50-d4b900d05b5a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:05.125155 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946249a1-908e-43bc-bd3f-01db7225b0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:05.125155 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946249a1-908e-43bc-bd3f-01db7225b0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:05.125155 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946249a1-908e-43bc-bd3f-01db7225b0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:05.125155 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946249a1-908e-43bc-bd3f-01db7225b0e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:05.133076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946249a1-908e-43bc-bd3f-01db7225b0e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:05.134535 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946249a1-908e-43bc-bd3f-01db7225b0e0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:05.148889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-946249a1-908e-43bc-bd3f-01db7225b0e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 06:45:05.148889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:05.148889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:45:05.148889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:45:05.148889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:45:05.148889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:45:05.148889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:45:05.148889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:45:05.148889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:45:05.148889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:45:05.148889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:45:05.148889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:45:05.148889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:45:05.148889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:45:05.148889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:45:05.148889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:45:05.150655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:45:05.150655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:45:05.150655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:45:05.150655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:45:05.150655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:45:05.150655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:45:05.150655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:45:05.150655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:45:05.150655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:45:05.150655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:45:05.150655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:45:05.150655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:45:05.150655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:45:05.150655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:45:05.150655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:45:05.150655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:45:05.150655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:45:05.150655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:45:05.151678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:45:05.151678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:45:05.151678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:45:05.151678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:45:05.151678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:45:05.151678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:45:05.151678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:45:05.151678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:45:05.151678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 06:45:05.151678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:45:05.151678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 622/1253] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:45:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:45:05.156642 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89971a-6510-4e8b-8ecc-ac6625451f14 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:05.272818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89971a-6510-4e8b-8ecc-ac6625451f14 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:05.315017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fab65-5b4f-41ff-946f-1c37c58a4cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:05.315716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fab65-5b4f-41ff-946f-1c37c58a4cac None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:05.316003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fab65-5b4f-41ff-946f-1c37c58a4cac None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:05.316374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fab65-5b4f-41ff-946f-1c37c58a4cac None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:05.317872 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599fab65-5b4f-41ff-946f-1c37c58a4cac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:05.319977 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599fab65-5b4f-41ff-946f-1c37c58a4cac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:05.319977 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599fab65-5b4f-41ff-946f-1c37c58a4cac None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:05.340292 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 632/1254] 10.222.0.77 () {56 vars in 1143 bytes} [Wed May 11 06:45:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:45:05.347092 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946249a1-908e-43bc-bd3f-01db7225b0e0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:05.461902 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946249a1-908e-43bc-bd3f-01db7225b0e0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:05.500830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f991d9-9448-4a5e-9727-1cc57f6bf6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:05.501732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f991d9-9448-4a5e-9727-1cc57f6bf6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:05.502195 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f991d9-9448-4a5e-9727-1cc57f6bf6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:05.502498 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f991d9-9448-4a5e-9727-1cc57f6bf6e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:05.584118 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f991d9-9448-4a5e-9727-1cc57f6bf6e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:05.585516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f991d9-9448-4a5e-9727-1cc57f6bf6e3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:05.695459 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 623/1255] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:45:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:45:05.701473 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fab65-5b4f-41ff-946f-1c37c58a4cac None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:05.809418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fab65-5b4f-41ff-946f-1c37c58a4cac None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:05.844888 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ca910-3350-4c9d-be35-d7a0da3a2b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:05.845620 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ca910-3350-4c9d-be35-d7a0da3a2b8e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:05.845878 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ca910-3350-4c9d-be35-d7a0da3a2b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:05.846186 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ca910-3350-4c9d-be35-d7a0da3a2b8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:05.856294 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ca910-3350-4c9d-be35-d7a0da3a2b8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:05.857755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ca910-3350-4c9d-be35-d7a0da3a2b8e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:05.876092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-141ca910-3350-4c9d-be35-d7a0da3a2b8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:45:05.876092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:05.876092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:45:05.876092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:45:05.876092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:45:05.876092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:45:05.876092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:45:05.876092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:45:05.876092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:45:05.876092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:45:05.876092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:45:05.876092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:45:05.876092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:45:05.876092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:45:05.876092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:45:05.877287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:45:05.877287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:45:05.877287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:45:05.877287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:45:05.877287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:45:05.877287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:45:05.877287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:45:05.877287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:45:05.877287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:45:05.877287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:45:05.877287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:45:05.877287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:45:05.877287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:45:05.877287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:45:05.877287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:45:05.877287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:45:05.877287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:45:05.878620 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:45:05.878620 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:45:05.878620 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:45:05.878620 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:45:05.878620 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 633/1256] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:45:05.883349 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f991d9-9448-4a5e-9727-1cc57f6bf6e3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:05.980723 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f991d9-9448-4a5e-9727-1cc57f6bf6e3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:06.016866 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cb8de-5ddf-4b3b-ae4f-bdff829d02e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:06.017574 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cb8de-5ddf-4b3b-ae4f-bdff829d02e4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:06.017843 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cb8de-5ddf-4b3b-ae4f-bdff829d02e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:06.018124 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cb8de-5ddf-4b3b-ae4f-bdff829d02e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:06.018912 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940cb8de-5ddf-4b3b-ae4f-bdff829d02e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:06.019256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940cb8de-5ddf-4b3b-ae4f-bdff829d02e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:06.020717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940cb8de-5ddf-4b3b-ae4f-bdff829d02e4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:06.032742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 624/1257] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:45:06.039673 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ca910-3350-4c9d-be35-d7a0da3a2b8e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:06.147756 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ca910-3350-4c9d-be35-d7a0da3a2b8e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:06.181530 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f81be8-4739-403f-a213-853c0a99fc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:06.182336 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f81be8-4739-403f-a213-853c0a99fc69 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:06.182618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f81be8-4739-403f-a213-853c0a99fc69 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:06.182890 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f81be8-4739-403f-a213-853c0a99fc69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:06.189556 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f81be8-4739-403f-a213-853c0a99fc69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:06.191035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f81be8-4739-403f-a213-853c0a99fc69 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:06.205694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a0f81be8-4739-403f-a213-853c0a99fc69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:45:06.205694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:06.205694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:45:06.205694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:45:06.205694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:45:06.205694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:45:06.205694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:45:06.205694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:45:06.205694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:45:06.205694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:45:06.205694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:45:06.205694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:45:06.205694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:45:06.205694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:45:06.205694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:45:06.206848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:45:06.206848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:45:06.206848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:45:06.206848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:45:06.206848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:45:06.206848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:45:06.206848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:45:06.206848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:45:06.206848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:45:06.206848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:45:06.206848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:45:06.206848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:45:06.206848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:45:06.206848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:45:06.206848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:45:06.206848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:45:06.206848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:45:06.207940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:45:06.207940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:45:06.207940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:45:06.207940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:45:06.207940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:45:06.207940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:45:06.207940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:45:06.207940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:45:06.207940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 634/1258] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:45:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:45:06.213182 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cb8de-5ddf-4b3b-ae4f-bdff829d02e4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:06.315108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cb8de-5ddf-4b3b-ae4f-bdff829d02e4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:06.349219 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8e935-32a6-4d78-89e2-9e5528ba4ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:06.349920 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8e935-32a6-4d78-89e2-9e5528ba4ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:06.350210 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8e935-32a6-4d78-89e2-9e5528ba4ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:06.350482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8e935-32a6-4d78-89e2-9e5528ba4ed7 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:06.351303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8e935-32a6-4d78-89e2-9e5528ba4ed7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:06.351609 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8e935-32a6-4d78-89e2-9e5528ba4ed7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:06.353049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8e935-32a6-4d78-89e2-9e5528ba4ed7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:06.365190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 625/1259] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:45:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:45:06.371197 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f81be8-4739-403f-a213-853c0a99fc69 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:06.478126 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f81be8-4739-403f-a213-853c0a99fc69 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:06.515271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd796ecd-0bb8-4e16-b19c-7fb86b17ec69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:06.515958 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd796ecd-0bb8-4e16-b19c-7fb86b17ec69 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:06.516244 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd796ecd-0bb8-4e16-b19c-7fb86b17ec69 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:06.516630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd796ecd-0bb8-4e16-b19c-7fb86b17ec69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:06.517406 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd796ecd-0bb8-4e16-b19c-7fb86b17ec69 None admin] RBAC: Adding query filter params (role.id=5debd8ad07a74bedbf2efd53b11cd7cd, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=d46e2703839e498da8f3e2c3fda1d61c) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:06.517668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd796ecd-0bb8-4e16-b19c-7fb86b17ec69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:06.519164 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd796ecd-0bb8-4e16-b19c-7fb86b17ec69 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:06.537805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 635/1260] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:45:06 2022] GET /identity/v3/role_assignments?user.id=d46e2703839e498da8f3e2c3fda1d61c&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=5debd8ad07a74bedbf2efd53b11cd7cd => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:45:08.711128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bab94-3051-4c74-86d3-fd9b103e7d6c None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:08.711728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bab94-3051-4c74-86d3-fd9b103e7d6c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:08.711728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bab94-3051-4c74-86d3-fd9b103e7d6c None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:08.713054 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 626/1261] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:45:08.719498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a154e0f-d25d-430c-93d8-d24fa85e5ded None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:08.720223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a154e0f-d25d-430c-93d8-d24fa85e5ded None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:08.720362 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a154e0f-d25d-430c-93d8-d24fa85e5ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:08.741233 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5a154e0f-d25d-430c-93d8-d24fa85e5ded None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:45:08.742491 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5a154e0f-d25d-430c-93d8-d24fa85e5ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:08.815985 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 636/1262] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:45:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:45:08.846234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bab94-3051-4c74-86d3-fd9b103e7d6c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:08.959528 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bab94-3051-4c74-86d3-fd9b103e7d6c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:09.000399 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78eb22c-d72c-46c7-b499-5909ff6aa85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:09.001116 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78eb22c-d72c-46c7-b499-5909ff6aa85c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:09.001392 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78eb22c-d72c-46c7-b499-5909ff6aa85c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:09.001667 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78eb22c-d72c-46c7-b499-5909ff6aa85c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:09.012059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78eb22c-d72c-46c7-b499-5909ff6aa85c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:45:09.019625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-f78eb22c-d72c-46c7-b499-5909ff6aa85c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:45:09.019625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:09.019625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:45:09.019625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:45:09.019625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:45:09.019625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:45:09.019625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:45:09.019625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:45:09.019625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:45:09.019625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:45:09.019625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:45:09.019625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:45:09.019625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:45:09.019625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:45:09.019625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:45:09.019625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:45:09.020737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:45:09.020737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:45:09.020737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:45:09.020737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:45:09.020737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:45:09.020737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:45:09.020737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:45:09.020737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:45:09.020737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:45:09.020737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:45:09.020737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:45:09.020737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:45:09.020737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:45:09.020737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:45:09.020737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:45:09.020737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:45:09.021692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:45:09.021692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:45:09.021692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:45:09.021692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:45:09.021692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:45:09.021692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:45:09.021692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:45:09.021692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:45:09.021692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:45:09.021692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:45:09.021692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:45:09.021692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:45:09.021692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 627/1263] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:45:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:45:09.028302 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a154e0f-d25d-430c-93d8-d24fa85e5ded None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:09.132547 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a154e0f-d25d-430c-93d8-d24fa85e5ded None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:09.168343 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63fbea-4f8d-4124-a943-69136bb4c4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:09.169010 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63fbea-4f8d-4124-a943-69136bb4c4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:09.169289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63fbea-4f8d-4124-a943-69136bb4c4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:09.169557 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63fbea-4f8d-4124-a943-69136bb4c4a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:09.170302 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63fbea-4f8d-4124-a943-69136bb4c4a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:09.170610 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63fbea-4f8d-4124-a943-69136bb4c4a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:09.172025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63fbea-4f8d-4124-a943-69136bb4c4a2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:09.180545 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 637/1264] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:45:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:45:09.187017 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78eb22c-d72c-46c7-b499-5909ff6aa85c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:09.300303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78eb22c-d72c-46c7-b499-5909ff6aa85c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:09.335270 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96777a4b-09d4-40dd-9c7b-c4d16f73f2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:09.336049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96777a4b-09d4-40dd-9c7b-c4d16f73f2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:09.336323 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96777a4b-09d4-40dd-9c7b-c4d16f73f2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:09.336589 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96777a4b-09d4-40dd-9c7b-c4d16f73f2b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:09.347993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96777a4b-09d4-40dd-9c7b-c4d16f73f2b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:09.349442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96777a4b-09d4-40dd-9c7b-c4d16f73f2b3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:09.367074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-96777a4b-09d4-40dd-9c7b-c4d16f73f2b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:45:09.367074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:09.367074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:45:09.367074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:45:09.367074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:45:09.367074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:45:09.367074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:45:09.367074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:45:09.367074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:45:09.367074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:45:09.367074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:45:09.367074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:45:09.367074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:45:09.367074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:45:09.367074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:45:09.368544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:45:09.368544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:45:09.368544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:45:09.368544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:45:09.368544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:45:09.368544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:45:09.368544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:45:09.368544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:45:09.368544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:45:09.368544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:45:09.368544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:45:09.368544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:45:09.368544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:45:09.368544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:45:09.368544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:45:09.368544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:45:09.368544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:45:09.369850 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:45:09.369850 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:45:09.369850 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:45:09.369850 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:45:09.369850 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 628/1265] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:45:09.374206 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63fbea-4f8d-4124-a943-69136bb4c4a2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:09.490572 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63fbea-4f8d-4124-a943-69136bb4c4a2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:09.530381 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72497281-d350-48c1-9774-ba375e7f8684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:09.531341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72497281-d350-48c1-9774-ba375e7f8684 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:09.531744 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72497281-d350-48c1-9774-ba375e7f8684 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:09.532132 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72497281-d350-48c1-9774-ba375e7f8684 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:09.533350 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72497281-d350-48c1-9774-ba375e7f8684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:09.533757 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72497281-d350-48c1-9774-ba375e7f8684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:09.536087 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72497281-d350-48c1-9774-ba375e7f8684 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:09.548920 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 638/1266] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:45:09.555016 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96777a4b-09d4-40dd-9c7b-c4d16f73f2b3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:09.654915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96777a4b-09d4-40dd-9c7b-c4d16f73f2b3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:09.689864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbc5bb-bb70-422d-94bb-85c44d67d3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:09.690653 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbc5bb-bb70-422d-94bb-85c44d67d3fd None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:09.690935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbc5bb-bb70-422d-94bb-85c44d67d3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:09.691230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbc5bb-bb70-422d-94bb-85c44d67d3fd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:09.698923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbc5bb-bb70-422d-94bb-85c44d67d3fd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:09.700434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbc5bb-bb70-422d-94bb-85c44d67d3fd None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:09.714314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-18cbc5bb-bb70-422d-94bb-85c44d67d3fd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 06:45:09.714314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:09.714314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:45:09.714314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:45:09.714314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:45:09.714314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:45:09.714314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:45:09.714314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:45:09.714314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:45:09.714314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:45:09.714314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:45:09.714314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:45:09.714314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:45:09.714314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:45:09.714314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:45:09.714314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:45:09.715761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:45:09.715761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:45:09.715761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:45:09.715761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:45:09.715761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:45:09.715761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:45:09.715761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:45:09.715761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:45:09.715761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:45:09.715761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:45:09.715761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:45:09.715761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:45:09.715761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:45:09.715761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:45:09.715761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:45:09.715761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:45:09.715761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:45:09.715761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:45:09.716984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:45:09.716984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:45:09.716984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:45:09.716984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:45:09.716984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:45:09.716984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:45:09.716984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:45:09.716984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:45:09.716984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 06:45:09.716984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:45:09.716984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 629/1267] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:45:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:45:09.724664 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72497281-d350-48c1-9774-ba375e7f8684 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:09.839386 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72497281-d350-48c1-9774-ba375e7f8684 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:09.872809 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a5497-157a-4afb-8c78-25fc8eb8656f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:09.873464 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a5497-157a-4afb-8c78-25fc8eb8656f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:09.873738 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a5497-157a-4afb-8c78-25fc8eb8656f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:09.874007 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a5497-157a-4afb-8c78-25fc8eb8656f None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:09.874830 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a5497-157a-4afb-8c78-25fc8eb8656f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:09.875163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a5497-157a-4afb-8c78-25fc8eb8656f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:09.876597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a5497-157a-4afb-8c78-25fc8eb8656f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:09.893070 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 639/1268] 10.222.0.77 () {56 vars in 1143 bytes} [Wed May 11 06:45:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:45:09.899684 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbc5bb-bb70-422d-94bb-85c44d67d3fd None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:10.013782 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbc5bb-bb70-422d-94bb-85c44d67d3fd None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:10.050001 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8565d0f-87ef-437b-a070-e072f2044892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:10.050783 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8565d0f-87ef-437b-a070-e072f2044892 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:10.051088 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8565d0f-87ef-437b-a070-e072f2044892 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:10.051352 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8565d0f-87ef-437b-a070-e072f2044892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:10.061946 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8565d0f-87ef-437b-a070-e072f2044892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:10.063421 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8565d0f-87ef-437b-a070-e072f2044892 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:10.080655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-b8565d0f-87ef-437b-a070-e072f2044892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:45:10.080655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:10.080655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:45:10.080655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:45:10.080655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:45:10.080655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:45:10.080655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:45:10.080655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:45:10.080655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:45:10.080655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:45:10.080655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:45:10.080655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:45:10.080655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:45:10.080655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:45:10.080655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:45:10.081685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:45:10.081685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:45:10.081685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:45:10.081685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:45:10.081685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:45:10.081685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:45:10.081685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:45:10.081685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:45:10.081685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:45:10.081685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:45:10.081685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:45:10.081685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:45:10.081685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:45:10.081685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:45:10.081685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:45:10.081685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:45:10.081685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:45:10.082796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:45:10.082796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:45:10.082796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:45:10.082796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:45:10.082796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 630/1269] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:45:10.090524 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a5497-157a-4afb-8c78-25fc8eb8656f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:10.202002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a5497-157a-4afb-8c78-25fc8eb8656f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:10.241076 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc97b61-8b5a-45a4-bca1-17234f92937f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:10.241733 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc97b61-8b5a-45a4-bca1-17234f92937f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:10.242015 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc97b61-8b5a-45a4-bca1-17234f92937f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:10.242293 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc97b61-8b5a-45a4-bca1-17234f92937f None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:10.243016 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc97b61-8b5a-45a4-bca1-17234f92937f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:10.243353 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc97b61-8b5a-45a4-bca1-17234f92937f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:10.244715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc97b61-8b5a-45a4-bca1-17234f92937f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:10.255771 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 640/1270] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:45:10.261690 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8565d0f-87ef-437b-a070-e072f2044892 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:10.359529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8565d0f-87ef-437b-a070-e072f2044892 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:10.393375 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960cea6-853f-415f-a7d1-c670128d71f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:10.394192 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960cea6-853f-415f-a7d1-c670128d71f2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:10.394473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960cea6-853f-415f-a7d1-c670128d71f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:10.394741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960cea6-853f-415f-a7d1-c670128d71f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:10.402534 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960cea6-853f-415f-a7d1-c670128d71f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:10.404004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960cea6-853f-415f-a7d1-c670128d71f2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:10.418840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-a960cea6-853f-415f-a7d1-c670128d71f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:45:10.418840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:10.418840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:45:10.418840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:45:10.418840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:45:10.418840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:45:10.418840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:45:10.418840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:45:10.418840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:45:10.418840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:45:10.418840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:45:10.418840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:45:10.418840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:45:10.418840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:45:10.418840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:45:10.419903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:45:10.419903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:45:10.419903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:45:10.419903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:45:10.419903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:45:10.419903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:45:10.419903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:45:10.419903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:45:10.419903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:45:10.419903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:45:10.419903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:45:10.419903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:45:10.419903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:45:10.419903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:45:10.419903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:45:10.419903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:45:10.419903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:45:10.420993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:45:10.420993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:45:10.420993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:45:10.420993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:45:10.420993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:45:10.420993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:45:10.420993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:45:10.420993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:45:10.420993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 631/1271] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:45:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:45:10.426247 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc97b61-8b5a-45a4-bca1-17234f92937f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:10.530843 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc97b61-8b5a-45a4-bca1-17234f92937f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:10.565261 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe387e-1b5e-4aa3-803d-9e467a7eaff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:10.565902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe387e-1b5e-4aa3-803d-9e467a7eaff7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:10.566176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe387e-1b5e-4aa3-803d-9e467a7eaff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:10.566442 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe387e-1b5e-4aa3-803d-9e467a7eaff7 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:10.567594 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe387e-1b5e-4aa3-803d-9e467a7eaff7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:10.567903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe387e-1b5e-4aa3-803d-9e467a7eaff7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:10.569347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe387e-1b5e-4aa3-803d-9e467a7eaff7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:10.581789 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 641/1272] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:45:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:45:10.589502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960cea6-853f-415f-a7d1-c670128d71f2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:10.695471 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960cea6-853f-415f-a7d1-c670128d71f2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:10.729699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df45280-b322-4fb8-9fa9-b45a6079d955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:10.730567 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df45280-b322-4fb8-9fa9-b45a6079d955 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:10.730847 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df45280-b322-4fb8-9fa9-b45a6079d955 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:10.731144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df45280-b322-4fb8-9fa9-b45a6079d955 None admin] PATH_INFO: `/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/d46e2703839e498da8f3e2c3fda1d61c/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:10.733316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df45280-b322-4fb8-9fa9-b45a6079d955 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f573a9de6904664ace6287072a8a7dc, user_id=d46e2703839e498da8f3e2c3fda1d61c, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:10.734750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df45280-b322-4fb8-9fa9-b45a6079d955 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:10.749963 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 632/1273] 10.222.0.77 () {58 vars in 1439 bytes} [Wed May 11 06:45:10 2022] PUT /identity/v3/projects/0f573a9de6904664ace6287072a8a7dc/users/d46e2703839e498da8f3e2c3fda1d61c/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:45:12.953331 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f67c60-f667-45c5-9091-f5bedb861023 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:12.953928 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f67c60-f667-45c5-9091-f5bedb861023 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:12.953928 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f67c60-f667-45c5-9091-f5bedb861023 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:12.955518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 642/1274] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:45:12.960570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75669994-eb5b-48c8-9e88-c541816e2e7f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:12.960978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75669994-eb5b-48c8-9e88-c541816e2e7f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:12.961118 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75669994-eb5b-48c8-9e88-c541816e2e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:12.978926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-75669994-eb5b-48c8-9e88-c541816e2e7f None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:45:12.980192 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-75669994-eb5b-48c8-9e88-c541816e2e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:13.044261 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 633/1275] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:45:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:45:13.067832 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f67c60-f667-45c5-9091-f5bedb861023 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:13.164024 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f67c60-f667-45c5-9091-f5bedb861023 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:13.197103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9580e-e941-488a-8876-4ed67fd7ba92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:13.197889 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9580e-e941-488a-8876-4ed67fd7ba92 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:13.198166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9580e-e941-488a-8876-4ed67fd7ba92 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:13.198433 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9580e-e941-488a-8876-4ed67fd7ba92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:13.209571 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9580e-e941-488a-8876-4ed67fd7ba92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:45:13.217012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c0f9580e-e941-488a-8876-4ed67fd7ba92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:45:13.217012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:13.217012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:45:13.217012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:45:13.217012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:45:13.217012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:45:13.217012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:45:13.217012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:45:13.217012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:45:13.217012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:45:13.217012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:45:13.217012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:45:13.217012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:45:13.217012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:45:13.217012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:45:13.217012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:45:13.218169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:45:13.218169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:45:13.218169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:45:13.218169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:45:13.218169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:45:13.218169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:45:13.218169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:45:13.218169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:45:13.218169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:45:13.218169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:45:13.218169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:45:13.218169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:45:13.218169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:45:13.218169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:45:13.218169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:45:13.218169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:45:13.219288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:45:13.219288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:45:13.219288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:45:13.219288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:45:13.219288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:45:13.219288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:45:13.219288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:45:13.219288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:45:13.219288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:45:13.219288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:45:13.219288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:45:13.219288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:45:13.219288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 643/1276] 10.222.0.77 () {56 vars in 1096 bytes} [Wed May 11 06:45:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:45:13.224467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75669994-eb5b-48c8-9e88-c541816e2e7f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:13.334129 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75669994-eb5b-48c8-9e88-c541816e2e7f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:13.377055 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beafd6a-5c6c-43db-9ff6-1044bddd9ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:13.377721 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beafd6a-5c6c-43db-9ff6-1044bddd9ddd None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:13.377993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beafd6a-5c6c-43db-9ff6-1044bddd9ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:13.378259 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beafd6a-5c6c-43db-9ff6-1044bddd9ddd None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:13.379007 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beafd6a-5c6c-43db-9ff6-1044bddd9ddd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:13.379327 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beafd6a-5c6c-43db-9ff6-1044bddd9ddd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:13.380720 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beafd6a-5c6c-43db-9ff6-1044bddd9ddd None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:13.389603 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 634/1277] 10.222.0.77 () {56 vars in 1099 bytes} [Wed May 11 06:45:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:45:13.395492 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9580e-e941-488a-8876-4ed67fd7ba92 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:13.512816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9580e-e941-488a-8876-4ed67fd7ba92 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:13.550820 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e051f-1c14-4acf-a4c4-16066e48a3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:13.551946 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e051f-1c14-4acf-a4c4-16066e48a3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:13.552272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e051f-1c14-4acf-a4c4-16066e48a3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:13.552613 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e051f-1c14-4acf-a4c4-16066e48a3f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:13.564275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e051f-1c14-4acf-a4c4-16066e48a3f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:13.565979 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e051f-1c14-4acf-a4c4-16066e48a3f3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:13.585412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-484e051f-1c14-4acf-a4c4-16066e48a3f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:45:13.585412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:13.585412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:45:13.585412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:45:13.585412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:45:13.585412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:45:13.585412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:45:13.585412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:45:13.585412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:45:13.585412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:45:13.585412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:45:13.585412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:45:13.585412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:45:13.585412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:45:13.585412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:45:13.586443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:45:13.586443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:45:13.586443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:45:13.586443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:45:13.586443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:45:13.586443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:45:13.586443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:45:13.586443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:45:13.586443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:45:13.586443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:45:13.586443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:45:13.586443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:45:13.586443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:45:13.586443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:45:13.586443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:45:13.586443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:45:13.586443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:45:13.587599 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:45:13.587599 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:45:13.587599 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:45:13.587599 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:45:13.587599 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 644/1278] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:45:13.592918 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beafd6a-5c6c-43db-9ff6-1044bddd9ddd None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:13.691037 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beafd6a-5c6c-43db-9ff6-1044bddd9ddd None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:13.724132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2788c9-a1df-43b4-96fa-2922077da77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:13.724777 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2788c9-a1df-43b4-96fa-2922077da77b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:13.725051 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2788c9-a1df-43b4-96fa-2922077da77b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:13.725322 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2788c9-a1df-43b4-96fa-2922077da77b None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:13.726037 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2788c9-a1df-43b4-96fa-2922077da77b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:13.726340 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2788c9-a1df-43b4-96fa-2922077da77b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:13.727778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2788c9-a1df-43b4-96fa-2922077da77b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:13.739095 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 635/1279] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:45:13.748120 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e051f-1c14-4acf-a4c4-16066e48a3f3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:13.858809 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e051f-1c14-4acf-a4c4-16066e48a3f3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:13.892457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccb27a-a208-4462-818e-cfa8e2193f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:13.893259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccb27a-a208-4462-818e-cfa8e2193f77 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:13.893542 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccb27a-a208-4462-818e-cfa8e2193f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:13.893814 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccb27a-a208-4462-818e-cfa8e2193f77 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:13.901344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccb27a-a208-4462-818e-cfa8e2193f77 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:13.902796 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccb27a-a208-4462-818e-cfa8e2193f77 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:13.917044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a8ccb27a-a208-4462-818e-cfa8e2193f77 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 06:45:13.917044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:13.917044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:45:13.917044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:45:13.917044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:45:13.917044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:45:13.917044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:45:13.917044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:45:13.917044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:45:13.917044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:45:13.917044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:45:13.917044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:45:13.917044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:45:13.917044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:45:13.917044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:45:13.917044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:45:13.918174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:45:13.918174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:45:13.918174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:45:13.918174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:45:13.918174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:45:13.918174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:45:13.918174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:45:13.918174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:45:13.918174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:45:13.918174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:45:13.918174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:45:13.918174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:45:13.918174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:45:13.918174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:45:13.918174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:45:13.918174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:45:13.918174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:45:13.918174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:45:13.919173 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:45:13.919173 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:45:13.919173 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:45:13.919173 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:45:13.919173 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:45:13.919173 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:45:13.919173 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:45:13.919173 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:45:13.919173 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 06:45:13.919173 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:45:13.922993 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 645/1280] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:45:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:45:13.924755 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2788c9-a1df-43b4-96fa-2922077da77b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:14.031686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2788c9-a1df-43b4-96fa-2922077da77b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:14.064672 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bf7e4-92aa-48f8-af62-3d33bf0c07a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:14.065325 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bf7e4-92aa-48f8-af62-3d33bf0c07a5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:14.065601 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bf7e4-92aa-48f8-af62-3d33bf0c07a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:14.065862 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bf7e4-92aa-48f8-af62-3d33bf0c07a5 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:14.067011 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bf7e4-92aa-48f8-af62-3d33bf0c07a5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:14.067343 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bf7e4-92aa-48f8-af62-3d33bf0c07a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:14.068752 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bf7e4-92aa-48f8-af62-3d33bf0c07a5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:14.088669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 636/1281] 10.222.0.77 () {56 vars in 1143 bytes} [Wed May 11 06:45:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:45:14.095425 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccb27a-a208-4462-818e-cfa8e2193f77 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:14.219309 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccb27a-a208-4462-818e-cfa8e2193f77 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:14.252120 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36edb8-6740-4be4-bc38-f81951a7de3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:14.252746 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36edb8-6740-4be4-bc38-f81951a7de3c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:14.253021 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36edb8-6740-4be4-bc38-f81951a7de3c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:14.253289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36edb8-6740-4be4-bc38-f81951a7de3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:14.333195 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36edb8-6740-4be4-bc38-f81951a7de3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:14.334652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36edb8-6740-4be4-bc38-f81951a7de3c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:14.460712 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 646/1282] 10.222.0.77 () {58 vars in 1282 bytes} [Wed May 11 06:45:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:45:14.466778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bf7e4-92aa-48f8-af62-3d33bf0c07a5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:14.579532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bf7e4-92aa-48f8-af62-3d33bf0c07a5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:14.612896 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8fed0-6832-4bca-a996-e5ff50d2a7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:14.613679 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8fed0-6832-4bca-a996-e5ff50d2a7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:14.613962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8fed0-6832-4bca-a996-e5ff50d2a7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:14.614237 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8fed0-6832-4bca-a996-e5ff50d2a7e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:14.624271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8fed0-6832-4bca-a996-e5ff50d2a7e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:14.625718 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8fed0-6832-4bca-a996-e5ff50d2a7e1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:14.642792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-66c8fed0-6832-4bca-a996-e5ff50d2a7e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:45:14.642792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:14.642792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:45:14.642792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:45:14.642792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:45:14.642792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:45:14.642792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:45:14.642792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:45:14.642792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:45:14.642792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:45:14.642792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:45:14.642792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:45:14.642792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:45:14.642792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:45:14.642792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:45:14.643817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:45:14.643817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:45:14.643817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:45:14.643817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:45:14.643817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:45:14.643817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:45:14.643817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:45:14.643817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:45:14.643817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:45:14.643817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:45:14.643817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:45:14.643817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:45:14.643817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:45:14.643817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:45:14.643817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:45:14.643817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:45:14.643817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:45:14.644829 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:45:14.644829 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:45:14.644829 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:45:14.644829 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:45:14.644829 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 637/1283] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:45:14.650103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36edb8-6740-4be4-bc38-f81951a7de3c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:14.752557 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36edb8-6740-4be4-bc38-f81951a7de3c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:14.789028 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3327984-bf5d-421a-97ea-a7b68a451e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:14.789685 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3327984-bf5d-421a-97ea-a7b68a451e91 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:14.789993 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3327984-bf5d-421a-97ea-a7b68a451e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:14.790264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3327984-bf5d-421a-97ea-a7b68a451e91 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:14.791008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3327984-bf5d-421a-97ea-a7b68a451e91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:14.791311 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3327984-bf5d-421a-97ea-a7b68a451e91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:14.792689 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3327984-bf5d-421a-97ea-a7b68a451e91 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:14.804758 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 647/1284] 10.222.0.77 () {56 vars in 1109 bytes} [Wed May 11 06:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:45:14.810787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8fed0-6832-4bca-a996-e5ff50d2a7e1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:14.926309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8fed0-6832-4bca-a996-e5ff50d2a7e1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:14.962013 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458975e-69c1-430f-8ecd-0298b66cd220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:14.962795 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458975e-69c1-430f-8ecd-0298b66cd220 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:14.963103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458975e-69c1-430f-8ecd-0298b66cd220 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:14.963378 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458975e-69c1-430f-8ecd-0298b66cd220 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:14.970073 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458975e-69c1-430f-8ecd-0298b66cd220 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:14.971576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458975e-69c1-430f-8ecd-0298b66cd220 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:14.985147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-e458975e-69c1-430f-8ecd-0298b66cd220 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:45:14.985147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:14.985147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:45:14.985147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:45:14.985147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:45:14.985147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:45:14.985147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:45:14.985147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:45:14.985147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:45:14.985147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:45:14.985147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:45:14.985147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:45:14.985147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:45:14.985147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:45:14.985147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:45:14.986166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:45:14.986166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:45:14.986166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:45:14.986166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:45:14.986166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:45:14.986166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:45:14.986166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:45:14.986166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:45:14.986166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 06:45:14.986166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:45:14.986166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 06:45:14.986166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:45:14.986166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:45:14.986166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:45:14.986166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 06:45:14.986166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:45:14.986166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 06:45:14.987130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:45:14.987130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:45:14.987130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:45:14.987130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:45:14.987130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:45:14.987130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:45:14.987130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:45:14.987130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 06:45:14.987130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 638/1285] 10.222.0.77 () {56 vars in 1111 bytes} [Wed May 11 06:45:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:45:14.994439 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3327984-bf5d-421a-97ea-a7b68a451e91 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:15.095551 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3327984-bf5d-421a-97ea-a7b68a451e91 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:15.128945 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e00e1-30ec-44b0-82e5-75a8877fb734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:15.129595 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e00e1-30ec-44b0-82e5-75a8877fb734 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:15.129876 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e00e1-30ec-44b0-82e5-75a8877fb734 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:15.130150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e00e1-30ec-44b0-82e5-75a8877fb734 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:15.130940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e00e1-30ec-44b0-82e5-75a8877fb734 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:15.131283 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e00e1-30ec-44b0-82e5-75a8877fb734 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:15.132720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e00e1-30ec-44b0-82e5-75a8877fb734 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:15.144526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 648/1286] 10.222.0.77 () {56 vars in 1148 bytes} [Wed May 11 06:45:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:45:15.152448 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458975e-69c1-430f-8ecd-0298b66cd220 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:15.264383 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458975e-69c1-430f-8ecd-0298b66cd220 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:15.301299 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0df00-fdf5-40cb-9bd9-0fedbe7b2258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:15.302314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0df00-fdf5-40cb-9bd9-0fedbe7b2258 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:15.302658 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0df00-fdf5-40cb-9bd9-0fedbe7b2258 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:15.303018 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0df00-fdf5-40cb-9bd9-0fedbe7b2258 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:15.304298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0df00-fdf5-40cb-9bd9-0fedbe7b2258 None admin] RBAC: Adding query filter params (role.id=5debd8ad07a74bedbf2efd53b11cd7cd, scope.project.id=0f573a9de6904664ace6287072a8a7dc, user.id=d46e2703839e498da8f3e2c3fda1d61c) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:15.304667 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0df00-fdf5-40cb-9bd9-0fedbe7b2258 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:15.306851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0df00-fdf5-40cb-9bd9-0fedbe7b2258 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:15.316312 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 639/1287] 10.222.0.77 () {56 vars in 1374 bytes} [Wed May 11 06:45:15 2022] GET /identity/v3/role_assignments?user.id=d46e2703839e498da8f3e2c3fda1d61c&scope.project.id=0f573a9de6904664ace6287072a8a7dc&role.id=5debd8ad07a74bedbf2efd53b11cd7cd => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:45:17.515327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335f824-1b32-4bd1-8c9b-447595bdf9fb None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:17.515932 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335f824-1b32-4bd1-8c9b-447595bdf9fb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:17.515932 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335f824-1b32-4bd1-8c9b-447595bdf9fb None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:17.517214 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 649/1288] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:45:17.523642 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1e8bf-fc14-4143-b01f-0057f09a34d9 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:17.524358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1e8bf-fc14-4143-b01f-0057f09a34d9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:17.524547 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1e8bf-fc14-4143-b01f-0057f09a34d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:17.551056 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1cd1e8bf-fc14-4143-b01f-0057f09a34d9 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:45:17.553243 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1cd1e8bf-fc14-4143-b01f-0057f09a34d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:17.628292 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 640/1289] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:45:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:45:17.650487 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335f824-1b32-4bd1-8c9b-447595bdf9fb None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:17.754547 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335f824-1b32-4bd1-8c9b-447595bdf9fb None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:17.788107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5ca32-6c42-441b-8517-505f65c4f1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:17.788886 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5ca32-6c42-441b-8517-505f65c4f1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:17.789164 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5ca32-6c42-441b-8517-505f65c4f1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:17.789430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5ca32-6c42-441b-8517-505f65c4f1a4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:17.790096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5ca32-6c42-441b-8517-505f65c4f1a4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:17.791927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5ca32-6c42-441b-8517-505f65c4f1a4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:17.803805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-d4c5ca32-6c42-441b-8517-505f65c4f1a4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 06:45:17.803805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:17.803805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:45:17.803805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:45:17.803805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:45:17.803805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:45:17.803805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:45:17.803805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:45:17.803805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 06:45:17.803805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:45:17.803805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:45:17.803805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:45:17.803805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:17.803805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:45:17.803805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:45:17.803805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:45:17.803805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:45:17.804981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:45:17.804981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:45:17.804981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:45:17.804981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:45:17.804981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:45:17.804981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:45:17.804981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:45:17.804981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:45:17.804981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:45:17.804981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:45:17.804981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:45:17.804981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:45:17.804981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:45:17.804981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:45:17.804981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:45:17.804981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:45:17.806065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:45:17.806065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:45:17.806065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:45:17.806065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:45:17.806065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:45:17.806065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:45:17.806065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:45:17.806065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:45:17.806065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:45:17.806065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:45:17.806065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:45:17.806065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:45:17.806065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 06:45:17.806065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:45:17.806065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 650/1290] 10.222.0.77 () {56 vars in 1117 bytes} [Wed May 11 06:45:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:45:17.812787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1e8bf-fc14-4143-b01f-0057f09a34d9 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:17.915004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1e8bf-fc14-4143-b01f-0057f09a34d9 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:17.949302 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366c0f6-b26b-4f71-be1b-9d61c1f97498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:17.949962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366c0f6-b26b-4f71-be1b-9d61c1f97498 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:17.950236 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366c0f6-b26b-4f71-be1b-9d61c1f97498 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:17.950512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366c0f6-b26b-4f71-be1b-9d61c1f97498 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:17.951243 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366c0f6-b26b-4f71-be1b-9d61c1f97498 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:17.951545 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366c0f6-b26b-4f71-be1b-9d61c1f97498 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:17.952924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366c0f6-b26b-4f71-be1b-9d61c1f97498 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:17.960553 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 641/1291] 10.222.0.77 () {56 vars in 1116 bytes} [Wed May 11 06:45:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:45:17.967471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5ca32-6c42-441b-8517-505f65c4f1a4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:18.073791 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5ca32-6c42-441b-8517-505f65c4f1a4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:18.106846 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5515c3-4a65-4cea-87cb-5a1090d1cfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:18.107515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5515c3-4a65-4cea-87cb-5a1090d1cfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:18.107789 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5515c3-4a65-4cea-87cb-5a1090d1cfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:18.108055 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5515c3-4a65-4cea-87cb-5a1090d1cfd1 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:18.108760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5515c3-4a65-4cea-87cb-5a1090d1cfd1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:18.109128 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5515c3-4a65-4cea-87cb-5a1090d1cfd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:18.110486 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5515c3-4a65-4cea-87cb-5a1090d1cfd1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:18.115060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 651/1292] 10.222.0.77 () {56 vars in 1116 bytes} [Wed May 11 06:45:17 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:45:20.312763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb066427-e587-4a84-a7c7-ffdb09924058 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:20.313242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb066427-e587-4a84-a7c7-ffdb09924058 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:20.313332 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb066427-e587-4a84-a7c7-ffdb09924058 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:20.315455 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 642/1293] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:45:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:45:20.321307 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f3144-bb7e-414c-ae19-b7499d822c06 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:20.321745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f3144-bb7e-414c-ae19-b7499d822c06 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:20.321845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f3144-bb7e-414c-ae19-b7499d822c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:20.339805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bb7f3144-bb7e-414c-ae19-b7499d822c06 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:45:20.340969 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bb7f3144-bb7e-414c-ae19-b7499d822c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:20.413017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 652/1294] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:45:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:45:20.435509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb066427-e587-4a84-a7c7-ffdb09924058 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:20.560644 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb066427-e587-4a84-a7c7-ffdb09924058 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:20.598485 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973bc27-e409-4a4d-8173-b0ba688fe347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:20.599307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973bc27-e409-4a4d-8173-b0ba688fe347 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:20.599634 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973bc27-e409-4a4d-8173-b0ba688fe347 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:20.599961 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973bc27-e409-4a4d-8173-b0ba688fe347 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:20.600994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973bc27-e409-4a4d-8173-b0ba688fe347 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:20.603390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973bc27-e409-4a4d-8173-b0ba688fe347 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:20.619890 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 643/1295] 10.222.0.77 () {60 vars in 1141 bytes} [Wed May 11 06:45:20 2022] POST /identity/v3/services => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:45:22.845966 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c3745-f1f4-4040-8284-5131db2ff903 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:22.846830 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c3745-f1f4-4040-8284-5131db2ff903 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:22.846830 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c3745-f1f4-4040-8284-5131db2ff903 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:22.849046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 653/1296] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:45:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:45:22.854556 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75c48e-d5d7-4bf9-b08e-8597c43a4a8a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:22.855014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75c48e-d5d7-4bf9-b08e-8597c43a4a8a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:22.855124 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75c48e-d5d7-4bf9-b08e-8597c43a4a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:22.873359 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5a75c48e-d5d7-4bf9-b08e-8597c43a4a8a None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:45:22.874540 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5a75c48e-d5d7-4bf9-b08e-8597c43a4a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:22.952727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 644/1297] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:45:22 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:45:22.976053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c3745-f1f4-4040-8284-5131db2ff903 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:23.083800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c3745-f1f4-4040-8284-5131db2ff903 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:23.117976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38232cc3-dcee-4c3d-a828-3a228e0cf2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:23.118697 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38232cc3-dcee-4c3d-a828-3a228e0cf2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:23.118999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38232cc3-dcee-4c3d-a828-3a228e0cf2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:23.119283 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38232cc3-dcee-4c3d-a828-3a228e0cf2c6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:23.119941 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38232cc3-dcee-4c3d-a828-3a228e0cf2c6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:23.121344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38232cc3-dcee-4c3d-a828-3a228e0cf2c6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:23.133229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-38232cc3-dcee-4c3d-a828-3a228e0cf2c6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 06:45:23.133229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:23.133229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:45:23.133229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:45:23.133229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:45:23.133229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:45:23.133229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:45:23.133229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:45:23.133229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 06:45:23.133229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:45:23.133229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:45:23.133229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:45:23.133229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:23.133229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:45:23.133229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:45:23.133229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:45:23.133229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:45:23.134337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:45:23.134337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:45:23.134337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:45:23.134337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:45:23.134337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:45:23.134337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:45:23.134337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:45:23.134337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:45:23.134337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:45:23.134337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:45:23.134337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:45:23.134337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:45:23.134337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:45:23.134337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:45:23.134337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:45:23.134337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:45:23.135860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:45:23.135860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:45:23.135860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:45:23.135860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:45:23.135860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:45:23.135860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:45:23.135860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:45:23.135860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:45:23.135860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:45:23.135860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:45:23.135860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:45:23.135860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:45:23.135860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 06:45:23.135860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:45:23.135860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 654/1298] 10.222.0.77 () {56 vars in 1117 bytes} [Wed May 11 06:45:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:45:23.144111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75c48e-d5d7-4bf9-b08e-8597c43a4a8a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:23.244474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75c48e-d5d7-4bf9-b08e-8597c43a4a8a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:23.281421 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e43b6d-5fb4-4558-8713-02249156c514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:23.282080 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e43b6d-5fb4-4558-8713-02249156c514 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:23.282360 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e43b6d-5fb4-4558-8713-02249156c514 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:23.282633 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e43b6d-5fb4-4558-8713-02249156c514 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:23.283372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e43b6d-5fb4-4558-8713-02249156c514 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:23.283674 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e43b6d-5fb4-4558-8713-02249156c514 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:23.285053 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e43b6d-5fb4-4558-8713-02249156c514 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:23.290679 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 645/1299] 10.222.0.77 () {56 vars in 1116 bytes} [Wed May 11 06:45:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:45:23.296657 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38232cc3-dcee-4c3d-a828-3a228e0cf2c6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:23.401921 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38232cc3-dcee-4c3d-a828-3a228e0cf2c6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:23.435394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4116f-25e6-466e-812b-f7f66907955f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:23.436040 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4116f-25e6-466e-812b-f7f66907955f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:23.436321 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4116f-25e6-466e-812b-f7f66907955f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:23.436592 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4116f-25e6-466e-812b-f7f66907955f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:23.437379 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4116f-25e6-466e-812b-f7f66907955f None admin] RBAC: Adding query filter params (interface=public, service_id=4a5d034a86e34d07ab13ca9c28c85e8d, region_id=RegionOne) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:23.437690 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4116f-25e6-466e-812b-f7f66907955f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:23.439084 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4116f-25e6-466e-812b-f7f66907955f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:23.444511 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 655/1300] 10.222.0.77 () {56 vars in 1251 bytes} [Wed May 11 06:45:23 2022] GET /identity/v3/endpoints?service_id=4a5d034a86e34d07ab13ca9c28c85e8d&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:45:23.450413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e43b6d-5fb4-4558-8713-02249156c514 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:23.557263 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e43b6d-5fb4-4558-8713-02249156c514 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:23.596848 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33f9eb-01f0-4de9-990c-185e8c93308f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:23.597655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33f9eb-01f0-4de9-990c-185e8c93308f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:23.597962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33f9eb-01f0-4de9-990c-185e8c93308f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:23.598234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33f9eb-01f0-4de9-990c-185e8c93308f None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:23.599015 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33f9eb-01f0-4de9-990c-185e8c93308f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:23.602486 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33f9eb-01f0-4de9-990c-185e8c93308f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:23.610097 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 646/1301] 10.222.0.77 () {56 vars in 1087 bytes} [Wed May 11 06:45:23 2022] GET /identity/v3/services => generated 2191 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:45:25.794031 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df028d46-05dc-409d-9f1d-b504d74f3e19 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:25.795006 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df028d46-05dc-409d-9f1d-b504d74f3e19 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:25.795006 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df028d46-05dc-409d-9f1d-b504d74f3e19 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:25.797200 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 656/1302] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:45:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:45:25.802575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a9a2d-0de6-4bbc-9caf-e015c58e820e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:25.803011 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a9a2d-0de6-4bbc-9caf-e015c58e820e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:25.803121 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a9a2d-0de6-4bbc-9caf-e015c58e820e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:25.821818 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-016a9a2d-0de6-4bbc-9caf-e015c58e820e None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:45:25.822988 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-016a9a2d-0de6-4bbc-9caf-e015c58e820e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:25.888046 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 647/1303] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:45:25 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:45:25.910943 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df028d46-05dc-409d-9f1d-b504d74f3e19 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:26.020578 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df028d46-05dc-409d-9f1d-b504d74f3e19 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:26.054503 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf0f33-4b6c-4542-9fb5-6aacc5ec73aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:26.055284 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf0f33-4b6c-4542-9fb5-6aacc5ec73aa None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:26.055641 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf0f33-4b6c-4542-9fb5-6aacc5ec73aa None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:26.055919 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf0f33-4b6c-4542-9fb5-6aacc5ec73aa None admin] PATH_INFO: `/v3/services/placement` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:26.056579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf0f33-4b6c-4542-9fb5-6aacc5ec73aa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:26.057964 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf0f33-4b6c-4542-9fb5-6aacc5ec73aa None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:26.070237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-0edf0f33-4b6c-4542-9fb5-6aacc5ec73aa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 06:45:26.070237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:26.070237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:45:26.070237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:45:26.070237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:45:26.070237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:45:26.070237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:45:26.070237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:45:26.070237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 06:45:26.070237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:45:26.070237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:45:26.070237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:45:26.070237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:45:26.070237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:45:26.070237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:45:26.070237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:45:26.070237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:45:26.071444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:45:26.071444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:45:26.071444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:45:26.071444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:45:26.071444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:45:26.071444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:45:26.071444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:45:26.071444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:45:26.071444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:45:26.071444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:45:26.071444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:45:26.071444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:45:26.071444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:45:26.071444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:45:26.071444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:45:26.071444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:45:26.072600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:45:26.072600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 06:45:26.072600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:45:26.072600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 06:45:26.072600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:45:26.072600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:45:26.072600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:45:26.072600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 06:45:26.072600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:45:26.072600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 06:45:26.072600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:45:26.072600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:45:26.072600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 06:45:26.072600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 06:45:26.072600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 657/1304] 10.222.0.77 () {56 vars in 1117 bytes} [Wed May 11 06:45:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:45:26.078419 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a9a2d-0de6-4bbc-9caf-e015c58e820e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:26.174659 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a9a2d-0de6-4bbc-9caf-e015c58e820e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:26.208397 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952b71d-5b2c-4279-b8d3-9925416fd5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:26.209049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952b71d-5b2c-4279-b8d3-9925416fd5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:26.209325 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952b71d-5b2c-4279-b8d3-9925416fd5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:26.209593 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952b71d-5b2c-4279-b8d3-9925416fd5c2 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:26.210293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952b71d-5b2c-4279-b8d3-9925416fd5c2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:26.210598 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952b71d-5b2c-4279-b8d3-9925416fd5c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:26.212101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952b71d-5b2c-4279-b8d3-9925416fd5c2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:26.217205 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 648/1305] 10.222.0.77 () {56 vars in 1116 bytes} [Wed May 11 06:45:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:45:26.223187 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf0f33-4b6c-4542-9fb5-6aacc5ec73aa None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:26.332326 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf0f33-4b6c-4542-9fb5-6aacc5ec73aa None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:26.371552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d600eb4-1ffe-4d9d-9df6-884a59752b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:26.372208 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d600eb4-1ffe-4d9d-9df6-884a59752b02 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:26.372493 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d600eb4-1ffe-4d9d-9df6-884a59752b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:26.372766 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d600eb4-1ffe-4d9d-9df6-884a59752b02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:26.373512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d600eb4-1ffe-4d9d-9df6-884a59752b02 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:26.374885 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d600eb4-1ffe-4d9d-9df6-884a59752b02 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:26.396595 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 658/1306] 10.222.0.77 () {60 vars in 1144 bytes} [Wed May 11 06:45:26 2022] POST /identity/v3/endpoints => generated 331 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:46:30.208814 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc3ba4-2210-4344-9b7a-880030e810eb None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:30.209820 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc3ba4-2210-4344-9b7a-880030e810eb None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:30.210328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc3ba4-2210-4344-9b7a-880030e810eb None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:30.217426 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0c723-f453-495f-ad17-4e2f6801c959 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:30.218279 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0c723-f453-495f-ad17-4e2f6801c959 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:30.218800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0c723-f453-495f-ad17-4e2f6801c959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:30.222711 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 649/1307] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:46:30 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:46:30.292296 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d0b0c723-f453-495f-ad17-4e2f6801c959 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:46:30.293904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d0b0c723-f453-495f-ad17-4e2f6801c959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:30.479393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 659/1308] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:46:30.525391 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637487a9-1a2f-4281-b6ac-b3c7edac297b None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:30.525912 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637487a9-1a2f-4281-b6ac-b3c7edac297b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:30.526364 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637487a9-1a2f-4281-b6ac-b3c7edac297b None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:30.528190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 650/1309] 10.222.0.77 () {54 vars in 964 bytes} [Wed May 11 06:46:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:46:30.534095 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da15788-3bc9-4869-b96a-4fe43472d9cb None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:30.534644 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da15788-3bc9-4869-b96a-4fe43472d9cb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:30.535101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da15788-3bc9-4869-b96a-4fe43472d9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:30.617617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8da15788-3bc9-4869-b96a-4fe43472d9cb None None] MFA Rules not processed for user `3c92f4b777a644ad8055f15b1a8bd0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:46:30.618803 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8da15788-3bc9-4869-b96a-4fe43472d9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:30.707659 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 660/1310] 10.222.0.77 () {58 vars in 1061 bytes} [Wed May 11 06:46:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:46:30.716467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637487a9-1a2f-4281-b6ac-b3c7edac297b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:46:30.718545 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-637487a9-1a2f-4281-b6ac-b3c7edac297b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:30.834514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637487a9-1a2f-4281-b6ac-b3c7edac297b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:46:30.909970 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b12e07-ef18-4afd-b2b1-6a05d2b2fb7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:46:30.910971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b12e07-ef18-4afd-b2b1-6a05d2b2fb7b service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:30.911408 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b12e07-ef18-4afd-b2b1-6a05d2b2fb7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:30.911833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b12e07-ef18-4afd-b2b1-6a05d2b2fb7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:30.913628 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-42b12e07-ef18-4afd-b2b1-6a05d2b2fb7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:31.021362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b12e07-ef18-4afd-b2b1-6a05d2b2fb7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:46:31.023117 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b12e07-ef18-4afd-b2b1-6a05d2b2fb7b service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:46:31.059405 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 651/1311] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:46:33.573616 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b5ec7-4588-4cdb-a637-56c3c7ddc99c None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:33.574065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b5ec7-4588-4cdb-a637-56c3c7ddc99c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:33.574233 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b5ec7-4588-4cdb-a637-56c3c7ddc99c None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:33.575676 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 661/1312] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:46:33.581409 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cae68-5d5e-4a72-b7b0-79326c71da04 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:33.582276 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cae68-5d5e-4a72-b7b0-79326c71da04 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:33.582624 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cae68-5d5e-4a72-b7b0-79326c71da04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:33.683859 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7c0cae68-5d5e-4a72-b7b0-79326c71da04 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:46:33.685253 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7c0cae68-5d5e-4a72-b7b0-79326c71da04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:33.794735 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 652/1313] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:46:33.832116 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b5ec7-4588-4cdb-a637-56c3c7ddc99c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:46:33.833756 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a26b5ec7-4588-4cdb-a637-56c3c7ddc99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:33.935578 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b5ec7-4588-4cdb-a637-56c3c7ddc99c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:46:34.012024 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29ea80-90b9-463c-99e6-e4f72a6c475d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:46:34.012668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29ea80-90b9-463c-99e6-e4f72a6c475d service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:34.012956 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29ea80-90b9-463c-99e6-e4f72a6c475d service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:34.013232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29ea80-90b9-463c-99e6-e4f72a6c475d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:34.014983 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6a29ea80-90b9-463c-99e6-e4f72a6c475d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:34.126573 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29ea80-90b9-463c-99e6-e4f72a6c475d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:46:34.127981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29ea80-90b9-463c-99e6-e4f72a6c475d service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:46:34.145967 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 662/1314] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:46:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:46:36.644246 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8429c4-2ab0-4c9c-88eb-fd3138cab741 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:36.644822 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8429c4-2ab0-4c9c-88eb-fd3138cab741 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:36.644822 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8429c4-2ab0-4c9c-88eb-fd3138cab741 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:36.646184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 653/1315] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:46:36.652691 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd2af9-c4a1-4ded-8c09-e447ae960aa5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:36.653453 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd2af9-c4a1-4ded-8c09-e447ae960aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:36.653624 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd2af9-c4a1-4ded-8c09-e447ae960aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:36.727077 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a7fd2af9-c4a1-4ded-8c09-e447ae960aa5 None None] MFA Rules not processed for user `5c4ff16e69b74f1f9018258137fba1f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:46:36.728308 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a7fd2af9-c4a1-4ded-8c09-e447ae960aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:36.825035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 663/1316] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:46:36 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:46:36.864174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8429c4-2ab0-4c9c-88eb-fd3138cab741 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:46:36.865724 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8b8429c4-2ab0-4c9c-88eb-fd3138cab741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:36.971180 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8429c4-2ab0-4c9c-88eb-fd3138cab741 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:46:37.043898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2910eec-06bd-466e-aec9-8fb729adabc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:46:37.044536 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2910eec-06bd-466e-aec9-8fb729adabc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:37.044819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2910eec-06bd-466e-aec9-8fb729adabc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:37.045085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2910eec-06bd-466e-aec9-8fb729adabc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:37.046734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a2910eec-06bd-466e-aec9-8fb729adabc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:37.162610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2910eec-06bd-466e-aec9-8fb729adabc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:46:37.164081 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2910eec-06bd-466e-aec9-8fb729adabc3 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:46:37.184421 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 654/1317] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:46:36 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:46:39.909383 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f8ae7-aae7-4361-92ad-f49fe5ba1642 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:39.909956 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f8ae7-aae7-4361-92ad-f49fe5ba1642 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:39.909956 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f8ae7-aae7-4361-92ad-f49fe5ba1642 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:39.911339 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 664/1318] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:46:39.918107 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e922ec-7043-4ac1-a5ef-7193868e2f17 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:39.918575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e922ec-7043-4ac1-a5ef-7193868e2f17 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:39.918671 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e922ec-7043-4ac1-a5ef-7193868e2f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:39.994223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-07e922ec-7043-4ac1-a5ef-7193868e2f17 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:46:39.995501 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-07e922ec-7043-4ac1-a5ef-7193868e2f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:40.103607 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 655/1319] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:46:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:46:40.157485 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f8ae7-aae7-4361-92ad-f49fe5ba1642 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:46:40.159956 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2a6f8ae7-aae7-4361-92ad-f49fe5ba1642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:40.275433 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f8ae7-aae7-4361-92ad-f49fe5ba1642 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:46:40.349814 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744152b-2797-479e-b9ff-5ef0e809ae6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:46:40.350465 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744152b-2797-479e-b9ff-5ef0e809ae6c service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:40.350750 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744152b-2797-479e-b9ff-5ef0e809ae6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:40.351026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744152b-2797-479e-b9ff-5ef0e809ae6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:40.352713 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4744152b-2797-479e-b9ff-5ef0e809ae6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:40.463149 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744152b-2797-479e-b9ff-5ef0e809ae6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:46:40.464688 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744152b-2797-479e-b9ff-5ef0e809ae6c service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:46:40.483104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 665/1320] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:46:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:46:43.370409 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8494679-3b84-4a63-894a-b97794f4d980 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:43.370995 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8494679-3b84-4a63-894a-b97794f4d980 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:43.370995 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8494679-3b84-4a63-894a-b97794f4d980 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:43.372342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 656/1321] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:46:43.377696 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f4968-a506-476d-a912-deee1a6cce81 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:43.378115 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f4968-a506-476d-a912-deee1a6cce81 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:43.378233 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f4968-a506-476d-a912-deee1a6cce81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:43.444431 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-584f4968-a506-476d-a912-deee1a6cce81 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:46:43.445632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-584f4968-a506-476d-a912-deee1a6cce81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:43.543497 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 666/1322] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:46:43.594806 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6a293-9c60-44a7-9cea-1003e01c7caf None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:43.595096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6a293-9c60-44a7-9cea-1003e01c7caf None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:43.595384 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6a293-9c60-44a7-9cea-1003e01c7caf None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:43.596881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 657/1323] 10.222.0.77 () {54 vars in 964 bytes} [Wed May 11 06:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:46:43.603172 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4146ab-26e4-4933-9bbe-50bfda2363b8 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:43.603560 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4146ab-26e4-4933-9bbe-50bfda2363b8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:43.603902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4146ab-26e4-4933-9bbe-50bfda2363b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:43.681479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1a4146ab-26e4-4933-9bbe-50bfda2363b8 None None] MFA Rules not processed for user `3c92f4b777a644ad8055f15b1a8bd0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:46:43.682774 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1a4146ab-26e4-4933-9bbe-50bfda2363b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:43.759884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 667/1324] 10.222.0.77 () {58 vars in 1061 bytes} [Wed May 11 06:46:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:46:43.769500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6a293-9c60-44a7-9cea-1003e01c7caf None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:46:43.770998 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-67d6a293-9c60-44a7-9cea-1003e01c7caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:43.872424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6a293-9c60-44a7-9cea-1003e01c7caf None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:46:43.947473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c65a7a-7d98-46f0-ba7b-3ea18bf690c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:46:43.948165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c65a7a-7d98-46f0-ba7b-3ea18bf690c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:43.948447 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c65a7a-7d98-46f0-ba7b-3ea18bf690c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:43.948717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c65a7a-7d98-46f0-ba7b-3ea18bf690c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:43.950344 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-25c65a7a-7d98-46f0-ba7b-3ea18bf690c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:44.059862 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c65a7a-7d98-46f0-ba7b-3ea18bf690c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:46:44.061342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c65a7a-7d98-46f0-ba7b-3ea18bf690c9 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:46:44.080808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 658/1325] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:46:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:46:46.553522 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050f506-56b1-4ac7-8db2-d7b9fbada851 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:46.554055 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050f506-56b1-4ac7-8db2-d7b9fbada851 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:46.554055 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050f506-56b1-4ac7-8db2-d7b9fbada851 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:46.555411 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 668/1326] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:46:46.560852 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb827b-a0aa-400a-b8c3-b40f8f5f9f6d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:46.561274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb827b-a0aa-400a-b8c3-b40f8f5f9f6d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:46.561526 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb827b-a0aa-400a-b8c3-b40f8f5f9f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:46.624987 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3fdb827b-a0aa-400a-b8c3-b40f8f5f9f6d None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:46:46.626216 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3fdb827b-a0aa-400a-b8c3-b40f8f5f9f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:46.721562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 659/1327] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:46:46.756905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050f506-56b1-4ac7-8db2-d7b9fbada851 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:46:46.758451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f050f506-56b1-4ac7-8db2-d7b9fbada851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:46.861381 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050f506-56b1-4ac7-8db2-d7b9fbada851 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:46:46.934554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff2f64-6c06-46ea-a7c5-55a5cb62b481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:46:46.935258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff2f64-6c06-46ea-a7c5-55a5cb62b481 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:46.935546 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff2f64-6c06-46ea-a7c5-55a5cb62b481 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:46.935819 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff2f64-6c06-46ea-a7c5-55a5cb62b481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:46.937484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c9ff2f64-6c06-46ea-a7c5-55a5cb62b481 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:47.048412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff2f64-6c06-46ea-a7c5-55a5cb62b481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:46:47.049866 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff2f64-6c06-46ea-a7c5-55a5cb62b481 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:46:47.068686 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 669/1328] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:46:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:46:49.317070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd7067-cf40-4946-bfdd-c688ecae1206 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:49.317569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd7067-cf40-4946-bfdd-c688ecae1206 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:49.317569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd7067-cf40-4946-bfdd-c688ecae1206 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:49.319004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 660/1329] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:46:49.326776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd3bd0-3ad7-4bfb-a72e-7b5bdca2efc6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:49.327294 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd3bd0-3ad7-4bfb-a72e-7b5bdca2efc6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:49.327391 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd3bd0-3ad7-4bfb-a72e-7b5bdca2efc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:49.397289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f1dd3bd0-3ad7-4bfb-a72e-7b5bdca2efc6 None None] MFA Rules not processed for user `5c4ff16e69b74f1f9018258137fba1f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:46:49.398509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f1dd3bd0-3ad7-4bfb-a72e-7b5bdca2efc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:49.495342 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 670/1330] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:46:49 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:46:49.532302 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd7067-cf40-4946-bfdd-c688ecae1206 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:46:49.533841 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-97bd7067-cf40-4946-bfdd-c688ecae1206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:49.636294 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd7067-cf40-4946-bfdd-c688ecae1206 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:46:49.711966 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f910a-db5a-4cb8-a56f-7c440831646b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:46:49.712628 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f910a-db5a-4cb8-a56f-7c440831646b service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:49.712900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f910a-db5a-4cb8-a56f-7c440831646b service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:49.713175 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f910a-db5a-4cb8-a56f-7c440831646b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:49.714879 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a73f910a-db5a-4cb8-a56f-7c440831646b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:49.822815 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f910a-db5a-4cb8-a56f-7c440831646b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:46:49.824315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f910a-db5a-4cb8-a56f-7c440831646b service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:46:49.842265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 661/1331] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:46:49 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:46:52.292624 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f139b-750f-4bcd-9fd5-76892174820a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:52.293075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f139b-750f-4bcd-9fd5-76892174820a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:52.293164 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f139b-750f-4bcd-9fd5-76892174820a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:52.294540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 671/1332] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:46:52.300605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e71b42-6e5d-4270-8995-d9526b935f5c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:52.301072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e71b42-6e5d-4270-8995-d9526b935f5c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:52.301167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e71b42-6e5d-4270-8995-d9526b935f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:52.368991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-90e71b42-6e5d-4270-8995-d9526b935f5c None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:46:52.372238 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-90e71b42-6e5d-4270-8995-d9526b935f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:52.475694 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 662/1333] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:46:52.511453 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f139b-750f-4bcd-9fd5-76892174820a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:46:52.512983 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-df0f139b-750f-4bcd-9fd5-76892174820a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:52.627615 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f139b-750f-4bcd-9fd5-76892174820a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:46:52.698202 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153bb6d-76cc-4056-aacf-d39cd768626d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:46:52.698854 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153bb6d-76cc-4056-aacf-d39cd768626d service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:52.699168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153bb6d-76cc-4056-aacf-d39cd768626d service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:52.699442 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153bb6d-76cc-4056-aacf-d39cd768626d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:52.701083 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d153bb6d-76cc-4056-aacf-d39cd768626d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:52.809831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153bb6d-76cc-4056-aacf-d39cd768626d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:46:52.811323 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153bb6d-76cc-4056-aacf-d39cd768626d service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:46:52.829651 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 672/1334] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:46:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:46:55.088231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a91c46-2b37-41ab-adb7-e2ba9fcbd20d None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:55.089051 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a91c46-2b37-41ab-adb7-e2ba9fcbd20d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:55.089051 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a91c46-2b37-41ab-adb7-e2ba9fcbd20d None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:55.090428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 663/1335] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:46:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:46:55.095990 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fdbf9-5171-4db6-914d-d169eac07e77 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:55.096409 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fdbf9-5171-4db6-914d-d169eac07e77 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:55.096521 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fdbf9-5171-4db6-914d-d169eac07e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:55.160130 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-057fdbf9-5171-4db6-914d-d169eac07e77 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:46:55.161327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-057fdbf9-5171-4db6-914d-d169eac07e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:55.270324 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 673/1336] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:46:55.318441 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a91c46-2b37-41ab-adb7-e2ba9fcbd20d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:46:55.320216 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-58a91c46-2b37-41ab-adb7-e2ba9fcbd20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:55.430101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a91c46-2b37-41ab-adb7-e2ba9fcbd20d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:46:55.517767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b6fa2-05ab-4667-bc21-1b917f341e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:46:55.518424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b6fa2-05ab-4667-bc21-1b917f341e1a service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:55.518706 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b6fa2-05ab-4667-bc21-1b917f341e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:55.518993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b6fa2-05ab-4667-bc21-1b917f341e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:55.520731 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0b6b6fa2-05ab-4667-bc21-1b917f341e1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:55.630983 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b6fa2-05ab-4667-bc21-1b917f341e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:46:55.632420 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b6fa2-05ab-4667-bc21-1b917f341e1a service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:46:55.650245 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 664/1337] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:46:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:46:58.612902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32c0b2-4ae0-4e25-bf7f-3027fb87590a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:58.613455 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32c0b2-4ae0-4e25-bf7f-3027fb87590a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:58.613455 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32c0b2-4ae0-4e25-bf7f-3027fb87590a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:58.614747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 674/1338] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:46:58.621378 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c747e-bdb4-4664-b3b5-60d776d28bd2 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:58.621835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c747e-bdb4-4664-b3b5-60d776d28bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:58.621930 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c747e-bdb4-4664-b3b5-60d776d28bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:58.703164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a96c747e-bdb4-4664-b3b5-60d776d28bd2 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:46:58.704470 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a96c747e-bdb4-4664-b3b5-60d776d28bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:58.804126 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 665/1339] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:46:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:46:58.840897 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32c0b2-4ae0-4e25-bf7f-3027fb87590a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:46:58.843319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1a32c0b2-4ae0-4e25-bf7f-3027fb87590a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:58.955368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32c0b2-4ae0-4e25-bf7f-3027fb87590a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:46:59.030032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42399d-0103-44c3-92a6-44ed0bdec80d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:46:59.030680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42399d-0103-44c3-92a6-44ed0bdec80d service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:59.031054 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42399d-0103-44c3-92a6-44ed0bdec80d service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:59.031330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42399d-0103-44c3-92a6-44ed0bdec80d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:59.032956 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2e42399d-0103-44c3-92a6-44ed0bdec80d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:59.139762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42399d-0103-44c3-92a6-44ed0bdec80d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:46:59.141191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42399d-0103-44c3-92a6-44ed0bdec80d service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:46:59.158849 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 675/1340] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:46:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:03.513745 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd40a52-c597-439c-8fae-9bd42e7f07d4 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:03.514339 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd40a52-c597-439c-8fae-9bd42e7f07d4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:03.514339 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd40a52-c597-439c-8fae-9bd42e7f07d4 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:03.515703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 666/1341] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:47:03.521259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d493e7e-40e0-4dee-847e-327ab5ebf77c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:03.521689 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d493e7e-40e0-4dee-847e-327ab5ebf77c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:03.521824 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d493e7e-40e0-4dee-847e-327ab5ebf77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:03.597353 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2d493e7e-40e0-4dee-847e-327ab5ebf77c None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:03.598526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2d493e7e-40e0-4dee-847e-327ab5ebf77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:03.707345 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 676/1342] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:03.745840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd40a52-c597-439c-8fae-9bd42e7f07d4 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:03.748320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9bd40a52-c597-439c-8fae-9bd42e7f07d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:03.845216 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd40a52-c597-439c-8fae-9bd42e7f07d4 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:03.849089 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af573ad9-f063-4f31-ae3e-7bb679777d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:03.849744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af573ad9-f063-4f31-ae3e-7bb679777d55 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:03.850035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af573ad9-f063-4f31-ae3e-7bb679777d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:03.850312 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af573ad9-f063-4f31-ae3e-7bb679777d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:03.859607 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af573ad9-f063-4f31-ae3e-7bb679777d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:03.861055 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af573ad9-f063-4f31-ae3e-7bb679777d55 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:03.870403 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 667/1343] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:06.651686 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699066d-5879-4b4c-a852-f9a022c70bda None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:06.652314 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699066d-5879-4b4c-a852-f9a022c70bda None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:06.652314 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699066d-5879-4b4c-a852-f9a022c70bda None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:06.653617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 677/1344] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:47:06.658826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725ab27-2018-4ddf-bfda-a60180ce2ce8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:06.659293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725ab27-2018-4ddf-bfda-a60180ce2ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:06.659395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725ab27-2018-4ddf-bfda-a60180ce2ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:06.687544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3725ab27-2018-4ddf-bfda-a60180ce2ce8 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:06.688647 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3725ab27-2018-4ddf-bfda-a60180ce2ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:06.768961 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 668/1345] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:47:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:06.805246 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699066d-5879-4b4c-a852-f9a022c70bda None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:06.816431 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699066d-5879-4b4c-a852-f9a022c70bda None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:06.819991 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3d8ce-8af0-4715-8220-42b2559e875a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:06.820731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3d8ce-8af0-4715-8220-42b2559e875a service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:06.821093 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3d8ce-8af0-4715-8220-42b2559e875a service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:06.821435 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3d8ce-8af0-4715-8220-42b2559e875a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:06.830641 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3d8ce-8af0-4715-8220-42b2559e875a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:06.832181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3d8ce-8af0-4715-8220-42b2559e875a service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:06.841580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 678/1346] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:47:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:11.114119 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5f095-5a44-425b-a2bd-a0821d015dd4 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:11.114646 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5f095-5a44-425b-a2bd-a0821d015dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:11.114646 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5f095-5a44-425b-a2bd-a0821d015dd4 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:11.116035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 669/1347] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:47:11.121447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32138855-ac08-49d2-8901-8d284d8bac77 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:11.121905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32138855-ac08-49d2-8901-8d284d8bac77 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:11.122017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32138855-ac08-49d2-8901-8d284d8bac77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:11.140063 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-32138855-ac08-49d2-8901-8d284d8bac77 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:11.141252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-32138855-ac08-49d2-8901-8d284d8bac77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:11.149621 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 679/1348] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:11.187215 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5f095-5a44-425b-a2bd-a0821d015dd4 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:11.199583 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5f095-5a44-425b-a2bd-a0821d015dd4 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:11.203515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c14d7-1ae4-4f9e-8fd0-2d98c428ac76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:11.204174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c14d7-1ae4-4f9e-8fd0-2d98c428ac76 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:11.204457 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c14d7-1ae4-4f9e-8fd0-2d98c428ac76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:11.204819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c14d7-1ae4-4f9e-8fd0-2d98c428ac76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:11.214574 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c14d7-1ae4-4f9e-8fd0-2d98c428ac76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:11.216059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c14d7-1ae4-4f9e-8fd0-2d98c428ac76 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:11.225974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 670/1349] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:16.531193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265b8d8-4d90-408c-a9cf-b34ea232413b None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:16.531697 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265b8d8-4d90-408c-a9cf-b34ea232413b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:16.531787 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265b8d8-4d90-408c-a9cf-b34ea232413b None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:16.533144 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 680/1350] 10.222.0.77 () {54 vars in 921 bytes} [Wed May 11 06:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:47:16.549284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8f6bb-6351-4adf-9a2f-a6888f7779d1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:16.549788 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8f6bb-6351-4adf-9a2f-a6888f7779d1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:16.549870 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8f6bb-6351-4adf-9a2f-a6888f7779d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:16.675990 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5fc8f6bb-6351-4adf-9a2f-a6888f7779d1 None None] MFA Rules not processed for user `d46e2703839e498da8f3e2c3fda1d61c`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:16.680080 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5fc8f6bb-6351-4adf-9a2f-a6888f7779d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:16.792829 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 671/1351] 10.222.0.77 () {58 vars in 1018 bytes} [Wed May 11 06:47:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:20.921813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf3492-ead7-45ad-a069-f9d0e6c0d4ac None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:20.922417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf3492-ead7-45ad-a069-f9d0e6c0d4ac None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:20.922417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf3492-ead7-45ad-a069-f9d0e6c0d4ac None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:20.924019 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 681/1352] 10.222.0.77 () {54 vars in 921 bytes} [Wed May 11 06:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:47:20.930602 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778ab15-7d65-426c-adec-751726b2860a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:20.931094 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778ab15-7d65-426c-adec-751726b2860a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:20.931191 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778ab15-7d65-426c-adec-751726b2860a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:20.950493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7778ab15-7d65-426c-adec-751726b2860a None None] MFA Rules not processed for user `d46e2703839e498da8f3e2c3fda1d61c`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:20.951867 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7778ab15-7d65-426c-adec-751726b2860a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:20.962467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 672/1353] 10.222.0.77 () {58 vars in 1018 bytes} [Wed May 11 06:47:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:22.407258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f6d23-a5e5-4e92-af1b-eedb20f028ab None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:22.407825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f6d23-a5e5-4e92-af1b-eedb20f028ab None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:22.407825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f6d23-a5e5-4e92-af1b-eedb20f028ab None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:22.409317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 682/1354] 10.222.0.77 () {54 vars in 921 bytes} [Wed May 11 06:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:47:22.414625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a88cbb-9c0f-4516-bfbc-8d9799b0ce5c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:22.415058 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a88cbb-9c0f-4516-bfbc-8d9799b0ce5c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:22.415232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a88cbb-9c0f-4516-bfbc-8d9799b0ce5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:22.434877 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-43a88cbb-9c0f-4516-bfbc-8d9799b0ce5c None None] MFA Rules not processed for user `d46e2703839e498da8f3e2c3fda1d61c`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:22.436107 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-43a88cbb-9c0f-4516-bfbc-8d9799b0ce5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:22.446150 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 673/1355] 10.222.0.77 () {58 vars in 1018 bytes} [Wed May 11 06:47:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:26.311861 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23589db0-e742-4960-bade-1b779b39d6fb None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:26.312366 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23589db0-e742-4960-bade-1b779b39d6fb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:26.312616 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23589db0-e742-4960-bade-1b779b39d6fb None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:26.314420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 683/1356] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:47:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:47:26.319767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f4b6a-241a-46fc-ac56-53b9330ddbe2 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:26.320175 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f4b6a-241a-46fc-ac56-53b9330ddbe2 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:26.320524 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f4b6a-241a-46fc-ac56-53b9330ddbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:26.338592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5e5f4b6a-241a-46fc-ac56-53b9330ddbe2 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:26.339816 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5e5f4b6a-241a-46fc-ac56-53b9330ddbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:26.348321 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 674/1357] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:26.398649 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37592e-4adc-4408-bc75-02379bf71eae None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:26.399230 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37592e-4adc-4408-bc75-02379bf71eae None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:26.399646 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37592e-4adc-4408-bc75-02379bf71eae None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:26.401191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 684/1358] 10.222.0.77 () {54 vars in 961 bytes} [Wed May 11 06:47:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:47:26.406891 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac86e9a-e494-4417-973d-9cfe6fb979ca None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:26.407499 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac86e9a-e494-4417-973d-9cfe6fb979ca None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:26.407741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac86e9a-e494-4417-973d-9cfe6fb979ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:26.459996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fac86e9a-e494-4417-973d-9cfe6fb979ca None None] MFA Rules not processed for user `edf9d57de89a4701ba1a5b079d0ad348`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:26.461181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fac86e9a-e494-4417-973d-9cfe6fb979ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:26.542810 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 675/1359] 10.222.0.77 () {58 vars in 1058 bytes} [Wed May 11 06:47:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:26.557411 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37592e-4adc-4408-bc75-02379bf71eae None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:26.572817 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37592e-4adc-4408-bc75-02379bf71eae None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:26.578211 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3722c-2e03-4db5-85c5-862269aa381a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:26.578983 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3722c-2e03-4db5-85c5-862269aa381a service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:26.579314 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3722c-2e03-4db5-85c5-862269aa381a service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:26.579652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3722c-2e03-4db5-85c5-862269aa381a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:26.588140 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3722c-2e03-4db5-85c5-862269aa381a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:26.589812 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3722c-2e03-4db5-85c5-862269aa381a service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:26.599429 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 685/1360] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:47:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:29.027958 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a2037-726a-4e72-940a-1432bca47451 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:29.028504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a2037-726a-4e72-940a-1432bca47451 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:29.028504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a2037-726a-4e72-940a-1432bca47451 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:29.029819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 676/1361] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:47:29.035473 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a09c3e-7e39-4a37-ba2f-16265fc229f6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:29.035896 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a09c3e-7e39-4a37-ba2f-16265fc229f6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:29.036033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a09c3e-7e39-4a37-ba2f-16265fc229f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:29.054723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-54a09c3e-7e39-4a37-ba2f-16265fc229f6 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:29.055952 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-54a09c3e-7e39-4a37-ba2f-16265fc229f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:29.064745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 686/1362] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:29.108733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a2037-726a-4e72-940a-1432bca47451 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:29.123626 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a2037-726a-4e72-940a-1432bca47451 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:29.129082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2540d-7b02-4560-b9f6-61dd35ccdbd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:29.129808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2540d-7b02-4560-b9f6-61dd35ccdbd0 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:29.130194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2540d-7b02-4560-b9f6-61dd35ccdbd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:29.130543 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2540d-7b02-4560-b9f6-61dd35ccdbd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:29.138871 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2540d-7b02-4560-b9f6-61dd35ccdbd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:29.140604 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2540d-7b02-4560-b9f6-61dd35ccdbd0 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:29.150062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 677/1363] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:31.686209 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659be13-4733-40f6-823a-cc7e2176ec03 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:31.686745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659be13-4733-40f6-823a-cc7e2176ec03 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:31.686745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659be13-4733-40f6-823a-cc7e2176ec03 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:31.688317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 687/1364] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:47:31.700836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf8bdf-45fd-4d82-9f6f-452b14c1983f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:31.701710 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf8bdf-45fd-4d82-9f6f-452b14c1983f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:31.702131 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf8bdf-45fd-4d82-9f6f-452b14c1983f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:31.729122 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-85bf8bdf-45fd-4d82-9f6f-452b14c1983f None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:31.730326 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-85bf8bdf-45fd-4d82-9f6f-452b14c1983f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:31.738223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 678/1365] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:31.782521 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f318c0-34b7-42bd-8070-cf0cb64965d9 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:31.782811 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f318c0-34b7-42bd-8070-cf0cb64965d9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:31.783125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f318c0-34b7-42bd-8070-cf0cb64965d9 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:31.784564 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 688/1366] 10.222.0.77 () {54 vars in 961 bytes} [Wed May 11 06:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:47:31.789833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63f692-c2d1-4ec6-a607-853109f78bf7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:31.790122 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63f692-c2d1-4ec6-a607-853109f78bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:31.790395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63f692-c2d1-4ec6-a607-853109f78bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:31.809469 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5c63f692-c2d1-4ec6-a607-853109f78bf7 None None] MFA Rules not processed for user `edf9d57de89a4701ba1a5b079d0ad348`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:31.810658 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5c63f692-c2d1-4ec6-a607-853109f78bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:31.821695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 679/1367] 10.222.0.77 () {58 vars in 1058 bytes} [Wed May 11 06:47:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:31.829639 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f318c0-34b7-42bd-8070-cf0cb64965d9 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:31.844567 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f318c0-34b7-42bd-8070-cf0cb64965d9 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:31.850468 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda8b28-f853-4d7d-89cc-824f1f73334c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:31.851202 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda8b28-f853-4d7d-89cc-824f1f73334c service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:31.851546 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda8b28-f853-4d7d-89cc-824f1f73334c service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:31.851884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda8b28-f853-4d7d-89cc-824f1f73334c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:31.860017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda8b28-f853-4d7d-89cc-824f1f73334c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:31.861595 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda8b28-f853-4d7d-89cc-824f1f73334c service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:31.871000 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 689/1368] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:47:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:34.155849 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66d580-3b8f-44a4-98ff-75c7032d1768 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.156469 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66d580-3b8f-44a4-98ff-75c7032d1768 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.156469 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66d580-3b8f-44a4-98ff-75c7032d1768 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.157718 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 680/1369] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:47:34.163265 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e33b93-7f3a-488c-91fb-d0c29b3f3ae5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.163673 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e33b93-7f3a-488c-91fb-d0c29b3f3ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.163844 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e33b93-7f3a-488c-91fb-d0c29b3f3ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.182176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f0e33b93-7f3a-488c-91fb-d0c29b3f3ae5 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:34.183398 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f0e33b93-7f3a-488c-91fb-d0c29b3f3ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:34.192049 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 690/1370] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:34.236479 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66d580-3b8f-44a4-98ff-75c7032d1768 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:34.251694 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66d580-3b8f-44a4-98ff-75c7032d1768 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:34.257222 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d164b37-6bba-4daf-b8e5-d51660051357 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:34.257882 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d164b37-6bba-4daf-b8e5-d51660051357 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.258160 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d164b37-6bba-4daf-b8e5-d51660051357 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.258434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d164b37-6bba-4daf-b8e5-d51660051357 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.267244 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d164b37-6bba-4daf-b8e5-d51660051357 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:34.268830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d164b37-6bba-4daf-b8e5-d51660051357 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:34.278774 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 681/1371] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:34.421120 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cd499-f53c-4c68-af22-75095fef5154 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.421369 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cd499-f53c-4c68-af22-75095fef5154 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.421529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cd499-f53c-4c68-af22-75095fef5154 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.423317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 691/1372] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:47:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:47:34.429590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ca539-17e8-4b87-abfc-d6af5ae41b52 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.430203 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ca539-17e8-4b87-abfc-d6af5ae41b52 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.430463 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ca539-17e8-4b87-abfc-d6af5ae41b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.452212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-465ca539-17e8-4b87-abfc-d6af5ae41b52 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:34.453971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-465ca539-17e8-4b87-abfc-d6af5ae41b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:34.467328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 682/1373] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:34.777203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09dbab-bd77-457a-9c7b-1790d12422c8 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.777619 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09dbab-bd77-457a-9c7b-1790d12422c8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.777991 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09dbab-bd77-457a-9c7b-1790d12422c8 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.779563 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 692/1374] 10.222.0.77 () {54 vars in 963 bytes} [Wed May 11 06:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:47:34.784892 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547d004-687d-4cd8-9b58-5707922566f8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.785287 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547d004-687d-4cd8-9b58-5707922566f8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.785658 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547d004-687d-4cd8-9b58-5707922566f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.834505 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b547d004-687d-4cd8-9b58-5707922566f8 None None] MFA Rules not processed for user `628e4779afa24fb187c4b10a3765af9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:34.835925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b547d004-687d-4cd8-9b58-5707922566f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:34.895534 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 683/1375] 10.222.0.77 () {58 vars in 1060 bytes} [Wed May 11 06:47:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:34.903461 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09dbab-bd77-457a-9c7b-1790d12422c8 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:34.914464 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09dbab-bd77-457a-9c7b-1790d12422c8 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:34.918492 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b7ea5-2321-4e35-976c-46534e005a21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:34.919305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b7ea5-2321-4e35-976c-46534e005a21 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.919794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b7ea5-2321-4e35-976c-46534e005a21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.920286 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b7ea5-2321-4e35-976c-46534e005a21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.929661 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b7ea5-2321-4e35-976c-46534e005a21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:34.931239 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b7ea5-2321-4e35-976c-46534e005a21 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:34.941205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 693/1376] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:36.566812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3e83e-709a-4626-abfd-337352fc9d4d None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:36.567414 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3e83e-709a-4626-abfd-337352fc9d4d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:36.567414 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3e83e-709a-4626-abfd-337352fc9d4d None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:36.568937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 684/1377] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:47:36.574919 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272016a0-90dd-4767-94b4-a77fe0e7dbf9 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:36.575519 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272016a0-90dd-4767-94b4-a77fe0e7dbf9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:36.575519 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272016a0-90dd-4767-94b4-a77fe0e7dbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:36.594770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-272016a0-90dd-4767-94b4-a77fe0e7dbf9 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:36.596054 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-272016a0-90dd-4767-94b4-a77fe0e7dbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:36.604570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 694/1378] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:36.649017 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3e83e-709a-4626-abfd-337352fc9d4d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:36.664234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3e83e-709a-4626-abfd-337352fc9d4d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:36.669994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebf887-c66b-4eaa-b76f-9864141f7201 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:36.670667 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebf887-c66b-4eaa-b76f-9864141f7201 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:36.670951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebf887-c66b-4eaa-b76f-9864141f7201 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:36.671255 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebf887-c66b-4eaa-b76f-9864141f7201 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:36.679788 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ebf887-c66b-4eaa-b76f-9864141f7201 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:36.681407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ebf887-c66b-4eaa-b76f-9864141f7201 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:36.691261 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 685/1379] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:47:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:38.954140 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb8688-4ac3-4e9d-b249-4144e29c3267 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:38.954741 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb8688-4ac3-4e9d-b249-4144e29c3267 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:38.954741 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb8688-4ac3-4e9d-b249-4144e29c3267 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:38.956065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 695/1380] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:47:38.961407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae6418-043c-4a6f-9529-140774dfedb4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:38.961823 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae6418-043c-4a6f-9529-140774dfedb4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:38.961966 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae6418-043c-4a6f-9529-140774dfedb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:38.979719 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5dae6418-043c-4a6f-9529-140774dfedb4 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:38.980905 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5dae6418-043c-4a6f-9529-140774dfedb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:38.989067 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 686/1381] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:39.032755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb8688-4ac3-4e9d-b249-4144e29c3267 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:39.047735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb8688-4ac3-4e9d-b249-4144e29c3267 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:39.053390 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3145e87-2617-4261-9769-c0fd5f8ab2d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:39.054143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3145e87-2617-4261-9769-c0fd5f8ab2d6 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:39.054516 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3145e87-2617-4261-9769-c0fd5f8ab2d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:39.054887 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3145e87-2617-4261-9769-c0fd5f8ab2d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:39.063581 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3145e87-2617-4261-9769-c0fd5f8ab2d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:39.065731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3145e87-2617-4261-9769-c0fd5f8ab2d6 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:39.075694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 696/1382] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:47:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:41.324714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a390e77-ded7-456b-8397-86d06aead7d9 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:41.325338 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a390e77-ded7-456b-8397-86d06aead7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:41.325338 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a390e77-ded7-456b-8397-86d06aead7d9 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:41.326730 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 687/1383] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:47:41.333232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a69d1-8030-43bc-be85-ac217f7eb97e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:41.334204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a69d1-8030-43bc-be85-ac217f7eb97e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:41.334448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a69d1-8030-43bc-be85-ac217f7eb97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:41.355008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5a3a69d1-8030-43bc-be85-ac217f7eb97e None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:41.356283 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5a3a69d1-8030-43bc-be85-ac217f7eb97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:41.364873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 697/1384] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:41.406827 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a390e77-ded7-456b-8397-86d06aead7d9 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:41.421920 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a390e77-ded7-456b-8397-86d06aead7d9 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:41.427784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fdd230-9bb9-465c-a234-322afeefd4cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:41.428441 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdd230-9bb9-465c-a234-322afeefd4cc service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:41.428720 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdd230-9bb9-465c-a234-322afeefd4cc service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:41.428994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdd230-9bb9-465c-a234-322afeefd4cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:41.438116 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fdd230-9bb9-465c-a234-322afeefd4cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:41.440135 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fdd230-9bb9-465c-a234-322afeefd4cc service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:41.449894 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 688/1385] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:43.698725 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c46ab-b9a0-4bf5-979b-efa4578d0d19 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:43.699351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c46ab-b9a0-4bf5-979b-efa4578d0d19 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:43.699503 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c46ab-b9a0-4bf5-979b-efa4578d0d19 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:43.701245 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 698/1386] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:47:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:47:43.706680 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca96a01-60f0-4e7e-8f4e-1ea505968fd8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:43.707149 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca96a01-60f0-4e7e-8f4e-1ea505968fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:43.707265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca96a01-60f0-4e7e-8f4e-1ea505968fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:43.725555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-bca96a01-60f0-4e7e-8f4e-1ea505968fd8 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:43.726781 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bca96a01-60f0-4e7e-8f4e-1ea505968fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:43.736400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 689/1387] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:43.780598 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c46ab-b9a0-4bf5-979b-efa4578d0d19 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:43.795581 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c46ab-b9a0-4bf5-979b-efa4578d0d19 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:43.802050 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7e575-7966-43c5-a4e5-1bae9794d5d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:43.802940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7e575-7966-43c5-a4e5-1bae9794d5d4 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:43.803367 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7e575-7966-43c5-a4e5-1bae9794d5d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:43.803775 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7e575-7966-43c5-a4e5-1bae9794d5d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:43.815526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7e575-7966-43c5-a4e5-1bae9794d5d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:43.817613 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7e575-7966-43c5-a4e5-1bae9794d5d4 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:43.830495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 699/1388] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:46.074490 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd91ca7-123e-42ae-a124-e92aa5c432b5 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:46.075071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd91ca7-123e-42ae-a124-e92aa5c432b5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:46.075071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd91ca7-123e-42ae-a124-e92aa5c432b5 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:46.076556 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 690/1389] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:47:46.082083 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b5386-9ea2-4cbb-b667-ea08b1985872 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:46.082608 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b5386-9ea2-4cbb-b667-ea08b1985872 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:46.082763 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b5386-9ea2-4cbb-b667-ea08b1985872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:46.101560 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a09b5386-9ea2-4cbb-b667-ea08b1985872 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:46.102784 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a09b5386-9ea2-4cbb-b667-ea08b1985872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:46.111292 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 700/1390] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:47:46.154468 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd91ca7-123e-42ae-a124-e92aa5c432b5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:46.169629 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd91ca7-123e-42ae-a124-e92aa5c432b5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:46.175483 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3de09-7f66-4393-862b-f7182ea23374 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:46.176138 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3de09-7f66-4393-862b-f7182ea23374 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:46.176425 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3de09-7f66-4393-862b-f7182ea23374 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:46.176705 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3de09-7f66-4393-862b-f7182ea23374 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:46.185545 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3de09-7f66-4393-862b-f7182ea23374 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:46.187185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3de09-7f66-4393-862b-f7182ea23374 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:46.198421 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 691/1391] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:47:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:48.916658 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b673d18-9ca7-4218-9c84-7fe79dcacfb7 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:48.917395 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b673d18-9ca7-4218-9c84-7fe79dcacfb7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:48.917395 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b673d18-9ca7-4218-9c84-7fe79dcacfb7 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:48.918610 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 701/1392] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:47:48.924209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ef0c4-6fc6-4c47-b389-269fa0e6de13 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:48.924636 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ef0c4-6fc6-4c47-b389-269fa0e6de13 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:48.924745 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ef0c4-6fc6-4c47-b389-269fa0e6de13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:48.944050 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-065ef0c4-6fc6-4c47-b389-269fa0e6de13 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:48.945244 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-065ef0c4-6fc6-4c47-b389-269fa0e6de13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:48.953645 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 692/1393] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:48.997834 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b673d18-9ca7-4218-9c84-7fe79dcacfb7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:49.013826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b673d18-9ca7-4218-9c84-7fe79dcacfb7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:49.020590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151350d-e5fe-4292-9938-11f857c0f715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:49.021251 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151350d-e5fe-4292-9938-11f857c0f715 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:49.021533 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151350d-e5fe-4292-9938-11f857c0f715 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:49.023253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151350d-e5fe-4292-9938-11f857c0f715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:49.031132 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151350d-e5fe-4292-9938-11f857c0f715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:49.032746 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151350d-e5fe-4292-9938-11f857c0f715 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:49.042653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 702/1394] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:47:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:50.478158 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e43c51-5985-46cb-ac9a-2f4d8756aad8 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:50.478692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e43c51-5985-46cb-ac9a-2f4d8756aad8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:50.478692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e43c51-5985-46cb-ac9a-2f4d8756aad8 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:50.480327 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 693/1395] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:47:50.485487 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f08f53-3dc5-4c7f-a088-32b89e0e9e93 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:50.485926 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f08f53-3dc5-4c7f-a088-32b89e0e9e93 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:50.486212 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f08f53-3dc5-4c7f-a088-32b89e0e9e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:50.504987 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-07f08f53-3dc5-4c7f-a088-32b89e0e9e93 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:50.506181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-07f08f53-3dc5-4c7f-a088-32b89e0e9e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:50.514818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 703/1396] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:50.570307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fa913-2501-4195-b7fd-e3475c89f218 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:50.570595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fa913-2501-4195-b7fd-e3475c89f218 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:50.570869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fa913-2501-4195-b7fd-e3475c89f218 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:50.572274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 694/1397] 10.222.0.77 () {54 vars in 962 bytes} [Wed May 11 06:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:47:50.577553 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb45f9-1445-488a-9e66-d942656dc3fa None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:50.577888 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb45f9-1445-488a-9e66-d942656dc3fa None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:50.578170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb45f9-1445-488a-9e66-d942656dc3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:50.628339 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-cefb45f9-1445-488a-9e66-d942656dc3fa None None] MFA Rules not processed for user `281c923b01a143dbb79d8c0ea04f55b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:50.629564 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cefb45f9-1445-488a-9e66-d942656dc3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:50.694134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 704/1398] 10.222.0.77 () {58 vars in 1059 bytes} [Wed May 11 06:47:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:50.701764 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fa913-2501-4195-b7fd-e3475c89f218 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:50.713479 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fa913-2501-4195-b7fd-e3475c89f218 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:50.717352 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00295d-7f5d-49dc-8dc1-3f711a73a3cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '281c923b01a143dbb79d8c0ea04f55b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:50.717993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00295d-7f5d-49dc-8dc1-3f711a73a3cd service glance] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:50.718282 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00295d-7f5d-49dc-8dc1-3f711a73a3cd service glance] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:50.718551 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00295d-7f5d-49dc-8dc1-3f711a73a3cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:50.727540 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00295d-7f5d-49dc-8dc1-3f711a73a3cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:50.728970 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00295d-7f5d-49dc-8dc1-3f711a73a3cd service glance] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:50.738328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 695/1399] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:47:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:51.159444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73287bd4-7c00-4840-a268-6f8d5f0d58e4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:51.159732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73287bd4-7c00-4840-a268-6f8d5f0d58e4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:51.159988 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73287bd4-7c00-4840-a268-6f8d5f0d58e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:51.207325 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-73287bd4-7c00-4840-a268-6f8d5f0d58e4 None None] MFA Rules not processed for user `99cbf80fc74c4183a6eed3e97f7196f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:51.208512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-73287bd4-7c00-4840-a268-6f8d5f0d58e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:51.269037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 705/1400] 10.222.0.77 () {58 vars in 1009 bytes} [Wed May 11 06:47:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:51.276312 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e976738-890e-41b6-94bc-d0bb46a96d4f None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:51.276580 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e976738-890e-41b6-94bc-d0bb46a96d4f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:51.276858 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e976738-890e-41b6-94bc-d0bb46a96d4f None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:51.278813 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 696/1401] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:47:51.288691 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1164214-4f5e-44d4-b215-8c07c8c77325 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:51.288983 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1164214-4f5e-44d4-b215-8c07c8c77325 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:51.289239 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1164214-4f5e-44d4-b215-8c07c8c77325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:51.309816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d1164214-4f5e-44d4-b215-8c07c8c77325 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:51.311071 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d1164214-4f5e-44d4-b215-8c07c8c77325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:51.313431 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec554d15-4a20-4031-8a98-4a7c5fe4157f None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:51.314069 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec554d15-4a20-4031-8a98-4a7c5fe4157f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:51.314344 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec554d15-4a20-4031-8a98-4a7c5fe4157f None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:51.315754 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 697/1402] 10.222.0.77 () {54 vars in 942 bytes} [Wed May 11 06:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:47:51.320592 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 706/1403] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:51.321810 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4570327-9499-44fe-b9ac-de518c6c134c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:51.322127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4570327-9499-44fe-b9ac-de518c6c134c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:51.322376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4570327-9499-44fe-b9ac-de518c6c134c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:51.364326 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1164214-4f5e-44d4-b215-8c07c8c77325 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:51.377107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1164214-4f5e-44d4-b215-8c07c8c77325 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:51.378520 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a4570327-9499-44fe-b9ac-de518c6c134c None None] MFA Rules not processed for user `f726f58d30734be7abf15400bff89533`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:51.379859 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a4570327-9499-44fe-b9ac-de518c6c134c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:51.384280 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d21e8-f583-4739-9488-fbda8f75286b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:51.384280 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d21e8-f583-4739-9488-fbda8f75286b service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:51.384521 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d21e8-f583-4739-9488-fbda8f75286b service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:51.384810 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d21e8-f583-4739-9488-fbda8f75286b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:51.393289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d21e8-f583-4739-9488-fbda8f75286b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:51.394908 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d21e8-f583-4739-9488-fbda8f75286b service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:51.405081 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 707/1404] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:47:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:51.453168 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 698/1405] 10.222.0.77 () {58 vars in 1039 bytes} [Wed May 11 06:47:51 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:47:51.463316 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d21e8-f583-4739-9488-fbda8f75286b service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:51.474313 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d21e8-f583-4739-9488-fbda8f75286b service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:51.480269 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e75aff-b111-42e5-96b4-e0ffb957d574 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f726f58d30734be7abf15400bff89533', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:51.480953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e75aff-b111-42e5-96b4-e0ffb957d574 service swift] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:51.481241 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e75aff-b111-42e5-96b4-e0ffb957d574 service swift] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:51.481517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e75aff-b111-42e5-96b4-e0ffb957d574 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:51.490834 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e75aff-b111-42e5-96b4-e0ffb957d574 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:51.492511 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e75aff-b111-42e5-96b4-e0ffb957d574 service swift] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:51.501841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 708/1406] 10.222.0.77 () {60 vars in 1384 bytes} [Wed May 11 06:47:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 06:47:53.687421 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0854cee-92e9-4ade-b255-4c9aa5386e79 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:53.688009 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0854cee-92e9-4ade-b255-4c9aa5386e79 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:53.688009 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0854cee-92e9-4ade-b255-4c9aa5386e79 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:53.689746 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 699/1407] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:47:53.695206 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ea28d-95ae-4db2-920b-d14775a9d853 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:53.695656 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ea28d-95ae-4db2-920b-d14775a9d853 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:53.695837 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ea28d-95ae-4db2-920b-d14775a9d853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:53.714178 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d22ea28d-95ae-4db2-920b-d14775a9d853 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:53.715414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d22ea28d-95ae-4db2-920b-d14775a9d853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:53.724422 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 709/1408] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:53.772281 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0854cee-92e9-4ade-b255-4c9aa5386e79 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:53.787352 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0854cee-92e9-4ade-b255-4c9aa5386e79 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:53.792734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128dc53-145f-424b-8224-befdd003ca60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:53.793370 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128dc53-145f-424b-8224-befdd003ca60 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:53.793653 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128dc53-145f-424b-8224-befdd003ca60 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:53.793921 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128dc53-145f-424b-8224-befdd003ca60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:53.802024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128dc53-145f-424b-8224-befdd003ca60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:53.804003 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128dc53-145f-424b-8224-befdd003ca60 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:53.815078 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 700/1409] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:47:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:48:15.034883 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e71639-4159-4b0d-8468-4b1f71b2cb25 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:15.035560 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e71639-4159-4b0d-8468-4b1f71b2cb25 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:15.035560 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e71639-4159-4b0d-8468-4b1f71b2cb25 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:15.036862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 710/1410] 10.222.0.77 () {54 vars in 918 bytes} [Wed May 11 06:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:48:15.042367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f536c1f-ffa7-47b8-bfd4-4f98d4c04055 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:15.042861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f536c1f-ffa7-47b8-bfd4-4f98d4c04055 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:15.042861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f536c1f-ffa7-47b8-bfd4-4f98d4c04055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:15.064526 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5f536c1f-ffa7-47b8-bfd4-4f98d4c04055 None None] MFA Rules not processed for user `d46e2703839e498da8f3e2c3fda1d61c`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:15.065744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5f536c1f-ffa7-47b8-bfd4-4f98d4c04055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:15.076594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 701/1411] 10.222.0.77 () {58 vars in 1015 bytes} [Wed May 11 06:48:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:48:15.092728 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73522ff7-82cc-4e83-bf91-2f7c9952d13f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:15.093137 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73522ff7-82cc-4e83-bf91-2f7c9952d13f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:15.093545 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73522ff7-82cc-4e83-bf91-2f7c9952d13f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:15.096010 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 711/1412] 10.222.0.77 () {54 vars in 918 bytes} [Wed May 11 06:48:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:48:15.102129 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe07ed-13a0-450e-b246-eb38c74271e9 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:15.102413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe07ed-13a0-450e-b246-eb38c74271e9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:15.102685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe07ed-13a0-450e-b246-eb38c74271e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:15.121517 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1bbe07ed-13a0-450e-b246-eb38c74271e9 None None] MFA Rules not processed for user `edf9d57de89a4701ba1a5b079d0ad348`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:15.122713 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1bbe07ed-13a0-450e-b246-eb38c74271e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:15.132966 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 702/1413] 10.222.0.77 () {58 vars in 1015 bytes} [Wed May 11 06:48:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:48:17.815390 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50124a0-441d-4740-b197-a21374680243 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:17.816364 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50124a0-441d-4740-b197-a21374680243 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:17.816364 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50124a0-441d-4740-b197-a21374680243 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:17.818414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:48:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:48:17.826216 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824e727-915a-4550-9dd5-2c5226541cca None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:17.826632 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824e727-915a-4550-9dd5-2c5226541cca None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:17.826802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824e727-915a-4550-9dd5-2c5226541cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:17.854326 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9824e727-915a-4550-9dd5-2c5226541cca None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:17.855564 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9824e727-915a-4550-9dd5-2c5226541cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:17.864668 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:48:17.912197 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50124a0-441d-4740-b197-a21374680243 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:48:17.928874 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50124a0-441d-4740-b197-a21374680243 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:48:17.935441 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b211fdf-56eb-4329-a434-46b384a56905 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:48:17.936114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b211fdf-56eb-4329-a434-46b384a56905 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:17.936357 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b211fdf-56eb-4329-a434-46b384a56905 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:17.936668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b211fdf-56eb-4329-a434-46b384a56905 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:17.945425 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b211fdf-56eb-4329-a434-46b384a56905 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:48:17.947071 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b211fdf-56eb-4329-a434-46b384a56905 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:48:17.956601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 713/1416] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:48:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:48:18.948711 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1de421-3bcf-4bda-852e-f9b51c0ccde7 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:18.949664 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1de421-3bcf-4bda-852e-f9b51c0ccde7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:18.949664 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1de421-3bcf-4bda-852e-f9b51c0ccde7 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:18.951873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:48:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:48:18.960110 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943bd20-3748-4eba-9c9c-e572712b5aba None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:18.960568 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943bd20-3748-4eba-9c9c-e572712b5aba None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:18.960672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943bd20-3748-4eba-9c9c-e572712b5aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:18.980311 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3943bd20-3748-4eba-9c9c-e572712b5aba None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:18.981519 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3943bd20-3748-4eba-9c9c-e572712b5aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:18.990043 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:48:19.147914 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1de421-3bcf-4bda-852e-f9b51c0ccde7 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:48:19.164004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1de421-3bcf-4bda-852e-f9b51c0ccde7 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:48:19.170760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112387a0-62ae-4aee-8241-87eb2344b526 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:48:19.171433 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112387a0-62ae-4aee-8241-87eb2344b526 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:19.171716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112387a0-62ae-4aee-8241-87eb2344b526 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:19.171990 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112387a0-62ae-4aee-8241-87eb2344b526 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:19.180273 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112387a0-62ae-4aee-8241-87eb2344b526 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:48:19.181967 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112387a0-62ae-4aee-8241-87eb2344b526 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:48:19.191849 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 705/1419] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:48:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:48:20.157355 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cdd79-4a04-41ff-8600-b621fcdfe304 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:20.158232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cdd79-4a04-41ff-8600-b621fcdfe304 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:20.158232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cdd79-4a04-41ff-8600-b621fcdfe304 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:20.160491 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:48:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:48:20.166385 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d51a21-b25a-4e36-bf0f-6badf89e3d03 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:20.166802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d51a21-b25a-4e36-bf0f-6badf89e3d03 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:20.166915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d51a21-b25a-4e36-bf0f-6badf89e3d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:20.185414 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-55d51a21-b25a-4e36-bf0f-6badf89e3d03 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:20.186603 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-55d51a21-b25a-4e36-bf0f-6badf89e3d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:20.195340 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:48:20.347375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cdd79-4a04-41ff-8600-b621fcdfe304 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:48:20.364134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cdd79-4a04-41ff-8600-b621fcdfe304 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:48:20.370502 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4c448-5eac-48f1-97e6-c162c73a56cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:48:20.371457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4c448-5eac-48f1-97e6-c162c73a56cc service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:20.371738 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4c448-5eac-48f1-97e6-c162c73a56cc service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:20.372004 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4c448-5eac-48f1-97e6-c162c73a56cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:20.380272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4c448-5eac-48f1-97e6-c162c73a56cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:48:20.381853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4c448-5eac-48f1-97e6-c162c73a56cc service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:48:20.391206 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 716/1422] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:48:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:48:21.314361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddc32e-eb8f-4525-8a07-8520fad7b69e None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:21.314867 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddc32e-eb8f-4525-8a07-8520fad7b69e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:21.314995 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddc32e-eb8f-4525-8a07-8520fad7b69e None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:21.317108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:48:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:48:21.324365 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b00ee7-c8ce-444d-85a3-72be489bee32 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:21.324828 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b00ee7-c8ce-444d-85a3-72be489bee32 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:21.324944 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b00ee7-c8ce-444d-85a3-72be489bee32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:21.343970 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-04b00ee7-c8ce-444d-85a3-72be489bee32 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:21.345249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-04b00ee7-c8ce-444d-85a3-72be489bee32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:21.355394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:48:21.505026 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddc32e-eb8f-4525-8a07-8520fad7b69e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:48:21.520708 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddc32e-eb8f-4525-8a07-8520fad7b69e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:48:21.526714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3180a-30d2-42e1-8bec-e24397e0ed3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:48:21.527379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3180a-30d2-42e1-8bec-e24397e0ed3e service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:21.527634 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3180a-30d2-42e1-8bec-e24397e0ed3e service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:21.527936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3180a-30d2-42e1-8bec-e24397e0ed3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:21.536147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3180a-30d2-42e1-8bec-e24397e0ed3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:48:21.537728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3180a-30d2-42e1-8bec-e24397e0ed3e service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:48:21.548114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 708/1425] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:48:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:48:22.462885 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd6f72-e71a-4d5f-9bde-d28616898d9e None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:22.463837 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd6f72-e71a-4d5f-9bde-d28616898d9e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:22.463837 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd6f72-e71a-4d5f-9bde-d28616898d9e None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:22.466012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:48:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:48:22.471237 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46dcc0-f3ed-4a03-92e3-2451b3f74b5b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:22.471678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46dcc0-f3ed-4a03-92e3-2451b3f74b5b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:22.471771 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46dcc0-f3ed-4a03-92e3-2451b3f74b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:22.490371 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fd46dcc0-f3ed-4a03-92e3-2451b3f74b5b None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:22.491609 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fd46dcc0-f3ed-4a03-92e3-2451b3f74b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:22.500007 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:48:22.653652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd6f72-e71a-4d5f-9bde-d28616898d9e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:48:22.677807 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd6f72-e71a-4d5f-9bde-d28616898d9e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:48:22.685931 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733afa3-64a1-4b4c-918f-96fc8b52f872 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:48:22.686581 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733afa3-64a1-4b4c-918f-96fc8b52f872 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:22.686859 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733afa3-64a1-4b4c-918f-96fc8b52f872 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:22.687159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733afa3-64a1-4b4c-918f-96fc8b52f872 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:22.695776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733afa3-64a1-4b4c-918f-96fc8b52f872 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:48:22.697365 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733afa3-64a1-4b4c-918f-96fc8b52f872 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:48:22.706823 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 719/1428] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:48:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:48:23.580647 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a461a-f753-4506-bc1f-d54149109f55 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:23.581468 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a461a-f753-4506-bc1f-d54149109f55 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:23.581468 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a461a-f753-4506-bc1f-d54149109f55 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:23.583860 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:48:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:48:23.592134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b1e95-fdaa-4ac5-a74a-cdcf51847943 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:23.592569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b1e95-fdaa-4ac5-a74a-cdcf51847943 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:23.592688 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b1e95-fdaa-4ac5-a74a-cdcf51847943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:23.615298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b13b1e95-fdaa-4ac5-a74a-cdcf51847943 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:23.617110 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b13b1e95-fdaa-4ac5-a74a-cdcf51847943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:23.627291 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:48:23.780525 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a461a-f753-4506-bc1f-d54149109f55 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:48:23.800684 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a461a-f753-4506-bc1f-d54149109f55 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:48:23.807171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20fd27-d8e6-4ea9-bc5e-8b7c8a8f1582 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:48:23.807819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20fd27-d8e6-4ea9-bc5e-8b7c8a8f1582 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:23.808106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20fd27-d8e6-4ea9-bc5e-8b7c8a8f1582 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:23.808379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20fd27-d8e6-4ea9-bc5e-8b7c8a8f1582 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:23.817076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20fd27-d8e6-4ea9-bc5e-8b7c8a8f1582 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:48:23.818661 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20fd27-d8e6-4ea9-bc5e-8b7c8a8f1582 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:48:23.828276 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 711/1431] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:48:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:48:24.685348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f6d4a-d74d-45f2-8a46-00d19870dd0c None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:24.685938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f6d4a-d74d-45f2-8a46-00d19870dd0c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:24.685938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f6d4a-d74d-45f2-8a46-00d19870dd0c None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:24.687329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:48:24.693757 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c261f5-5ca7-45af-9b93-23c88110ee6e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:24.694197 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c261f5-5ca7-45af-9b93-23c88110ee6e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:24.694393 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c261f5-5ca7-45af-9b93-23c88110ee6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:24.713810 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-41c261f5-5ca7-45af-9b93-23c88110ee6e None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:24.715060 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-41c261f5-5ca7-45af-9b93-23c88110ee6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:24.724228 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:48:24.886022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f6d4a-d74d-45f2-8a46-00d19870dd0c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:48:24.907816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f6d4a-d74d-45f2-8a46-00d19870dd0c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:48:24.914359 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ed4d8-7c27-430f-a2e4-db76f98b8a13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:48:24.914993 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ed4d8-7c27-430f-a2e4-db76f98b8a13 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:24.915320 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ed4d8-7c27-430f-a2e4-db76f98b8a13 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:24.915709 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ed4d8-7c27-430f-a2e4-db76f98b8a13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:24.924048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ed4d8-7c27-430f-a2e4-db76f98b8a13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:48:24.925635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ed4d8-7c27-430f-a2e4-db76f98b8a13 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:48:24.935305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 722/1434] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:48:25.804473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936af6e4-b569-45ee-b5db-39189a386d0d None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:25.805112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936af6e4-b569-45ee-b5db-39189a386d0d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:25.805112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936af6e4-b569-45ee-b5db-39189a386d0d None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:25.806437 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:48:25.812576 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f4ef1-a8e5-4280-bf10-87f17c6de96f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:25.813018 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f4ef1-a8e5-4280-bf10-87f17c6de96f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:25.813134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f4ef1-a8e5-4280-bf10-87f17c6de96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:25.840723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-361f4ef1-a8e5-4280-bf10-87f17c6de96f None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:25.841936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-361f4ef1-a8e5-4280-bf10-87f17c6de96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:25.850848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:48:26.003319 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936af6e4-b569-45ee-b5db-39189a386d0d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:48:26.023172 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936af6e4-b569-45ee-b5db-39189a386d0d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:48:26.032373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fffc1-52d8-4d79-b09c-7fa838c302b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:48:26.033031 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fffc1-52d8-4d79-b09c-7fa838c302b6 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:26.033309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fffc1-52d8-4d79-b09c-7fa838c302b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:26.033578 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fffc1-52d8-4d79-b09c-7fa838c302b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:26.045978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fffc1-52d8-4d79-b09c-7fa838c302b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:48:26.047598 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fffc1-52d8-4d79-b09c-7fa838c302b6 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:48:26.057586 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 714/1437] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:48:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:48:26.933777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877ec70-1056-4aa8-81aa-a228ced4ec70 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:26.934393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877ec70-1056-4aa8-81aa-a228ced4ec70 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:26.934393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877ec70-1056-4aa8-81aa-a228ced4ec70 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:26.935948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:48:26.942609 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36769b5b-c463-49de-a105-190239f99fd5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:26.943355 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36769b5b-c463-49de-a105-190239f99fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:26.943548 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36769b5b-c463-49de-a105-190239f99fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:26.963589 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-36769b5b-c463-49de-a105-190239f99fd5 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:26.964800 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-36769b5b-c463-49de-a105-190239f99fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:26.973342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:48:27.125223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877ec70-1056-4aa8-81aa-a228ced4ec70 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:48:27.143933 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877ec70-1056-4aa8-81aa-a228ced4ec70 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:48:27.150178 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dbbb7d-bd99-4bad-89fc-b8ec9abaf6d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:48:27.150820 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbbb7d-bd99-4bad-89fc-b8ec9abaf6d3 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:27.151236 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbbb7d-bd99-4bad-89fc-b8ec9abaf6d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:27.151514 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbbb7d-bd99-4bad-89fc-b8ec9abaf6d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:27.159856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dbbb7d-bd99-4bad-89fc-b8ec9abaf6d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:48:27.161450 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dbbb7d-bd99-4bad-89fc-b8ec9abaf6d3 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:48:27.172136 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 725/1440] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:48:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:48:29.232343 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f12d42-4eac-4a53-8320-74046468d8b3 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:29.233300 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f12d42-4eac-4a53-8320-74046468d8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:29.233300 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f12d42-4eac-4a53-8320-74046468d8b3 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:29.235521 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:48:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:48:29.241048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ce43c-4364-4f0c-b732-6577551d9286 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:29.241514 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ce43c-4364-4f0c-b732-6577551d9286 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:29.241627 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ce43c-4364-4f0c-b732-6577551d9286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:29.264493 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-010ce43c-4364-4f0c-b732-6577551d9286 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:29.265766 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-010ce43c-4364-4f0c-b732-6577551d9286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:29.274363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:48:29.315772 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f12d42-4eac-4a53-8320-74046468d8b3 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:48:29.330165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f12d42-4eac-4a53-8320-74046468d8b3 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:48:29.334716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2586b-b8c4-4a77-b3c0-1cbfe733dab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:48:29.335398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2586b-b8c4-4a77-b3c0-1cbfe733dab1 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:29.335678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2586b-b8c4-4a77-b3c0-1cbfe733dab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:29.335960 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2586b-b8c4-4a77-b3c0-1cbfe733dab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:29.345615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2586b-b8c4-4a77-b3c0-1cbfe733dab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:48:29.347085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2586b-b8c4-4a77-b3c0-1cbfe733dab1 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:48:29.357223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 717/1443] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:48:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:48:31.701863 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc158d-1d45-4708-9a19-0e2fffc8bb32 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:31.702475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc158d-1d45-4708-9a19-0e2fffc8bb32 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:31.702475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc158d-1d45-4708-9a19-0e2fffc8bb32 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:31.704768 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:48:31.710181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13914d28-9230-4b32-ada2-7346df35a676 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:31.710868 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13914d28-9230-4b32-ada2-7346df35a676 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:31.711126 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13914d28-9230-4b32-ada2-7346df35a676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:31.731248 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-13914d28-9230-4b32-ada2-7346df35a676 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:31.732453 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-13914d28-9230-4b32-ada2-7346df35a676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:31.742019 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:48:31.779420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc158d-1d45-4708-9a19-0e2fffc8bb32 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:48:31.781493 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-17dc158d-1d45-4708-9a19-0e2fffc8bb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:31.798665 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc158d-1d45-4708-9a19-0e2fffc8bb32 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:48:31.803635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac435f-a71b-403c-a8b1-8b3b81c61fe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:48:31.804294 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac435f-a71b-403c-a8b1-8b3b81c61fe7 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:31.804848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac435f-a71b-403c-a8b1-8b3b81c61fe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:31.805130 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac435f-a71b-403c-a8b1-8b3b81c61fe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:31.815895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac435f-a71b-403c-a8b1-8b3b81c61fe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:48:31.817368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac435f-a71b-403c-a8b1-8b3b81c61fe7 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:48:31.826868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 728/1446] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:48:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:48:34.339293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9eddaf-f64e-4d78-8220-f6473cdd6f29 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:34.339911 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9eddaf-f64e-4d78-8220-f6473cdd6f29 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:34.339911 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9eddaf-f64e-4d78-8220-f6473cdd6f29 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:34.341194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:48:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:48:34.346856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cebaf-94ba-4906-a758-df97e9d876ad None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:34.347299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cebaf-94ba-4906-a758-df97e9d876ad None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:34.347432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cebaf-94ba-4906-a758-df97e9d876ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:34.366639 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-cf9cebaf-94ba-4906-a758-df97e9d876ad None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:34.367860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cf9cebaf-94ba-4906-a758-df97e9d876ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:34.376147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:48:34.413572 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9eddaf-f64e-4d78-8220-f6473cdd6f29 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:48:34.426944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9eddaf-f64e-4d78-8220-f6473cdd6f29 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:48:34.431364 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e666c21-87c7-4394-b659-aa6cece238bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:48:34.432028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e666c21-87c7-4394-b659-aa6cece238bc service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:34.432306 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e666c21-87c7-4394-b659-aa6cece238bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:34.432575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e666c21-87c7-4394-b659-aa6cece238bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:34.442775 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e666c21-87c7-4394-b659-aa6cece238bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:48:34.444241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e666c21-87c7-4394-b659-aa6cece238bc service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:48:34.453536 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 720/1449] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:48:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:48:36.781587 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ac4cf-91d1-49db-b3e1-7e2fc35e85f0 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:36.782500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ac4cf-91d1-49db-b3e1-7e2fc35e85f0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:36.782612 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ac4cf-91d1-49db-b3e1-7e2fc35e85f0 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:36.784956 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:48:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:48:36.791157 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c0b68-ee66-469d-b7e3-c92450c7b436 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:36.791593 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c0b68-ee66-469d-b7e3-c92450c7b436 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:36.791703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c0b68-ee66-469d-b7e3-c92450c7b436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:36.810071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2c4c0b68-ee66-469d-b7e3-c92450c7b436 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:36.811303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2c4c0b68-ee66-469d-b7e3-c92450c7b436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:36.820460 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:48:36.858433 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ac4cf-91d1-49db-b3e1-7e2fc35e85f0 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:48:36.876791 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ac4cf-91d1-49db-b3e1-7e2fc35e85f0 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:48:36.883694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f9dbe-676b-4035-8dfa-fac778ea7425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:48:36.884453 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f9dbe-676b-4035-8dfa-fac778ea7425 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:36.884734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f9dbe-676b-4035-8dfa-fac778ea7425 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:36.885022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f9dbe-676b-4035-8dfa-fac778ea7425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:36.894265 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f9dbe-676b-4035-8dfa-fac778ea7425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:48:36.896142 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f9dbe-676b-4035-8dfa-fac778ea7425 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:48:36.908897 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 731/1452] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:48:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:48:39.166369 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02132c7-dbf8-4d4f-b748-931bc1925d63 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:39.167341 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02132c7-dbf8-4d4f-b748-931bc1925d63 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:39.167341 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02132c7-dbf8-4d4f-b748-931bc1925d63 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:39.169475 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:48:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:48:39.175964 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeb2af-d71d-4d1d-a3b7-879d5bf9066d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:39.176737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeb2af-d71d-4d1d-a3b7-879d5bf9066d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:39.176950 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeb2af-d71d-4d1d-a3b7-879d5bf9066d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:39.197358 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-26aeb2af-d71d-4d1d-a3b7-879d5bf9066d None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:39.198571 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-26aeb2af-d71d-4d1d-a3b7-879d5bf9066d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:39.206970 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:48:39.243827 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02132c7-dbf8-4d4f-b748-931bc1925d63 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:48:39.256864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02132c7-dbf8-4d4f-b748-931bc1925d63 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:48:39.261318 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3f1ec-e3f3-4a7f-8f85-8ddf86676b52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:48:39.261965 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3f1ec-e3f3-4a7f-8f85-8ddf86676b52 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:39.262269 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3f1ec-e3f3-4a7f-8f85-8ddf86676b52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:39.262543 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3f1ec-e3f3-4a7f-8f85-8ddf86676b52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:39.272194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3f1ec-e3f3-4a7f-8f85-8ddf86676b52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:48:39.273690 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3f1ec-e3f3-4a7f-8f85-8ddf86676b52 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:48:39.283437 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 723/1455] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:48:41.573268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137b692-c394-424a-b7ae-93a23d20d2b2 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:41.573821 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137b692-c394-424a-b7ae-93a23d20d2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:41.573821 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137b692-c394-424a-b7ae-93a23d20d2b2 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:41.578718 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:48:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:48:41.586520 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834e587-c5b4-4014-9d3a-bc23fed56a7a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:41.587405 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834e587-c5b4-4014-9d3a-bc23fed56a7a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:41.587582 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834e587-c5b4-4014-9d3a-bc23fed56a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:41.607113 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1834e587-c5b4-4014-9d3a-bc23fed56a7a None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:41.608292 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1834e587-c5b4-4014-9d3a-bc23fed56a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:41.617674 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:48:41.655464 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137b692-c394-424a-b7ae-93a23d20d2b2 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:48:41.673644 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137b692-c394-424a-b7ae-93a23d20d2b2 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:48:41.680297 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8fc90-0331-4b4e-94bc-4ebc84d4c8a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:48:41.681309 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8fc90-0331-4b4e-94bc-4ebc84d4c8a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:41.681591 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8fc90-0331-4b4e-94bc-4ebc84d4c8a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:41.681895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8fc90-0331-4b4e-94bc-4ebc84d4c8a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:41.692297 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8fc90-0331-4b4e-94bc-4ebc84d4c8a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:48:41.693748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8fc90-0331-4b4e-94bc-4ebc84d4c8a7 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:48:41.703502 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 734/1458] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:48:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:48:43.947113 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5f9f0-288d-4496-a176-859cb71b80fb None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:43.947719 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5f9f0-288d-4496-a176-859cb71b80fb None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:43.947719 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5f9f0-288d-4496-a176-859cb71b80fb None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:43.949062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:48:43.955551 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6739064-1323-492f-aebd-512e9ad3f35d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:43.956231 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6739064-1323-492f-aebd-512e9ad3f35d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:43.956413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6739064-1323-492f-aebd-512e9ad3f35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:43.976962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d6739064-1323-492f-aebd-512e9ad3f35d None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:43.978150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d6739064-1323-492f-aebd-512e9ad3f35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:43.988135 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:48:44.025030 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5f9f0-288d-4496-a176-859cb71b80fb None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:48:44.037119 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5f9f0-288d-4496-a176-859cb71b80fb None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:48:44.041023 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567e74c-f045-45fd-abe9-f7f07e27bdab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:48:44.041650 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567e74c-f045-45fd-abe9-f7f07e27bdab service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:44.041974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567e74c-f045-45fd-abe9-f7f07e27bdab service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:44.042248 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567e74c-f045-45fd-abe9-f7f07e27bdab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:44.051336 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567e74c-f045-45fd-abe9-f7f07e27bdab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:48:44.052900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567e74c-f045-45fd-abe9-f7f07e27bdab service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:48:44.062132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 726/1461] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:48:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:48:46.300380 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168a2df-f82e-4dae-a533-4f131c717a67 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:46.300830 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168a2df-f82e-4dae-a533-4f131c717a67 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:46.300937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168a2df-f82e-4dae-a533-4f131c717a67 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:46.302375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:48:46.308379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d15c3-c0c4-48db-b1e4-11fac5607a76 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:46.308902 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d15c3-c0c4-48db-b1e4-11fac5607a76 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:46.308902 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d15c3-c0c4-48db-b1e4-11fac5607a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:46.333544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-cc8d15c3-c0c4-48db-b1e4-11fac5607a76 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:46.334773 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cc8d15c3-c0c4-48db-b1e4-11fac5607a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:46.344028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:48:46.385196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168a2df-f82e-4dae-a533-4f131c717a67 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:48:46.403316 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168a2df-f82e-4dae-a533-4f131c717a67 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:48:46.409249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2794e7d-e2c5-41d9-adeb-5443fa024214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:48:46.410222 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2794e7d-e2c5-41d9-adeb-5443fa024214 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:46.410633 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2794e7d-e2c5-41d9-adeb-5443fa024214 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:46.411015 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2794e7d-e2c5-41d9-adeb-5443fa024214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:46.422916 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2794e7d-e2c5-41d9-adeb-5443fa024214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:48:46.424390 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2794e7d-e2c5-41d9-adeb-5443fa024214 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:48:46.434179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 737/1464] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:48:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:48:48.643490 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1f6a5-d8e2-426b-a3fc-a4cddc5907a1 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:48.644255 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1f6a5-d8e2-426b-a3fc-a4cddc5907a1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:48.644255 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1f6a5-d8e2-426b-a3fc-a4cddc5907a1 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:48.646285 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:48:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:48:48.652661 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78789add-b9d8-499a-8179-bd7789838310 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:48.653398 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78789add-b9d8-499a-8179-bd7789838310 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:48.653568 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78789add-b9d8-499a-8179-bd7789838310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:48.676524 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-78789add-b9d8-499a-8179-bd7789838310 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:48.677748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-78789add-b9d8-499a-8179-bd7789838310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:48.686639 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:48:48.722782 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1f6a5-d8e2-426b-a3fc-a4cddc5907a1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:48:48.735193 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1f6a5-d8e2-426b-a3fc-a4cddc5907a1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:48:48.739065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2b7e8-057f-4c1a-8b8d-b59ebe43287b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:48:48.739738 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2b7e8-057f-4c1a-8b8d-b59ebe43287b service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:48.740011 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2b7e8-057f-4c1a-8b8d-b59ebe43287b service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:48.740283 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2b7e8-057f-4c1a-8b8d-b59ebe43287b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:48.749995 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2b7e8-057f-4c1a-8b8d-b59ebe43287b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:48:48.751493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2b7e8-057f-4c1a-8b8d-b59ebe43287b service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:48:48.761980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 729/1467] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:48:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:48:50.976176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f94eb-3c84-4897-a189-bfb1ca27f172 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:50.976805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f94eb-3c84-4897-a189-bfb1ca27f172 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:50.976805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f94eb-3c84-4897-a189-bfb1ca27f172 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:50.978132 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:48:50.984735 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d48f09-6abd-439d-a04a-94685c7bcecd None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:50.985472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d48f09-6abd-439d-a04a-94685c7bcecd None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:50.985572 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d48f09-6abd-439d-a04a-94685c7bcecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:51.013218 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d4d48f09-6abd-439d-a04a-94685c7bcecd None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:51.014419 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d4d48f09-6abd-439d-a04a-94685c7bcecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:51.023340 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:48:51.059817 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f94eb-3c84-4897-a189-bfb1ca27f172 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:48:51.075974 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f94eb-3c84-4897-a189-bfb1ca27f172 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:48:51.079677 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b827d-fc90-4443-8843-4a7933a05fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:48:51.080317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b827d-fc90-4443-8843-4a7933a05fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:51.080599 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b827d-fc90-4443-8843-4a7933a05fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:51.080881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b827d-fc90-4443-8843-4a7933a05fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:51.090467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b827d-fc90-4443-8843-4a7933a05fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:48:51.091943 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b827d-fc90-4443-8843-4a7933a05fa7 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:48:51.101782 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 740/1470] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:48:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:49:24.005946 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7fe2d-4431-4a61-a771-67a9bc98be48 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:24.006878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7fe2d-4431-4a61-a771-67a9bc98be48 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:24.006878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7fe2d-4431-4a61-a771-67a9bc98be48 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:24.008901 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 731/1471] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:49:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:49:24.014204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46cde5-354b-442f-b2be-d0c4b7b65a6a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:24.014666 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46cde5-354b-442f-b2be-d0c4b7b65a6a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:24.014780 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46cde5-354b-442f-b2be-d0c4b7b65a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:24.033749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7d46cde5-354b-442f-b2be-d0c4b7b65a6a None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:49:24.034943 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7d46cde5-354b-442f-b2be-d0c4b7b65a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:49:24.044220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 741/1472] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:49:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:49:24.096897 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafc4d4-dd47-44e1-bae9-b5cf616fd7d8 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:24.097239 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafc4d4-dd47-44e1-bae9-b5cf616fd7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:24.097517 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafc4d4-dd47-44e1-bae9-b5cf616fd7d8 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:24.098869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 732/1473] 10.222.0.77 () {54 vars in 962 bytes} [Wed May 11 06:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:49:24.103842 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e5cf3-db1f-4c86-815c-374626fcd601 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:24.104182 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e5cf3-db1f-4c86-815c-374626fcd601 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:24.104433 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e5cf3-db1f-4c86-815c-374626fcd601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:24.123974 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-025e5cf3-db1f-4c86-815c-374626fcd601 None None] MFA Rules not processed for user `281c923b01a143dbb79d8c0ea04f55b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:49:24.125189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-025e5cf3-db1f-4c86-815c-374626fcd601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:49:24.132027 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 742/1474] 10.222.0.77 () {58 vars in 1059 bytes} [Wed May 11 06:49:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:49:24.139418 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafc4d4-dd47-44e1-bae9-b5cf616fd7d8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:49:24.150745 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafc4d4-dd47-44e1-bae9-b5cf616fd7d8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:49:24.154900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76cb60-e979-46d1-b09a-b81b74aa4507 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '281c923b01a143dbb79d8c0ea04f55b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:49:24.155571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76cb60-e979-46d1-b09a-b81b74aa4507 service glance] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:24.155892 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76cb60-e979-46d1-b09a-b81b74aa4507 service glance] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:24.156166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76cb60-e979-46d1-b09a-b81b74aa4507 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:24.165580 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76cb60-e979-46d1-b09a-b81b74aa4507 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:49:24.167008 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76cb60-e979-46d1-b09a-b81b74aa4507 service glance] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:49:24.178881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 733/1475] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:49:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:49:26.487670 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e558e0c-75bf-4b11-9764-93157086be6f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:26.488274 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e558e0c-75bf-4b11-9764-93157086be6f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:26.488274 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e558e0c-75bf-4b11-9764-93157086be6f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:26.489600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 743/1476] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:49:26.495622 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46060b-a45d-487f-91f2-f941a35518b3 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:26.496094 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46060b-a45d-487f-91f2-f941a35518b3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:26.496205 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46060b-a45d-487f-91f2-f941a35518b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:26.517965 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5c46060b-a45d-487f-91f2-f941a35518b3 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:49:26.519203 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5c46060b-a45d-487f-91f2-f941a35518b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:49:26.527999 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 734/1477] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:49:26.550934 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e558e0c-75bf-4b11-9764-93157086be6f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:49:26.563748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e558e0c-75bf-4b11-9764-93157086be6f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:49:26.568561 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ea5e7-4746-4d43-8d74-44d064d10af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:49:26.569258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ea5e7-4746-4d43-8d74-44d064d10af7 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:26.569547 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ea5e7-4746-4d43-8d74-44d064d10af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:26.569821 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ea5e7-4746-4d43-8d74-44d064d10af7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:26.570594 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ea5e7-4746-4d43-8d74-44d064d10af7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:49:26.572422 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: WARNING py.warnings [None req-f08ea5e7-4746-4d43-8d74-44d064d10af7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 06:49:26.572422 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: warnings.warn(msg) May 11 06:49:26.572422 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: May 11 06:49:26.573563 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ea5e7-4746-4d43-8d74-44d064d10af7 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:49:26.593199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 744/1478] 10.222.0.77 () {56 vars in 1108 bytes} [Wed May 11 06:49:26 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:49:28.810030 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5284786-c2ec-4b51-b012-078ce87e686f None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:28.810882 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5284786-c2ec-4b51-b012-078ce87e686f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:28.810882 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5284786-c2ec-4b51-b012-078ce87e686f None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:28.813456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 735/1479] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:49:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:49:28.819935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a9176-18c5-4442-8c7e-139f2f8824ca None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:28.820389 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a9176-18c5-4442-8c7e-139f2f8824ca None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:28.820487 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a9176-18c5-4442-8c7e-139f2f8824ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:28.845980 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-762a9176-18c5-4442-8c7e-139f2f8824ca None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:49:28.847261 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-762a9176-18c5-4442-8c7e-139f2f8824ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:49:28.857546 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 745/1480] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:49:28.902660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5284786-c2ec-4b51-b012-078ce87e686f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:49:28.919320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5284786-c2ec-4b51-b012-078ce87e686f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:49:28.925122 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337cd85-be3c-4923-8d9c-68dbe5e6bc6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:49:28.925768 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337cd85-be3c-4923-8d9c-68dbe5e6bc6b service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:28.926050 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337cd85-be3c-4923-8d9c-68dbe5e6bc6b service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:28.926324 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337cd85-be3c-4923-8d9c-68dbe5e6bc6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:28.934663 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337cd85-be3c-4923-8d9c-68dbe5e6bc6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:49:28.936679 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337cd85-be3c-4923-8d9c-68dbe5e6bc6b service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:49:28.948568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 736/1481] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:49:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:49:31.336549 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36a2e5-2871-401d-91f1-b84ec2229842 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:31.337373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36a2e5-2871-401d-91f1-b84ec2229842 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:31.337373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36a2e5-2871-401d-91f1-b84ec2229842 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:31.339749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 746/1482] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:49:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:49:31.348788 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba89166-4bb5-4614-9635-23e20a24b09b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:31.349224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba89166-4bb5-4614-9635-23e20a24b09b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:31.349441 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba89166-4bb5-4614-9635-23e20a24b09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:31.369424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-aba89166-4bb5-4614-9635-23e20a24b09b None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:49:31.370638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-aba89166-4bb5-4614-9635-23e20a24b09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:49:31.378998 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 737/1483] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:49:31.417110 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36a2e5-2871-401d-91f1-b84ec2229842 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:49:31.429221 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36a2e5-2871-401d-91f1-b84ec2229842 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:49:31.433280 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3a69b-57af-4db7-8881-030f361646e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:49:31.433946 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3a69b-57af-4db7-8881-030f361646e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:31.434226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3a69b-57af-4db7-8881-030f361646e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:31.434501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3a69b-57af-4db7-8881-030f361646e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:31.444147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3a69b-57af-4db7-8881-030f361646e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:49:31.445583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3a69b-57af-4db7-8881-030f361646e5 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:49:31.454939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 747/1484] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:49:33.719109 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b28aa-dca6-4497-a8fc-6685876e87ec None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:33.719717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b28aa-dca6-4497-a8fc-6685876e87ec None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:33.719717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b28aa-dca6-4497-a8fc-6685876e87ec None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:33.721011 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 738/1485] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:49:33.727411 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67368f-f4a6-4cd7-bf5a-ff5652b77245 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:33.727870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67368f-f4a6-4cd7-bf5a-ff5652b77245 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:33.727976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67368f-f4a6-4cd7-bf5a-ff5652b77245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:33.746918 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2d67368f-f4a6-4cd7-bf5a-ff5652b77245 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:49:33.748201 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2d67368f-f4a6-4cd7-bf5a-ff5652b77245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:49:33.756973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 748/1486] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:49:33.794362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b28aa-dca6-4497-a8fc-6685876e87ec None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:49:33.806936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b28aa-dca6-4497-a8fc-6685876e87ec None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:49:33.811863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feaaef2-9975-406a-88fc-5dc284b66182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:49:33.812852 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaaef2-9975-406a-88fc-5dc284b66182 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:33.813158 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaaef2-9975-406a-88fc-5dc284b66182 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:33.813424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaaef2-9975-406a-88fc-5dc284b66182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:33.822835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feaaef2-9975-406a-88fc-5dc284b66182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:49:33.824317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feaaef2-9975-406a-88fc-5dc284b66182 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:49:33.833900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 739/1487] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:49:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:49:36.248119 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266bb1e-6547-4b3c-8032-949fc457654f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:36.249204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266bb1e-6547-4b3c-8032-949fc457654f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:36.249204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266bb1e-6547-4b3c-8032-949fc457654f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:36.251160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 749/1488] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:49:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:49:36.256590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7344784-7d6f-4e70-b1a2-290aaf6b45a3 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:36.257043 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7344784-7d6f-4e70-b1a2-290aaf6b45a3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:36.257150 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7344784-7d6f-4e70-b1a2-290aaf6b45a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:36.282511 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d7344784-7d6f-4e70-b1a2-290aaf6b45a3 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:49:36.283770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d7344784-7d6f-4e70-b1a2-290aaf6b45a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:49:36.292654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 740/1489] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:49:36.333383 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266bb1e-6547-4b3c-8032-949fc457654f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:49:36.346606 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266bb1e-6547-4b3c-8032-949fc457654f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:49:36.351450 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab29b7a-3699-49e5-9b5e-f286b8222457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:49:36.352130 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab29b7a-3699-49e5-9b5e-f286b8222457 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:36.352410 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab29b7a-3699-49e5-9b5e-f286b8222457 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:36.352687 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab29b7a-3699-49e5-9b5e-f286b8222457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:36.365951 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab29b7a-3699-49e5-9b5e-f286b8222457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:49:36.367513 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab29b7a-3699-49e5-9b5e-f286b8222457 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:49:36.377492 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 750/1490] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:49:38.779250 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c180ef-4030-4617-9ac2-78466fc641ea None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:38.780164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c180ef-4030-4617-9ac2-78466fc641ea None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:38.780164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c180ef-4030-4617-9ac2-78466fc641ea None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:38.782296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 741/1491] 10.222.0.77 () {54 vars in 926 bytes} [Wed May 11 06:49:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:49:38.790328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078560c-15c8-455e-a32f-e2cb49e16979 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:38.790788 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078560c-15c8-455e-a32f-e2cb49e16979 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:38.790884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078560c-15c8-455e-a32f-e2cb49e16979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:38.808946 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8078560c-15c8-455e-a32f-e2cb49e16979 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:49:38.810126 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8078560c-15c8-455e-a32f-e2cb49e16979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:49:38.818743 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 751/1492] 10.222.0.77 () {58 vars in 1023 bytes} [Wed May 11 06:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:49:38.856819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c180ef-4030-4617-9ac2-78466fc641ea None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:49:38.869765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c180ef-4030-4617-9ac2-78466fc641ea None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:49:38.874381 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c4de1-b26a-45f0-89a1-15d81cea5d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:49:38.875066 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c4de1-b26a-45f0-89a1-15d81cea5d6f service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:38.875376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c4de1-b26a-45f0-89a1-15d81cea5d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:38.875660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c4de1-b26a-45f0-89a1-15d81cea5d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:38.885444 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c4de1-b26a-45f0-89a1-15d81cea5d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:49:38.887298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c4de1-b26a-45f0-89a1-15d81cea5d6f service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:49:38.898889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 742/1493] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:49:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:51:05.857200 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38458e45-8bbd-4bce-8205-6c651c32ddcd None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:05.858124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38458e45-8bbd-4bce-8205-6c651c32ddcd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:05.858124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38458e45-8bbd-4bce-8205-6c651c32ddcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:05.887129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-38458e45-8bbd-4bce-8205-6c651c32ddcd None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:51:05.888320 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-38458e45-8bbd-4bce-8205-6c651c32ddcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:05.896816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 752/1494] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:51:05.907415 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc354a0-2428-42fd-997a-751f582a919a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:05.907934 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc354a0-2428-42fd-997a-751f582a919a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:05.908052 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc354a0-2428-42fd-997a-751f582a919a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:05.930006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-cdc354a0-2428-42fd-997a-751f582a919a None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:51:05.931252 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cdc354a0-2428-42fd-997a-751f582a919a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:05.940531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 743/1495] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:51:05.945246 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38458e45-8bbd-4bce-8205-6c651c32ddcd None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:05.955071 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38458e45-8bbd-4bce-8205-6c651c32ddcd None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:05.959759 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f85a5d-ce5d-4e1b-8bd0-a79cf666e460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:05.960417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f85a5d-ce5d-4e1b-8bd0-a79cf666e460 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:05.960704 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f85a5d-ce5d-4e1b-8bd0-a79cf666e460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:05.960982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f85a5d-ce5d-4e1b-8bd0-a79cf666e460 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:05.961716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f85a5d-ce5d-4e1b-8bd0-a79cf666e460 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:51:05.962029 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f85a5d-ce5d-4e1b-8bd0-a79cf666e460 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:05.963092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: WARNING py.warnings [None req-b4f85a5d-ce5d-4e1b-8bd0-a79cf666e460 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 06:51:05.963092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: warnings.warn(msg) May 11 06:51:05.963092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: May 11 06:51:05.963990 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f85a5d-ce5d-4e1b-8bd0-a79cf666e460 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:05.975299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 753/1496] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:51:05.983435 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc354a0-2428-42fd-997a-751f582a919a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:05.992918 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc354a0-2428-42fd-997a-751f582a919a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:05.998100 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aecc8f-a99e-4de1-91ca-1f18d168da94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:05.998750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aecc8f-a99e-4de1-91ca-1f18d168da94 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:05.999067 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aecc8f-a99e-4de1-91ca-1f18d168da94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:05.999343 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aecc8f-a99e-4de1-91ca-1f18d168da94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:06.000036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aecc8f-a99e-4de1-91ca-1f18d168da94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:06.001844 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: WARNING py.warnings [None req-28aecc8f-a99e-4de1-91ca-1f18d168da94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 06:51:06.001844 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: warnings.warn(msg) May 11 06:51:06.001844 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: May 11 06:51:06.003083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aecc8f-a99e-4de1-91ca-1f18d168da94 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:06.040501 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 744/1497] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:51:05 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:51:06.045123 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f85a5d-ce5d-4e1b-8bd0-a79cf666e460 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:06.055232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f85a5d-ce5d-4e1b-8bd0-a79cf666e460 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:06.111525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d63d30-137e-4ab1-a2a4-f6a21e49b5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:06.112064 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d63d30-137e-4ab1-a2a4-f6a21e49b5dc admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:06.112349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d63d30-137e-4ab1-a2a4-f6a21e49b5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:06.112627 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d63d30-137e-4ab1-a2a4-f6a21e49b5dc admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:06.113313 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d63d30-137e-4ab1-a2a4-f6a21e49b5dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:06.114337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: WARNING py.warnings [None req-16d63d30-137e-4ab1-a2a4-f6a21e49b5dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 06:51:06.114337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: warnings.warn(msg) May 11 06:51:06.114337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: May 11 06:51:06.115598 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d63d30-137e-4ab1-a2a4-f6a21e49b5dc admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:06.138039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 754/1498] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:51:06 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:51:06.142440 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aecc8f-a99e-4de1-91ca-1f18d168da94 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:06.152699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aecc8f-a99e-4de1-91ca-1f18d168da94 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:06.157497 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521592fa-160e-4a44-a9de-5ccc645d336f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:06.158157 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521592fa-160e-4a44-a9de-5ccc645d336f admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:06.158439 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521592fa-160e-4a44-a9de-5ccc645d336f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:06.158715 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521592fa-160e-4a44-a9de-5ccc645d336f admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:06.159469 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521592fa-160e-4a44-a9de-5ccc645d336f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:06.160484 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: WARNING py.warnings [None req-521592fa-160e-4a44-a9de-5ccc645d336f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 06:51:06.160484 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: warnings.warn(msg) May 11 06:51:06.160484 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: May 11 06:51:06.161354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521592fa-160e-4a44-a9de-5ccc645d336f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:06.173747 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 745/1499] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:51:06.177694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d63d30-137e-4ab1-a2a4-f6a21e49b5dc admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:06.188408 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d63d30-137e-4ab1-a2a4-f6a21e49b5dc admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:06.194192 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb57ff-7262-4729-b8f0-0853fcdb67f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:06.194880 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb57ff-7262-4729-b8f0-0853fcdb67f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:06.195203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb57ff-7262-4729-b8f0-0853fcdb67f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:06.195473 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb57ff-7262-4729-b8f0-0853fcdb67f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:06.196193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb57ff-7262-4729-b8f0-0853fcdb67f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:06.197212 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: WARNING py.warnings [None req-68eb57ff-7262-4729-b8f0-0853fcdb67f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 06:51:06.197212 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: warnings.warn(msg) May 11 06:51:06.197212 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: May 11 06:51:06.198283 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb57ff-7262-4729-b8f0-0853fcdb67f0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:06.213193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 755/1500] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:51:06.217583 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521592fa-160e-4a44-a9de-5ccc645d336f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:06.228067 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521592fa-160e-4a44-a9de-5ccc645d336f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:06.232867 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a435a-ad00-4a2e-9b14-2b42b696b345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:06.233752 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a435a-ad00-4a2e-9b14-2b42b696b345 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:06.234031 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a435a-ad00-4a2e-9b14-2b42b696b345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:06.234328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a435a-ad00-4a2e-9b14-2b42b696b345 admin admin] PATH_INFO: `/v3/projects/41fa3f7c449e458795ca0854a5dca3f2/users/5f024e10a0f44d00ad7bd4ffc0b4e807/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:06.248900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a435a-ad00-4a2e-9b14-2b42b696b345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41fa3f7c449e458795ca0854a5dca3f2, user_id=5f024e10a0f44d00ad7bd4ffc0b4e807, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:06.249927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: WARNING py.warnings [None req-9b1a435a-ad00-4a2e-9b14-2b42b696b345 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 06:51:06.249927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: warnings.warn(msg) May 11 06:51:06.249927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: May 11 06:51:06.251877 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a435a-ad00-4a2e-9b14-2b42b696b345 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:06.267111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 746/1501] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:51:06 2022] PUT /identity/v3/projects/41fa3f7c449e458795ca0854a5dca3f2/users/5f024e10a0f44d00ad7bd4ffc0b4e807/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:51:06.278984 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de16fc-9d4d-4dda-b2e6-18edf3a08cf6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:06.279282 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de16fc-9d4d-4dda-b2e6-18edf3a08cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:06.279557 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de16fc-9d4d-4dda-b2e6-18edf3a08cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:06.308184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d3de16fc-9d4d-4dda-b2e6-18edf3a08cf6 None None] MFA Rules not processed for user `5f024e10a0f44d00ad7bd4ffc0b4e807`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:51:06.309401 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d3de16fc-9d4d-4dda-b2e6-18edf3a08cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:06.373776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 756/1502] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:51:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:51:06.390058 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11c4b0-82e5-45bb-aa89-c7e3530a3b04 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:06.390347 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11c4b0-82e5-45bb-aa89-c7e3530a3b04 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:06.390622 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11c4b0-82e5-45bb-aa89-c7e3530a3b04 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:06.392040 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 747/1503] 10.222.0.77 () {54 vars in 963 bytes} [Wed May 11 06:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:51:06.397895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b84f2e-e809-457a-8b8f-21a216a18793 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:06.398263 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b84f2e-e809-457a-8b8f-21a216a18793 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:06.398655 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b84f2e-e809-457a-8b8f-21a216a18793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:06.417259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-65b84f2e-e809-457a-8b8f-21a216a18793 None None] MFA Rules not processed for user `628e4779afa24fb187c4b10a3765af9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:51:06.418607 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-65b84f2e-e809-457a-8b8f-21a216a18793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:06.473115 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 757/1504] 10.222.0.77 () {58 vars in 1060 bytes} [Wed May 11 06:51:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:51:06.480797 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11c4b0-82e5-45bb-aa89-c7e3530a3b04 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:06.492857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11c4b0-82e5-45bb-aa89-c7e3530a3b04 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:06.496746 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c265f-5cf7-42a5-84f9-1e1bc5d9551e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:06.497413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c265f-5cf7-42a5-84f9-1e1bc5d9551e service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:06.497691 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c265f-5cf7-42a5-84f9-1e1bc5d9551e service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:06.497963 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c265f-5cf7-42a5-84f9-1e1bc5d9551e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:06.506687 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c265f-5cf7-42a5-84f9-1e1bc5d9551e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:06.508177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c265f-5cf7-42a5-84f9-1e1bc5d9551e service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:06.517195 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 748/1505] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:51:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:51:06.559970 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3786a-43b2-45a7-ac94-24140b30b942 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:06.560509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3786a-43b2-45a7-ac94-24140b30b942 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:06.560808 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3786a-43b2-45a7-ac94-24140b30b942 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:06.562462 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 758/1506] 10.222.0.77 () {52 vars in 829 bytes} [Wed May 11 06:51:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:51:06.566724 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c265f-5cf7-42a5-84f9-1e1bc5d9551e service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:06.629905 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c265f-5cf7-42a5-84f9-1e1bc5d9551e service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:06.636863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02447f00-f394-471b-b22e-610643814072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:06.638186 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02447f00-f394-471b-b22e-610643814072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:06.638478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02447f00-f394-471b-b22e-610643814072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:06.638757 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02447f00-f394-471b-b22e-610643814072 admin admin] PATH_INFO: `/v3/users/5f024e10a0f44d00ad7bd4ffc0b4e807` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:06.641081 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02447f00-f394-471b-b22e-610643814072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f024e10a0f44d00ad7bd4ffc0b4e807)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:06.642596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: WARNING py.warnings [None req-02447f00-f394-471b-b22e-610643814072 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 06:51:06.642596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: warnings.warn(msg) May 11 06:51:06.642596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: May 11 06:51:06.644966 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02447f00-f394-471b-b22e-610643814072 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:06.715056 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-02447f00-f394-471b-b22e-610643814072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f024e10a0f44d00ad7bd4ffc0b4e807'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:06.735114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-02447f00-f394-471b-b22e-610643814072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f024e10a0f44d00ad7bd4ffc0b4e807'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:06.735815 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-02447f00-f394-471b-b22e-610643814072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f024e10a0f44d00ad7bd4ffc0b4e807'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:06.736542 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-02447f00-f394-471b-b22e-610643814072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f024e10a0f44d00ad7bd4ffc0b4e807'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:06.749110 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-02447f00-f394-471b-b22e-610643814072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f024e10a0f44d00ad7bd4ffc0b4e807'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:06.767621 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 749/1507] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:51:06 2022] DELETE /identity/v3/users/5f024e10a0f44d00ad7bd4ffc0b4e807 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:51:06.772267 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efb47d-1991-489d-9bb1-29f7a76c71bf None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:06.772556 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efb47d-1991-489d-9bb1-29f7a76c71bf None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:06.772831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efb47d-1991-489d-9bb1-29f7a76c71bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:06.790212 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b9efb47d-1991-489d-9bb1-29f7a76c71bf None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:51:06.791461 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b9efb47d-1991-489d-9bb1-29f7a76c71bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:06.851185 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 759/1508] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:51:06.861542 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02447f00-f394-471b-b22e-610643814072 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:06.863724 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-02447f00-f394-471b-b22e-610643814072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:06.926603 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02447f00-f394-471b-b22e-610643814072 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:06.931227 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b81de-d0f9-4ba0-91fa-456b5cf38b14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:06.931924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b81de-d0f9-4ba0-91fa-456b5cf38b14 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:06.932208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b81de-d0f9-4ba0-91fa-456b5cf38b14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:06.932476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b81de-d0f9-4ba0-91fa-456b5cf38b14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:06.943223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b81de-d0f9-4ba0-91fa-456b5cf38b14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:06.944634 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b81de-d0f9-4ba0-91fa-456b5cf38b14 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:06.954001 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 750/1509] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:51:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:51:07.288560 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efb47d-1991-489d-9bb1-29f7a76c71bf None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:07.289613 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b9efb47d-1991-489d-9bb1-29f7a76c71bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:07.302772 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efb47d-1991-489d-9bb1-29f7a76c71bf None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:07.308109 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29c4de-5b8a-46f1-9017-11f2a6dabd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:07.309017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29c4de-5b8a-46f1-9017-11f2a6dabd5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:07.309326 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29c4de-5b8a-46f1-9017-11f2a6dabd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:07.309658 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29c4de-5b8a-46f1-9017-11f2a6dabd5b admin admin] PATH_INFO: `/v3/projects/41fa3f7c449e458795ca0854a5dca3f2` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:07.310751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29c4de-5b8a-46f1-9017-11f2a6dabd5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=41fa3f7c449e458795ca0854a5dca3f2)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:07.312165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: WARNING py.warnings [None req-df29c4de-5b8a-46f1-9017-11f2a6dabd5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 06:51:07.312165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: warnings.warn(msg) May 11 06:51:07.312165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: May 11 06:51:07.313350 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29c4de-5b8a-46f1-9017-11f2a6dabd5b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:07.378784 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-df29c4de-5b8a-46f1-9017-11f2a6dabd5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41fa3f7c449e458795ca0854a5dca3f2', 'request_id': 'req-df29c4de-5b8a-46f1-9017-11f2a6dabd5b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:07.391801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-df29c4de-5b8a-46f1-9017-11f2a6dabd5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41fa3f7c449e458795ca0854a5dca3f2', 'request_id': 'req-df29c4de-5b8a-46f1-9017-11f2a6dabd5b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:07.402012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-df29c4de-5b8a-46f1-9017-11f2a6dabd5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41fa3f7c449e458795ca0854a5dca3f2', 'request_id': 'req-df29c4de-5b8a-46f1-9017-11f2a6dabd5b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:07.412626 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-df29c4de-5b8a-46f1-9017-11f2a6dabd5b admin admin] The token cache is being invalidate because project 41fa3f7c449e458795ca0854a5dca3f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:51:07.412895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-df29c4de-5b8a-46f1-9017-11f2a6dabd5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:07.413573 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-df29c4de-5b8a-46f1-9017-11f2a6dabd5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:07.415281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 760/1510] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:51:07 2022] DELETE /identity/v3/projects/41fa3f7c449e458795ca0854a5dca3f2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:52:50.071105 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bc4bc-dfa7-4e11-911c-a92d4bae9b79 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:52:50.071740 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bc4bc-dfa7-4e11-911c-a92d4bae9b79 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:52:50.071740 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bc4bc-dfa7-4e11-911c-a92d4bae9b79 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:52:50.073045 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:52:50.078266 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebca9f-9434-409b-94c1-490a36e430f1 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:52:50.078726 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebca9f-9434-409b-94c1-490a36e430f1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:52:50.078834 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebca9f-9434-409b-94c1-490a36e430f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:52:50.098994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-73ebca9f-9434-409b-94c1-490a36e430f1 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:52:50.100207 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-73ebca9f-9434-409b-94c1-490a36e430f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:52:50.174919 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:52:50.347095 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bc4bc-dfa7-4e11-911c-a92d4bae9b79 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:52:50.349614 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3c3bc4bc-dfa7-4e11-911c-a92d4bae9b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:52:50.426150 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bc4bc-dfa7-4e11-911c-a92d4bae9b79 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:52:50.432450 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d2a62-a375-43a8-8887-a37a75aafecf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:52:50.433082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d2a62-a375-43a8-8887-a37a75aafecf service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:52:50.433358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d2a62-a375-43a8-8887-a37a75aafecf service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:52:50.433628 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d2a62-a375-43a8-8887-a37a75aafecf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:52:50.442245 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d2a62-a375-43a8-8887-a37a75aafecf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:52:50.443838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d2a62-a375-43a8-8887-a37a75aafecf service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:52:50.453061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 752/1513] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:52:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:52:51.346557 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0a417-eff2-4f6c-931e-d3e362b1f0b0 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:52:51.347166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0a417-eff2-4f6c-931e-d3e362b1f0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:52:51.347166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0a417-eff2-4f6c-931e-d3e362b1f0b0 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:52:51.348551 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:52:51.353710 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69a662-2877-4723-9b4f-c52b0b84dd6c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:52:51.354157 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69a662-2877-4723-9b4f-c52b0b84dd6c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:52:51.354264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69a662-2877-4723-9b4f-c52b0b84dd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:52:51.368253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d8257-4994-40e8-bdf5-e8892aef17fa None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:52:51.368505 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d8257-4994-40e8-bdf5-e8892aef17fa None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:52:51.368817 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d8257-4994-40e8-bdf5-e8892aef17fa None None] PATH_INFO: `/v3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:52:51.370015 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 763/1515] 10.222.0.75 () {54 vars in 925 bytes} [Wed May 11 06:52:51 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:52:51.376521 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-dd69a662-2877-4723-9b4f-c52b0b84dd6c None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:52:51.377930 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-dd69a662-2877-4723-9b4f-c52b0b84dd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:52:51.378195 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6108a49-5137-4b28-a5e5-230e48fc1c82 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:52:51.378487 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6108a49-5137-4b28-a5e5-230e48fc1c82 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:52:51.378766 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6108a49-5137-4b28-a5e5-230e48fc1c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:52:51.386290 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 753/1516] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:52:51.399185 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f6108a49-5137-4b28-a5e5-230e48fc1c82 None None] MFA Rules not processed for user `d46e2703839e498da8f3e2c3fda1d61c`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:52:51.400381 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f6108a49-5137-4b28-a5e5-230e48fc1c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:52:51.460652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 764/1517] 10.222.0.75 () {58 vars in 1015 bytes} [Wed May 11 06:52:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:52:51.537116 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69a662-2877-4723-9b4f-c52b0b84dd6c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:52:51.550845 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69a662-2877-4723-9b4f-c52b0b84dd6c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:52:51.558190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf144495-a178-4577-bc00-1f095d86af0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:52:51.558836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf144495-a178-4577-bc00-1f095d86af0f service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:52:51.559485 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf144495-a178-4577-bc00-1f095d86af0f service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:52:51.559748 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf144495-a178-4577-bc00-1f095d86af0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:52:51.568637 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf144495-a178-4577-bc00-1f095d86af0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:52:51.570233 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf144495-a178-4577-bc00-1f095d86af0f service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:52:51.579930 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 754/1518] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:52:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:53:02.907578 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8075310-0ba8-4e2a-b742-e52046bae6be None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:02.908170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8075310-0ba8-4e2a-b742-e52046bae6be None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:02.908170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8075310-0ba8-4e2a-b742-e52046bae6be None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:02.910209 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 765/1519] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:53:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:53:02.915456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346d42e-4197-4115-a8ed-57f8a4dffc0c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:02.915937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346d42e-4197-4115-a8ed-57f8a4dffc0c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:02.916046 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346d42e-4197-4115-a8ed-57f8a4dffc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:02.935174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9346d42e-4197-4115-a8ed-57f8a4dffc0c None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:53:02.936393 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9346d42e-4197-4115-a8ed-57f8a4dffc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:53:02.944782 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 755/1520] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:53:03.094504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8075310-0ba8-4e2a-b742-e52046bae6be None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:53:03.111270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8075310-0ba8-4e2a-b742-e52046bae6be None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:53:03.116999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8d5dc-e39e-496c-ba40-ff491c63c6c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:53:03.117660 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8d5dc-e39e-496c-ba40-ff491c63c6c4 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:03.117941 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8d5dc-e39e-496c-ba40-ff491c63c6c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:03.118217 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8d5dc-e39e-496c-ba40-ff491c63c6c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:03.126663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8d5dc-e39e-496c-ba40-ff491c63c6c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:53:03.128405 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8d5dc-e39e-496c-ba40-ff491c63c6c4 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:53:03.137657 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 766/1521] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:53:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:53:04.020326 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2126bc-6246-421f-9a2b-244ffa2f0db8 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:04.020882 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2126bc-6246-421f-9a2b-244ffa2f0db8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:04.020882 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2126bc-6246-421f-9a2b-244ffa2f0db8 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:04.022146 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:53:04.028312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9eb604-5aff-4b79-ada1-e8c75daee020 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:04.029050 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9eb604-5aff-4b79-ada1-e8c75daee020 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:04.029199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9eb604-5aff-4b79-ada1-e8c75daee020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:04.048672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3d9eb604-5aff-4b79-ada1-e8c75daee020 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:53:04.049866 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3d9eb604-5aff-4b79-ada1-e8c75daee020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:53:04.059463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:53:04.209397 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2126bc-6246-421f-9a2b-244ffa2f0db8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:53:04.227901 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2126bc-6246-421f-9a2b-244ffa2f0db8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:53:04.234841 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f5b35-04de-456b-9987-39e0829ecf7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:53:04.235492 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f5b35-04de-456b-9987-39e0829ecf7b service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:04.235746 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f5b35-04de-456b-9987-39e0829ecf7b service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:04.236020 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f5b35-04de-456b-9987-39e0829ecf7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:04.244235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f5b35-04de-456b-9987-39e0829ecf7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:53:04.245827 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f5b35-04de-456b-9987-39e0829ecf7b service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:53:04.255124 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 757/1524] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:53:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:53:05.236559 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32daa353-f364-47e4-8976-b964065dc664 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:05.237467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32daa353-f364-47e4-8976-b964065dc664 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:05.237467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32daa353-f364-47e4-8976-b964065dc664 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:05.239081 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 768/1525] 10.222.0.77 () {54 vars in 960 bytes} [Wed May 11 06:53:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:53:05.244245 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e45820-8af3-4683-b1dc-0133c2e1d2d9 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:05.244721 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e45820-8af3-4683-b1dc-0133c2e1d2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:05.244820 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e45820-8af3-4683-b1dc-0133c2e1d2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:05.265568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b1e45820-8af3-4683-b1dc-0133c2e1d2d9 None None] MFA Rules not processed for user `d46e2703839e498da8f3e2c3fda1d61c`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:53:05.266783 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b1e45820-8af3-4683-b1dc-0133c2e1d2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:53:05.278236 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 758/1526] 10.222.0.77 () {58 vars in 1057 bytes} [Wed May 11 06:53:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:53:05.289464 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32daa353-f364-47e4-8976-b964065dc664 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:53:05.306742 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32daa353-f364-47e4-8976-b964065dc664 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:53:05.313511 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c258620-31b8-4def-aee7-bb6c0b91f038 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46e2703839e498da8f3e2c3fda1d61c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:53:05.314168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c258620-31b8-4def-aee7-bb6c0b91f038 service placement] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:05.314445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c258620-31b8-4def-aee7-bb6c0b91f038 service placement] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:05.314723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c258620-31b8-4def-aee7-bb6c0b91f038 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:05.324060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c258620-31b8-4def-aee7-bb6c0b91f038 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:53:05.325659 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c258620-31b8-4def-aee7-bb6c0b91f038 service placement] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:53:05.336532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 769/1527] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:53:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:53:15.589914 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faea27b-443a-439e-a248-4df0948e4d1d None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:15.591035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faea27b-443a-439e-a248-4df0948e4d1d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:15.591035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faea27b-443a-439e-a248-4df0948e4d1d None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:15.592870 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:53:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:53:15.597967 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16664e0b-86d5-45f7-a642-55a3458e0676 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:15.598501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16664e0b-86d5-45f7-a642-55a3458e0676 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:15.598612 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16664e0b-86d5-45f7-a642-55a3458e0676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:15.617445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-16664e0b-86d5-45f7-a642-55a3458e0676 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:53:15.618632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-16664e0b-86d5-45f7-a642-55a3458e0676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:53:15.627642 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:53:15.780876 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faea27b-443a-439e-a248-4df0948e4d1d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:53:15.797828 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faea27b-443a-439e-a248-4df0948e4d1d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:53:15.804532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ece22-f3cc-4d55-8bd1-d692d79fb87b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:53:15.805167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ece22-f3cc-4d55-8bd1-d692d79fb87b service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:15.805449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ece22-f3cc-4d55-8bd1-d692d79fb87b service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:15.805724 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ece22-f3cc-4d55-8bd1-d692d79fb87b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:15.814574 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ece22-f3cc-4d55-8bd1-d692d79fb87b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:53:15.816228 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ece22-f3cc-4d55-8bd1-d692d79fb87b service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:53:15.825767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 760/1530] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:53:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:53:16.726396 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7ecca-4a0d-40f6-9046-ad4b88978468 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:16.727105 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7ecca-4a0d-40f6-9046-ad4b88978468 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:16.727105 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7ecca-4a0d-40f6-9046-ad4b88978468 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:16.728344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:53:16.734254 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc99f8-7ea9-44a2-94b9-8def6f6b48bd None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:16.735014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc99f8-7ea9-44a2-94b9-8def6f6b48bd None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:16.735127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc99f8-7ea9-44a2-94b9-8def6f6b48bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:16.756505 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e3fc99f8-7ea9-44a2-94b9-8def6f6b48bd None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:53:16.757698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e3fc99f8-7ea9-44a2-94b9-8def6f6b48bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:53:16.765995 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:53:16.916470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7ecca-4a0d-40f6-9046-ad4b88978468 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:53:16.943046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7ecca-4a0d-40f6-9046-ad4b88978468 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:53:16.950002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b6d70-8b07-4f00-9df3-39a6ca5059a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:53:16.950641 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b6d70-8b07-4f00-9df3-39a6ca5059a1 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:16.950917 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b6d70-8b07-4f00-9df3-39a6ca5059a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:16.951233 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b6d70-8b07-4f00-9df3-39a6ca5059a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:16.960051 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b6d70-8b07-4f00-9df3-39a6ca5059a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:53:16.961629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b6d70-8b07-4f00-9df3-39a6ca5059a1 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:53:16.971114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 772/1533] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:53:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:53:21.163732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bab3b-d7d3-4ba3-8781-0d920ae56924 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:21.164650 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bab3b-d7d3-4ba3-8781-0d920ae56924 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:21.164650 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bab3b-d7d3-4ba3-8781-0d920ae56924 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:21.166830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:53:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:53:21.175563 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed177a2-aaeb-4025-81b7-168b1722dbcd None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:21.176001 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed177a2-aaeb-4025-81b7-168b1722dbcd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:21.176112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed177a2-aaeb-4025-81b7-168b1722dbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:21.196598 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-eed177a2-aaeb-4025-81b7-168b1722dbcd None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:53:21.197800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-eed177a2-aaeb-4025-81b7-168b1722dbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:53:21.206655 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:53:21.243087 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bab3b-d7d3-4ba3-8781-0d920ae56924 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:53:21.245661 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-801bab3b-d7d3-4ba3-8781-0d920ae56924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:53:21.310475 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bab3b-d7d3-4ba3-8781-0d920ae56924 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:53:21.315080 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ce9c3-5d45-46a0-ae78-4c56f35bc288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:53:21.315736 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ce9c3-5d45-46a0-ae78-4c56f35bc288 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:21.316011 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ce9c3-5d45-46a0-ae78-4c56f35bc288 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:21.316283 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ce9c3-5d45-46a0-ae78-4c56f35bc288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:21.326082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ce9c3-5d45-46a0-ae78-4c56f35bc288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:53:21.327571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ce9c3-5d45-46a0-ae78-4c56f35bc288 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:53:21.337190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 763/1536] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:53:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:53:23.538512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2a416-bac6-4fba-994d-4170aa1d8031 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:23.539466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2a416-bac6-4fba-994d-4170aa1d8031 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:23.539466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2a416-bac6-4fba-994d-4170aa1d8031 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:23.541830 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:53:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:53:23.547420 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce061a-2ceb-4347-b8a7-99c9c450501c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:23.547870 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce061a-2ceb-4347-b8a7-99c9c450501c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:23.547870 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce061a-2ceb-4347-b8a7-99c9c450501c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:23.567510 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c9ce061a-2ceb-4347-b8a7-99c9c450501c None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:53:23.568730 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c9ce061a-2ceb-4347-b8a7-99c9c450501c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:53:23.577067 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:53:23.613583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2a416-bac6-4fba-994d-4170aa1d8031 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:53:23.631070 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2a416-bac6-4fba-994d-4170aa1d8031 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:53:23.635165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facebac-ce11-4e4f-bf9d-04750fe97ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:53:23.635821 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facebac-ce11-4e4f-bf9d-04750fe97ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:23.636099 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facebac-ce11-4e4f-bf9d-04750fe97ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:23.636369 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facebac-ce11-4e4f-bf9d-04750fe97ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:23.646114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facebac-ce11-4e4f-bf9d-04750fe97ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:53:23.647617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facebac-ce11-4e4f-bf9d-04750fe97ae4 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:53:23.656650 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 775/1539] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:53:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:53:27.418071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d3c04-6312-466f-b08f-9681c41bfe2f None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:27.418612 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d3c04-6312-466f-b08f-9681c41bfe2f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:27.418612 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d3c04-6312-466f-b08f-9681c41bfe2f None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:27.420723 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 765/1540] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:53:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:53:27.426306 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3fbbb-b86b-49f8-a63b-ac0a429488d3 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:27.426779 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3fbbb-b86b-49f8-a63b-ac0a429488d3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:27.426875 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3fbbb-b86b-49f8-a63b-ac0a429488d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:27.447250 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-57e3fbbb-b86b-49f8-a63b-ac0a429488d3 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:53:27.448439 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-57e3fbbb-b86b-49f8-a63b-ac0a429488d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:53:27.457105 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 776/1541] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:53:27.726073 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d3c04-6312-466f-b08f-9681c41bfe2f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:53:27.728331 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4b3d3c04-6312-466f-b08f-9681c41bfe2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:53:27.792739 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d3c04-6312-466f-b08f-9681c41bfe2f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:53:27.797349 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75324d-e674-48c7-8b23-7fd9e80966bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:53:27.798003 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75324d-e674-48c7-8b23-7fd9e80966bf service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:27.798280 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75324d-e674-48c7-8b23-7fd9e80966bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:27.798551 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75324d-e674-48c7-8b23-7fd9e80966bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:27.808176 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75324d-e674-48c7-8b23-7fd9e80966bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:53:27.809951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75324d-e674-48c7-8b23-7fd9e80966bf service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:53:27.819235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 766/1542] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:53:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:53:30.092331 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb3694-f3a6-44a8-bde6-d545058b2a25 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:30.093203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb3694-f3a6-44a8-bde6-d545058b2a25 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:30.093203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb3694-f3a6-44a8-bde6-d545058b2a25 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:30.095487 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 777/1543] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:53:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:53:30.104266 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035f53d-1c60-4dfd-b901-5163c1a0c73d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:30.104720 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035f53d-1c60-4dfd-b901-5163c1a0c73d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:30.104816 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035f53d-1c60-4dfd-b901-5163c1a0c73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:30.128202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a035f53d-1c60-4dfd-b901-5163c1a0c73d None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:53:30.129402 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a035f53d-1c60-4dfd-b901-5163c1a0c73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:53:30.137093 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 767/1544] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:53:30.405900 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb3694-f3a6-44a8-bde6-d545058b2a25 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:53:30.407990 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d3bb3694-f3a6-44a8-bde6-d545058b2a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:53:30.429475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb3694-f3a6-44a8-bde6-d545058b2a25 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:53:30.437072 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843cc9e-ed77-4f82-a2ba-c848bd67b94b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:53:30.438040 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843cc9e-ed77-4f82-a2ba-c848bd67b94b service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:30.438447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843cc9e-ed77-4f82-a2ba-c848bd67b94b service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:30.438841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843cc9e-ed77-4f82-a2ba-c848bd67b94b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:30.452817 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843cc9e-ed77-4f82-a2ba-c848bd67b94b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:53:30.454815 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843cc9e-ed77-4f82-a2ba-c848bd67b94b service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:53:30.469419 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 778/1545] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:53:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:02.397309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303adaf-3fb2-4434-a5da-af5f33e1b670 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:02.398005 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303adaf-3fb2-4434-a5da-af5f33e1b670 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:02.398005 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303adaf-3fb2-4434-a5da-af5f33e1b670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:02.430614 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e303adaf-3fb2-4434-a5da-af5f33e1b670 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:02.432226 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e303adaf-3fb2-4434-a5da-af5f33e1b670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:02.443530 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 768/1546] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:02.453424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44212cb3-d96d-482a-9ad2-306d04dd4591 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:02.454025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44212cb3-d96d-482a-9ad2-306d04dd4591 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:02.454025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44212cb3-d96d-482a-9ad2-306d04dd4591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:02.485052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-44212cb3-d96d-482a-9ad2-306d04dd4591 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:02.486306 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-44212cb3-d96d-482a-9ad2-306d04dd4591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:02.495145 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 779/1547] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:02.499730 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303adaf-3fb2-4434-a5da-af5f33e1b670 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:02.512976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303adaf-3fb2-4434-a5da-af5f33e1b670 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:02.522749 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29aa4da-ae53-47a8-a334-fb8340e80ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:02.523466 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29aa4da-ae53-47a8-a334-fb8340e80ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:02.523742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29aa4da-ae53-47a8-a334-fb8340e80ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:02.524009 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29aa4da-ae53-47a8-a334-fb8340e80ff9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:02.524757 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29aa4da-ae53-47a8-a334-fb8340e80ff9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:55:02.525056 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29aa4da-ae53-47a8-a334-fb8340e80ff9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:02.526089 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: WARNING py.warnings [None req-a29aa4da-ae53-47a8-a334-fb8340e80ff9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 06:55:02.526089 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: warnings.warn(msg) May 11 06:55:02.526089 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: May 11 06:55:02.527204 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29aa4da-ae53-47a8-a334-fb8340e80ff9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:02.547549 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 769/1548] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:55:02.556395 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44212cb3-d96d-482a-9ad2-306d04dd4591 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:02.576797 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44212cb3-d96d-482a-9ad2-306d04dd4591 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:02.584868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c88bc1-2764-4304-b8ab-4aec825e74f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:02.585855 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c88bc1-2764-4304-b8ab-4aec825e74f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:02.586307 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c88bc1-2764-4304-b8ab-4aec825e74f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:02.586760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c88bc1-2764-4304-b8ab-4aec825e74f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:02.587798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c88bc1-2764-4304-b8ab-4aec825e74f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:02.589004 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: WARNING py.warnings [None req-b1c88bc1-2764-4304-b8ab-4aec825e74f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 06:55:02.589004 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: warnings.warn(msg) May 11 06:55:02.589004 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: May 11 06:55:02.590555 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c88bc1-2764-4304-b8ab-4aec825e74f1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:02.634469 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 780/1549] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:02 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:02.639310 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29aa4da-ae53-47a8-a334-fb8340e80ff9 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:02.663140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29aa4da-ae53-47a8-a334-fb8340e80ff9 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:02.684451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d71a7-145d-4582-9fb5-c381d4147d92 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:02.684989 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d71a7-145d-4582-9fb5-c381d4147d92 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:02.685450 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d71a7-145d-4582-9fb5-c381d4147d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:02.711991 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-983d71a7-145d-4582-9fb5-c381d4147d92 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:02.713874 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-983d71a7-145d-4582-9fb5-c381d4147d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:02.749912 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfaa57-b872-4917-87fc-be0546e4cdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:02.750850 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfaa57-b872-4917-87fc-be0546e4cdc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:02.751122 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfaa57-b872-4917-87fc-be0546e4cdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:02.751647 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfaa57-b872-4917-87fc-be0546e4cdc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:02.752474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfaa57-b872-4917-87fc-be0546e4cdc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:02.753638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: WARNING py.warnings [None req-b5dfaa57-b872-4917-87fc-be0546e4cdc1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 06:55:02.753638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: warnings.warn(msg) May 11 06:55:02.753638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: May 11 06:55:02.755170 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfaa57-b872-4917-87fc-be0546e4cdc1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:02.788085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 770/1550] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:02 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:02.789529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb735a-0d78-41f8-9f0a-1ba4b56fb48e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:02.791702 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb735a-0d78-41f8-9f0a-1ba4b56fb48e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:02.792579 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb735a-0d78-41f8-9f0a-1ba4b56fb48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:02.821626 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 781/1551] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:55:02.823153 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b060f1a-fb27-427c-b233-02e0d9339670 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:02.824005 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b060f1a-fb27-427c-b233-02e0d9339670 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:02.824289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b060f1a-fb27-427c-b233-02e0d9339670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:02.832665 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-bbcb735a-0d78-41f8-9f0a-1ba4b56fb48e None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:02.834771 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bbcb735a-0d78-41f8-9f0a-1ba4b56fb48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:02.854144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 771/1552] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:02.855075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb735a-0d78-41f8-9f0a-1ba4b56fb48e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:02.857254 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5b060f1a-fb27-427c-b233-02e0d9339670 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:02.858675 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5b060f1a-fb27-427c-b233-02e0d9339670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:02.872468 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb735a-0d78-41f8-9f0a-1ba4b56fb48e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:02.875585 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 782/1553] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:02.877205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c220b62-c6fe-4e42-bb19-75e8c4b296fc None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:02.877491 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c220b62-c6fe-4e42-bb19-75e8c4b296fc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:02.877676 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bb9f6-3d5d-4622-85f0-4b94148901d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:02.877815 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c220b62-c6fe-4e42-bb19-75e8c4b296fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:02.878339 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bb9f6-3d5d-4622-85f0-4b94148901d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:02.878997 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bb9f6-3d5d-4622-85f0-4b94148901d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:02.879284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bb9f6-3d5d-4622-85f0-4b94148901d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:02.880005 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bb9f6-3d5d-4622-85f0-4b94148901d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:02.881686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bb9f6-3d5d-4622-85f0-4b94148901d0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:02.898311 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 772/1554] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:02.899717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab486b8-9ad4-472c-bdbc-190d0976a56d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:02.900007 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab486b8-9ad4-472c-bdbc-190d0976a56d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:02.900281 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab486b8-9ad4-472c-bdbc-190d0976a56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:02.910143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9c220b62-c6fe-4e42-bb19-75e8c4b296fc None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:02.911451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9c220b62-c6fe-4e42-bb19-75e8c4b296fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:02.919948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7ab486b8-9ad4-472c-bdbc-190d0976a56d None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:02.921803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7ab486b8-9ad4-472c-bdbc-190d0976a56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:02.928605 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 783/1555] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:02.930678 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e36b2-e1e8-4c1d-9b1d-ccee42d0a11b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:02.930992 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e36b2-e1e8-4c1d-9b1d-ccee42d0a11b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:02.931277 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e36b2-e1e8-4c1d-9b1d-ccee42d0a11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:02.932550 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 773/1556] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:02.934133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb61139-3481-4ced-804b-f33818eb7772 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:02.934656 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb61139-3481-4ced-804b-f33818eb7772 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:02.935259 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb61139-3481-4ced-804b-f33818eb7772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:02.950346 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-068e36b2-e1e8-4c1d-9b1d-ccee42d0a11b None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:02.951565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-068e36b2-e1e8-4c1d-9b1d-ccee42d0a11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:02.952373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3cb61139-3481-4ced-804b-f33818eb7772 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:02.953533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3cb61139-3481-4ced-804b-f33818eb7772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:02.959322 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 784/1557] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:02.960515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb14691-a3ac-4c6c-92ef-a4bae7f92546 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:02.960797 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb14691-a3ac-4c6c-92ef-a4bae7f92546 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:02.961067 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb14691-a3ac-4c6c-92ef-a4bae7f92546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:02.961192 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 774/1558] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:02.961904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb61139-3481-4ced-804b-f33818eb7772 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:02.973432 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb61139-3481-4ced-804b-f33818eb7772 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:02.977924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20eca61-b581-40f0-93d1-6d52d96e32b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:02.978586 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20eca61-b581-40f0-93d1-6d52d96e32b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:02.978866 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20eca61-b581-40f0-93d1-6d52d96e32b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:02.979169 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20eca61-b581-40f0-93d1-6d52d96e32b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:02.979366 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1eb14691-a3ac-4c6c-92ef-a4bae7f92546 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:02.979892 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20eca61-b581-40f0-93d1-6d52d96e32b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:02.980540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1eb14691-a3ac-4c6c-92ef-a4bae7f92546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:02.981608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20eca61-b581-40f0-93d1-6d52d96e32b7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:02.988482 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 785/1559] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:02.989678 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf76a7f-3d59-46fd-beef-87c222f0cd99 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:02.989963 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf76a7f-3d59-46fd-beef-87c222f0cd99 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:02.990238 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf76a7f-3d59-46fd-beef-87c222f0cd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:02.992777 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 775/1560] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:02.994191 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f0b0a-e7e6-4580-aed6-fc328cb6f90d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:02.994479 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f0b0a-e7e6-4580-aed6-fc328cb6f90d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:02.994753 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f0b0a-e7e6-4580-aed6-fc328cb6f90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.008170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-adf76a7f-3d59-46fd-beef-87c222f0cd99 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:03.009369 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-adf76a7f-3d59-46fd-beef-87c222f0cd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:03.012739 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-337f0b0a-e7e6-4580-aed6-fc328cb6f90d None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:03.013891 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-337f0b0a-e7e6-4580-aed6-fc328cb6f90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:03.017879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 786/1561] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:03.018673 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf76a7f-3d59-46fd-beef-87c222f0cd99 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.027015 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 776/1562] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:03.027015 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538e43c-bc28-4835-b2f1-67c5c419c932 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.027015 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538e43c-bc28-4835-b2f1-67c5c419c932 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.027015 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538e43c-bc28-4835-b2f1-67c5c419c932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.029016 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf76a7f-3d59-46fd-beef-87c222f0cd99 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.034306 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60dd6f2-645d-48cd-a5f8-88433ed2028d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.034996 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dd6f2-645d-48cd-a5f8-88433ed2028d admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.035279 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dd6f2-645d-48cd-a5f8-88433ed2028d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.035548 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dd6f2-645d-48cd-a5f8-88433ed2028d admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.036294 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60dd6f2-645d-48cd-a5f8-88433ed2028d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:55:03.036572 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60dd6f2-645d-48cd-a5f8-88433ed2028d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.038305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60dd6f2-645d-48cd-a5f8-88433ed2028d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.043458 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b538e43c-bc28-4835-b2f1-67c5c419c932 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:03.044652 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b538e43c-bc28-4835-b2f1-67c5c419c932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:03.049928 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 787/1563] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:55:03.051252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8d911-8dae-4823-b88d-8c6c8912e692 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.051532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8d911-8dae-4823-b88d-8c6c8912e692 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.051804 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8d911-8dae-4823-b88d-8c6c8912e692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.059125 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 777/1564] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:03.059903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538e43c-bc28-4835-b2f1-67c5c419c932 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.069526 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538e43c-bc28-4835-b2f1-67c5c419c932 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.071276 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-dee8d911-8dae-4823-b88d-8c6c8912e692 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:03.072547 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-dee8d911-8dae-4823-b88d-8c6c8912e692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:03.074201 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31e438-de1a-4db6-ba71-bb9983a8abc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.074851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31e438-de1a-4db6-ba71-bb9983a8abc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.075188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31e438-de1a-4db6-ba71-bb9983a8abc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.075463 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31e438-de1a-4db6-ba71-bb9983a8abc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.076199 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31e438-de1a-4db6-ba71-bb9983a8abc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:55:03.076504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31e438-de1a-4db6-ba71-bb9983a8abc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.078130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31e438-de1a-4db6-ba71-bb9983a8abc2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.080636 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 788/1565] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:03.081136 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8d911-8dae-4823-b88d-8c6c8912e692 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.089583 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 778/1566] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:55:03.090241 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8d911-8dae-4823-b88d-8c6c8912e692 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.090400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31e438-de1a-4db6-ba71-bb9983a8abc2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.094679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86954c-7d3c-4a08-9011-c0f2967eef8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.095398 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86954c-7d3c-4a08-9011-c0f2967eef8c admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.095676 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86954c-7d3c-4a08-9011-c0f2967eef8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.095950 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86954c-7d3c-4a08-9011-c0f2967eef8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.096719 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86954c-7d3c-4a08-9011-c0f2967eef8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:55:03.097018 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86954c-7d3c-4a08-9011-c0f2967eef8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.098644 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86954c-7d3c-4a08-9011-c0f2967eef8c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.100098 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31e438-de1a-4db6-ba71-bb9983a8abc2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.104782 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e93e6-3c2e-424d-9979-932db12a4920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.105643 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e93e6-3c2e-424d-9979-932db12a4920 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.105931 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e93e6-3c2e-424d-9979-932db12a4920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.106193 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e93e6-3c2e-424d-9979-932db12a4920 admin admin] PATH_INFO: `/v3/projects/bc566f812503445085c9adfb27278276/users/949668a1b2e440e8853cc7006a9142ff/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.110520 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 789/1567] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:55:03.111761 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d59b4-5f5f-40b4-9a48-9fcb634be47f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.112037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d59b4-5f5f-40b4-9a48-9fcb634be47f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.112429 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d59b4-5f5f-40b4-9a48-9fcb634be47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.120719 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e93e6-3c2e-424d-9979-932db12a4920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc566f812503445085c9adfb27278276, user_id=949668a1b2e440e8853cc7006a9142ff, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.123463 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e93e6-3c2e-424d-9979-932db12a4920 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.131164 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-469d59b4-5f5f-40b4-9a48-9fcb634be47f None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:03.132367 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-469d59b4-5f5f-40b4-9a48-9fcb634be47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:03.137243 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 779/1568] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:03 2022] PUT /identity/v3/projects/bc566f812503445085c9adfb27278276/users/949668a1b2e440e8853cc7006a9142ff/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:03.138286 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f09df-e66c-4c84-be9d-f185dae03b1e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.138568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f09df-e66c-4c84-be9d-f185dae03b1e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.138874 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f09df-e66c-4c84-be9d-f185dae03b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.156354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a74f09df-e66c-4c84-be9d-f185dae03b1e None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:03.157550 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a74f09df-e66c-4c84-be9d-f185dae03b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:03.191809 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 790/1569] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:03.192869 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d59b4-5f5f-40b4-9a48-9fcb634be47f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.203818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d59b4-5f5f-40b4-9a48-9fcb634be47f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.208340 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b359c42-120c-4bf7-8adb-b29d6fc1a5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.209075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b359c42-120c-4bf7-8adb-b29d6fc1a5fb admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.209340 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b359c42-120c-4bf7-8adb-b29d6fc1a5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.209641 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b359c42-120c-4bf7-8adb-b29d6fc1a5fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.210329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b359c42-120c-4bf7-8adb-b29d6fc1a5fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.212392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b359c42-120c-4bf7-8adb-b29d6fc1a5fb admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.213756 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 780/1570] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:03.214627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f09df-e66c-4c84-be9d-f185dae03b1e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.223655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f09df-e66c-4c84-be9d-f185dae03b1e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.228736 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca3317-06b1-4152-8c31-48601bb9773d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.229638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca3317-06b1-4152-8c31-48601bb9773d admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.229923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca3317-06b1-4152-8c31-48601bb9773d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.230211 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca3317-06b1-4152-8c31-48601bb9773d admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.231199 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca3317-06b1-4152-8c31-48601bb9773d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:55:03.231609 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca3317-06b1-4152-8c31-48601bb9773d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.233215 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca3317-06b1-4152-8c31-48601bb9773d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.238048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 791/1571] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:03 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:03.242342 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b359c42-120c-4bf7-8adb-b29d6fc1a5fb admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.244752 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 781/1572] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:55:03.245514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca3317-06b1-4152-8c31-48601bb9773d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.254978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca3317-06b1-4152-8c31-48601bb9773d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.311622 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b359c42-120c-4bf7-8adb-b29d6fc1a5fb admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.312218 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4128ad-08b1-4bfd-8bf9-abb21732f3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.312889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4128ad-08b1-4bfd-8bf9-abb21732f3c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.313175 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4128ad-08b1-4bfd-8bf9-abb21732f3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.313450 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4128ad-08b1-4bfd-8bf9-abb21732f3c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.314141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4128ad-08b1-4bfd-8bf9-abb21732f3c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.316133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4128ad-08b1-4bfd-8bf9-abb21732f3c9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.316322 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd3408-0158-4f61-8300-1a7b688981f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.316981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd3408-0158-4f61-8300-1a7b688981f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.317259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd3408-0158-4f61-8300-1a7b688981f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.317532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd3408-0158-4f61-8300-1a7b688981f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.318254 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd3408-0158-4f61-8300-1a7b688981f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:55:03.318556 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd3408-0158-4f61-8300-1a7b688981f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.320310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd3408-0158-4f61-8300-1a7b688981f2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.331796 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 792/1573] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:55:03.332548 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd3408-0158-4f61-8300-1a7b688981f2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.342303 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd3408-0158-4f61-8300-1a7b688981f2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.347065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c13b28-464f-489e-8254-5326fbc00ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.347687 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c13b28-464f-489e-8254-5326fbc00ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.347964 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c13b28-464f-489e-8254-5326fbc00ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.348232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c13b28-464f-489e-8254-5326fbc00ef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.348908 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c13b28-464f-489e-8254-5326fbc00ef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.350814 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c13b28-464f-489e-8254-5326fbc00ef5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.351580 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 782/1574] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:03 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:03.352948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6736f80-4cf6-4c53-a65f-c6e64597a549 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.353243 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6736f80-4cf6-4c53-a65f-c6e64597a549 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.353506 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6736f80-4cf6-4c53-a65f-c6e64597a549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.380798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 793/1575] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:03 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:03.380798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c13b28-464f-489e-8254-5326fbc00ef5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.381110 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b6736f80-4cf6-4c53-a65f-c6e64597a549 None None] MFA Rules not processed for user `949668a1b2e440e8853cc7006a9142ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:03.381110 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b6736f80-4cf6-4c53-a65f-c6e64597a549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:03.439505 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c13b28-464f-489e-8254-5326fbc00ef5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.444494 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3d440-0c86-4fc8-b97e-143a40251eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.445194 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3d440-0c86-4fc8-b97e-143a40251eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.445479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3d440-0c86-4fc8-b97e-143a40251eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.445754 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3d440-0c86-4fc8-b97e-143a40251eb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.446517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3d440-0c86-4fc8-b97e-143a40251eb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:55:03.446825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3d440-0c86-4fc8-b97e-143a40251eb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.447282 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 783/1576] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:03.448114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6736f80-4cf6-4c53-a65f-c6e64597a549 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.448748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3d440-0c86-4fc8-b97e-143a40251eb0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.457876 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6736f80-4cf6-4c53-a65f-c6e64597a549 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.460673 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 794/1577] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:55:03.461364 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3d440-0c86-4fc8-b97e-143a40251eb0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.462698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631c9af-76ff-43c8-be02-d0d9d7459b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.463374 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631c9af-76ff-43c8-be02-d0d9d7459b7f admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.463656 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631c9af-76ff-43c8-be02-d0d9d7459b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.463929 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631c9af-76ff-43c8-be02-d0d9d7459b7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.464647 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631c9af-76ff-43c8-be02-d0d9d7459b7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:55:03.464950 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631c9af-76ff-43c8-be02-d0d9d7459b7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.466536 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631c9af-76ff-43c8-be02-d0d9d7459b7f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.471338 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3d440-0c86-4fc8-b97e-143a40251eb0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.476022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac784b53-92f0-413e-bf74-4ffe6a158d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.476692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac784b53-92f0-413e-bf74-4ffe6a158d26 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.476979 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac784b53-92f0-413e-bf74-4ffe6a158d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.477255 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac784b53-92f0-413e-bf74-4ffe6a158d26 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.477958 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac784b53-92f0-413e-bf74-4ffe6a158d26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.478225 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 784/1578] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:55:03.479087 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631c9af-76ff-43c8-be02-d0d9d7459b7f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.479941 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac784b53-92f0-413e-bf74-4ffe6a158d26 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.488414 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631c9af-76ff-43c8-be02-d0d9d7459b7f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.494045 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca873195-4bbb-459d-9f1c-c6d1baa03a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.494739 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca873195-4bbb-459d-9f1c-c6d1baa03a8f admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.495044 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca873195-4bbb-459d-9f1c-c6d1baa03a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.495317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca873195-4bbb-459d-9f1c-c6d1baa03a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.496034 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca873195-4bbb-459d-9f1c-c6d1baa03a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.498237 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca873195-4bbb-459d-9f1c-c6d1baa03a8f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.504721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 795/1579] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:03 2022] POST /identity/v3/users => generated 292 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:03.504721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac784b53-92f0-413e-bf74-4ffe6a158d26 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.512997 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac784b53-92f0-413e-bf74-4ffe6a158d26 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.519080 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7c482-51fe-4796-923d-f76cf822988d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.519733 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7c482-51fe-4796-923d-f76cf822988d admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.520008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7c482-51fe-4796-923d-f76cf822988d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.520352 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7c482-51fe-4796-923d-f76cf822988d admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.521276 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7c482-51fe-4796-923d-f76cf822988d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.523263 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7c482-51fe-4796-923d-f76cf822988d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.530022 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 785/1580] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:03 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:03.530022 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca873195-4bbb-459d-9f1c-c6d1baa03a8f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.551947 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 796/1581] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:03 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:03.552734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7c482-51fe-4796-923d-f76cf822988d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.589773 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca873195-4bbb-459d-9f1c-c6d1baa03a8f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.611594 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7c482-51fe-4796-923d-f76cf822988d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.616315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f56e5-e668-4612-a672-5d77cce22697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.616999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f56e5-e668-4612-a672-5d77cce22697 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.617376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f56e5-e668-4612-a672-5d77cce22697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.617595 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f56e5-e668-4612-a672-5d77cce22697 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.618321 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f56e5-e668-4612-a672-5d77cce22697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.620382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f56e5-e668-4612-a672-5d77cce22697 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.644220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 797/1582] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:03 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:03.644220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f56e5-e668-4612-a672-5d77cce22697 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.648422 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d44d5e-1055-4b33-b73e-3b81a887f39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.649098 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d44d5e-1055-4b33-b73e-3b81a887f39f admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.649443 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d44d5e-1055-4b33-b73e-3b81a887f39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.649750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d44d5e-1055-4b33-b73e-3b81a887f39f admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.650516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d44d5e-1055-4b33-b73e-3b81a887f39f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.652417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d44d5e-1055-4b33-b73e-3b81a887f39f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.653308 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f56e5-e668-4612-a672-5d77cce22697 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.659256 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709b833-327f-432f-a7f2-290cce82c7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.659907 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709b833-327f-432f-a7f2-290cce82c7fb admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.660320 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709b833-327f-432f-a7f2-290cce82c7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.660617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709b833-327f-432f-a7f2-290cce82c7fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.661536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709b833-327f-432f-a7f2-290cce82c7fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.664079 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709b833-327f-432f-a7f2-290cce82c7fb admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.675521 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 786/1583] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:03 2022] POST /identity/v3/users => generated 285 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:03.676472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d44d5e-1055-4b33-b73e-3b81a887f39f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.688474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d44d5e-1055-4b33-b73e-3b81a887f39f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.693726 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ca515-4af1-4b7a-be68-95f6d7fbd43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.694464 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ca515-4af1-4b7a-be68-95f6d7fbd43c admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.694682 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ca515-4af1-4b7a-be68-95f6d7fbd43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.694946 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ca515-4af1-4b7a-be68-95f6d7fbd43c admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.695686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ca515-4af1-4b7a-be68-95f6d7fbd43c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.697147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 798/1584] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:03 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:03.697594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ca515-4af1-4b7a-be68-95f6d7fbd43c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.697940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709b833-327f-432f-a7f2-290cce82c7fb admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.724146 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 787/1585] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:03 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:03.728214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ca515-4af1-4b7a-be68-95f6d7fbd43c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.766468 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709b833-327f-432f-a7f2-290cce82c7fb admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.788513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ca515-4af1-4b7a-be68-95f6d7fbd43c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.793048 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d693c-2d07-4b28-a7b6-b205ce6fa864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.793714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d693c-2d07-4b28-a7b6-b205ce6fa864 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.793993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d693c-2d07-4b28-a7b6-b205ce6fa864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.794263 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d693c-2d07-4b28-a7b6-b205ce6fa864 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.795005 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d693c-2d07-4b28-a7b6-b205ce6fa864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.796666 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d693c-2d07-4b28-a7b6-b205ce6fa864 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.806202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 788/1586] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:03.807303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d693c-2d07-4b28-a7b6-b205ce6fa864 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.817386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d693c-2d07-4b28-a7b6-b205ce6fa864 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.822007 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853b235-8d5b-4a69-89cb-6697789b3500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.822713 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853b235-8d5b-4a69-89cb-6697789b3500 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.823022 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853b235-8d5b-4a69-89cb-6697789b3500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.823303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853b235-8d5b-4a69-89cb-6697789b3500 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.823548 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b42c6-17f6-4071-8e1e-17c3a1fa5357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.823993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853b235-8d5b-4a69-89cb-6697789b3500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.824226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b42c6-17f6-4071-8e1e-17c3a1fa5357 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.824501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b42c6-17f6-4071-8e1e-17c3a1fa5357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.824765 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b42c6-17f6-4071-8e1e-17c3a1fa5357 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.825464 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b42c6-17f6-4071-8e1e-17c3a1fa5357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.825960 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853b235-8d5b-4a69-89cb-6697789b3500 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.827396 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b42c6-17f6-4071-8e1e-17c3a1fa5357 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.847122 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 789/1587] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:03 2022] POST /identity/v3/users => generated 290 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:03.847919 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853b235-8d5b-4a69-89cb-6697789b3500 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.852193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 799/1588] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:03 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:03.853002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b42c6-17f6-4071-8e1e-17c3a1fa5357 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.857318 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853b235-8d5b-4a69-89cb-6697789b3500 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.909649 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65406a40-d550-4072-8016-70c4fe782970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.910460 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65406a40-d550-4072-8016-70c4fe782970 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.910748 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65406a40-d550-4072-8016-70c4fe782970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.910942 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b42c6-17f6-4071-8e1e-17c3a1fa5357 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.911090 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65406a40-d550-4072-8016-70c4fe782970 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.911766 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65406a40-d550-4072-8016-70c4fe782970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.913875 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65406a40-d550-4072-8016-70c4fe782970 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.915565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcda48-a43b-47f7-947a-8ed6a5d6a21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.916284 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcda48-a43b-47f7-947a-8ed6a5d6a21a admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.916551 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcda48-a43b-47f7-947a-8ed6a5d6a21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.916831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcda48-a43b-47f7-947a-8ed6a5d6a21a admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.917572 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbcda48-a43b-47f7-947a-8ed6a5d6a21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.919225 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbcda48-a43b-47f7-947a-8ed6a5d6a21a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.929218 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 800/1589] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:03.932293 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcda48-a43b-47f7-947a-8ed6a5d6a21a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.942468 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 790/1590] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:03 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:03.942468 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65406a40-d550-4072-8016-70c4fe782970 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.945318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcda48-a43b-47f7-947a-8ed6a5d6a21a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.949692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65406a40-d550-4072-8016-70c4fe782970 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.949830 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce686cb-9432-458e-8b22-27b43dd0f9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.950472 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce686cb-9432-458e-8b22-27b43dd0f9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.950775 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce686cb-9432-458e-8b22-27b43dd0f9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.951088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce686cb-9432-458e-8b22-27b43dd0f9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.951833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce686cb-9432-458e-8b22-27b43dd0f9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.953418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce686cb-9432-458e-8b22-27b43dd0f9a8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.954256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229adaa-5782-4566-9553-4bb103bb3fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.954906 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229adaa-5782-4566-9553-4bb103bb3fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.955225 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229adaa-5782-4566-9553-4bb103bb3fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.955502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229adaa-5782-4566-9553-4bb103bb3fe2 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.956186 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229adaa-5782-4566-9553-4bb103bb3fe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.958135 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229adaa-5782-4566-9553-4bb103bb3fe2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.963743 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 801/1591] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:03.964335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce686cb-9432-458e-8b22-27b43dd0f9a8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.974752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce686cb-9432-458e-8b22-27b43dd0f9a8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.982370 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 791/1592] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:03 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:03.982521 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec89148-3305-4704-900b-745fee01fd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.982635 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229adaa-5782-4566-9553-4bb103bb3fe2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:03.982746 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec89148-3305-4704-900b-745fee01fd9d admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.982746 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec89148-3305-4704-900b-745fee01fd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.982746 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec89148-3305-4704-900b-745fee01fd9d admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:03.982746 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec89148-3305-4704-900b-745fee01fd9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:03.984101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec89148-3305-4704-900b-745fee01fd9d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:03.992800 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229adaa-5782-4566-9553-4bb103bb3fe2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:03.998051 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e03e5-973d-4cfa-b1a4-4c9b3b7b2e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:03.998715 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e03e5-973d-4cfa-b1a4-4c9b3b7b2e7f admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:03.999077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e03e5-973d-4cfa-b1a4-4c9b3b7b2e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:03.999369 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e03e5-973d-4cfa-b1a4-4c9b3b7b2e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.000090 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e03e5-973d-4cfa-b1a4-4c9b3b7b2e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.002360 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e03e5-973d-4cfa-b1a4-4c9b3b7b2e7f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.004891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 802/1593] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:03 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:04.008164 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec89148-3305-4704-900b-745fee01fd9d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.013271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 792/1594] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:04.014045 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e03e5-973d-4cfa-b1a4-4c9b3b7b2e7f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.015178 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec89148-3305-4704-900b-745fee01fd9d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.020220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bc181-2f2a-41ed-af24-8c016848db30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.020881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bc181-2f2a-41ed-af24-8c016848db30 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.021278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bc181-2f2a-41ed-af24-8c016848db30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.021591 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bc181-2f2a-41ed-af24-8c016848db30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.022320 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bc181-2f2a-41ed-af24-8c016848db30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.023228 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e03e5-973d-4cfa-b1a4-4c9b3b7b2e7f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.023951 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bc181-2f2a-41ed-af24-8c016848db30 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.027773 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac444b-e4aa-424a-9228-3ff5e26d8917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.028412 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac444b-e4aa-424a-9228-3ff5e26d8917 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.028694 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac444b-e4aa-424a-9228-3ff5e26d8917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.028973 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac444b-e4aa-424a-9228-3ff5e26d8917 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.029648 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac444b-e4aa-424a-9228-3ff5e26d8917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.031629 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac444b-e4aa-424a-9228-3ff5e26d8917 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.033874 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 803/1595] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:04.034720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bc181-2f2a-41ed-af24-8c016848db30 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.044375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bc181-2f2a-41ed-af24-8c016848db30 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.049818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5142ddb-00f5-46d1-8eeb-906636a8458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.050464 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5142ddb-00f5-46d1-8eeb-906636a8458c admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.050741 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5142ddb-00f5-46d1-8eeb-906636a8458c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.051041 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5142ddb-00f5-46d1-8eeb-906636a8458c admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.051782 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5142ddb-00f5-46d1-8eeb-906636a8458c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.053044 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 793/1596] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:04 2022] POST /identity/v3/users => generated 283 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:04.053503 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5142ddb-00f5-46d1-8eeb-906636a8458c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.053821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac444b-e4aa-424a-9228-3ff5e26d8917 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.067009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 804/1597] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:04.067009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5142ddb-00f5-46d1-8eeb-906636a8458c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.067284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac444b-e4aa-424a-9228-3ff5e26d8917 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.073779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfe241-3f9c-4475-908b-af3082e1feb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.073953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5142ddb-00f5-46d1-8eeb-906636a8458c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.074450 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfe241-3f9c-4475-908b-af3082e1feb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.074732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfe241-3f9c-4475-908b-af3082e1feb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.075040 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfe241-3f9c-4475-908b-af3082e1feb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.075763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cfe241-3f9c-4475-908b-af3082e1feb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.077523 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cfe241-3f9c-4475-908b-af3082e1feb4 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.078606 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89a891-d89b-4bd5-9f13-d946bfb547ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.079288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89a891-d89b-4bd5-9f13-d946bfb547ab admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.079564 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89a891-d89b-4bd5-9f13-d946bfb547ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.079842 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89a891-d89b-4bd5-9f13-d946bfb547ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.080549 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89a891-d89b-4bd5-9f13-d946bfb547ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.082134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89a891-d89b-4bd5-9f13-d946bfb547ab admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.087791 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 794/1598] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:04.088669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfe241-3f9c-4475-908b-af3082e1feb4 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.095143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 805/1599] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:04.095143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89a891-d89b-4bd5-9f13-d946bfb547ab admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.098526 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfe241-3f9c-4475-908b-af3082e1feb4 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.102823 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89a891-d89b-4bd5-9f13-d946bfb547ab admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.103224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49b38f-bb83-44e1-aad7-2d8a8c3f6518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.103873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49b38f-bb83-44e1-aad7-2d8a8c3f6518 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.104160 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49b38f-bb83-44e1-aad7-2d8a8c3f6518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.104436 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49b38f-bb83-44e1-aad7-2d8a8c3f6518 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.105132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49b38f-bb83-44e1-aad7-2d8a8c3f6518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.106717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49b38f-bb83-44e1-aad7-2d8a8c3f6518 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.107694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749c277-7ba6-41e4-9395-1f5e7be6d3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.108343 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749c277-7ba6-41e4-9395-1f5e7be6d3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.108648 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749c277-7ba6-41e4-9395-1f5e7be6d3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.108916 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749c277-7ba6-41e4-9395-1f5e7be6d3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.109631 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749c277-7ba6-41e4-9395-1f5e7be6d3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.111235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749c277-7ba6-41e4-9395-1f5e7be6d3d8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.116978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 795/1600] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:04.117732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49b38f-bb83-44e1-aad7-2d8a8c3f6518 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.124125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 806/1601] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:04.124125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749c277-7ba6-41e4-9395-1f5e7be6d3d8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.127014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49b38f-bb83-44e1-aad7-2d8a8c3f6518 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.131815 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346cbf8b-7880-4196-9811-66352741b6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.132681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cbf8b-7880-4196-9811-66352741b6b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.132949 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cbf8b-7880-4196-9811-66352741b6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.133227 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cbf8b-7880-4196-9811-66352741b6b6 admin admin] PATH_INFO: `/v3/projects/96f7562e6730438588a7aee055e82ab9/users/3abe8bdd0c8948eb97dcc7292359520c/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.133691 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749c277-7ba6-41e4-9395-1f5e7be6d3d8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.138131 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c5b99-aa18-4077-a683-3d13c3289a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.138763 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c5b99-aa18-4077-a683-3d13c3289a9a admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.139079 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c5b99-aa18-4077-a683-3d13c3289a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.139354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c5b99-aa18-4077-a683-3d13c3289a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.140198 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c5b99-aa18-4077-a683-3d13c3289a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.141768 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c5b99-aa18-4077-a683-3d13c3289a9a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.147095 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346cbf8b-7880-4196-9811-66352741b6b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f7562e6730438588a7aee055e82ab9, user_id=3abe8bdd0c8948eb97dcc7292359520c, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.149704 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346cbf8b-7880-4196-9811-66352741b6b6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.151442 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 807/1602] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:04.152201 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c5b99-aa18-4077-a683-3d13c3289a9a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.163160 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 796/1603] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:04 2022] PUT /identity/v3/projects/96f7562e6730438588a7aee055e82ab9/users/3abe8bdd0c8948eb97dcc7292359520c/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:04.163937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346cbf8b-7880-4196-9811-66352741b6b6 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.164582 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c5b99-aa18-4077-a683-3d13c3289a9a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.219829 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbb927-712e-412d-bc5a-a48c8b3830a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.220489 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbb927-712e-412d-bc5a-a48c8b3830a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.220770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbb927-712e-412d-bc5a-a48c8b3830a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.221042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbb927-712e-412d-bc5a-a48c8b3830a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.221767 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbb927-712e-412d-bc5a-a48c8b3830a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.223399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbb927-712e-412d-bc5a-a48c8b3830a3 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.226628 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346cbf8b-7880-4196-9811-66352741b6b6 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.231527 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9801fb-fb94-41cd-89e4-0f10c3c5cd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.232417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9801fb-fb94-41cd-89e4-0f10c3c5cd4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.232697 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9801fb-fb94-41cd-89e4-0f10c3c5cd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.232994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9801fb-fb94-41cd-89e4-0f10c3c5cd4e admin admin] PATH_INFO: `/v3/projects/98a55aa6d6354e2c8876c06d6c50b6a0/users/fbe0721b94e14bb7a09ec03cdba22692/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.233629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 808/1604] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:04.234524 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbb927-712e-412d-bc5a-a48c8b3830a3 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.244019 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbb927-712e-412d-bc5a-a48c8b3830a3 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.248469 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b26296-a77a-4039-9c0a-540de42c4720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.248782 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9801fb-fb94-41cd-89e4-0f10c3c5cd4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a55aa6d6354e2c8876c06d6c50b6a0, user_id=fbe0721b94e14bb7a09ec03cdba22692, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.249137 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b26296-a77a-4039-9c0a-540de42c4720 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.249418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b26296-a77a-4039-9c0a-540de42c4720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.249692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b26296-a77a-4039-9c0a-540de42c4720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.250396 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b26296-a77a-4039-9c0a-540de42c4720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.251984 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b26296-a77a-4039-9c0a-540de42c4720 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.252186 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9801fb-fb94-41cd-89e4-0f10c3c5cd4e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.261888 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 809/1605] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:04.262639 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b26296-a77a-4039-9c0a-540de42c4720 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.265179 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 797/1606] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:04 2022] PUT /identity/v3/projects/98a55aa6d6354e2c8876c06d6c50b6a0/users/fbe0721b94e14bb7a09ec03cdba22692/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:04.274769 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9801fb-fb94-41cd-89e4-0f10c3c5cd4e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.280336 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b26296-a77a-4039-9c0a-540de42c4720 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.323742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9801fb-fb94-41cd-89e4-0f10c3c5cd4e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.328539 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3913054-e6b0-468d-a069-63a3a7bba0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.329431 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3913054-e6b0-468d-a069-63a3a7bba0e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.329737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3913054-e6b0-468d-a069-63a3a7bba0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.329976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3913054-e6b0-468d-a069-63a3a7bba0e2 admin admin] PATH_INFO: `/v3/projects/a58468c143cd4d74b44853171625fae0/users/fc332499d33e43a385c1b531716acfd7/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.337587 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c722c34-7f22-4fa4-961e-58035541d0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.338477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c722c34-7f22-4fa4-961e-58035541d0a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.338756 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c722c34-7f22-4fa4-961e-58035541d0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.339053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c722c34-7f22-4fa4-961e-58035541d0a1 admin admin] PATH_INFO: `/v3/projects/da09c37173634c1cae0c84c546e327a9/users/1789de5479ed493cb3c461100e9d1c1a/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.343713 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3913054-e6b0-468d-a069-63a3a7bba0e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58468c143cd4d74b44853171625fae0, user_id=fc332499d33e43a385c1b531716acfd7, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.346345 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3913054-e6b0-468d-a069-63a3a7bba0e2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.353393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c722c34-7f22-4fa4-961e-58035541d0a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da09c37173634c1cae0c84c546e327a9, user_id=1789de5479ed493cb3c461100e9d1c1a, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.354367 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: WARNING py.warnings [None req-6c722c34-7f22-4fa4-961e-58035541d0a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 06:55:04.354367 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: warnings.warn(msg) May 11 06:55:04.354367 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: May 11 06:55:04.356495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c722c34-7f22-4fa4-961e-58035541d0a1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.360185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 798/1607] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:04 2022] PUT /identity/v3/projects/a58468c143cd4d74b44853171625fae0/users/fc332499d33e43a385c1b531716acfd7/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:04.360987 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3913054-e6b0-468d-a069-63a3a7bba0e2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.372284 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 810/1608] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:04 2022] PUT /identity/v3/projects/da09c37173634c1cae0c84c546e327a9/users/1789de5479ed493cb3c461100e9d1c1a/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:04.373079 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c722c34-7f22-4fa4-961e-58035541d0a1 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.419727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3913054-e6b0-468d-a069-63a3a7bba0e2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.429931 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c722c34-7f22-4fa4-961e-58035541d0a1 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.434899 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed335bbc-bcdb-437b-8ab6-b9363923d991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.435866 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed335bbc-bcdb-437b-8ab6-b9363923d991 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.436144 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed335bbc-bcdb-437b-8ab6-b9363923d991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.436415 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed335bbc-bcdb-437b-8ab6-b9363923d991 admin admin] PATH_INFO: `/v3/projects/27c3689015e24bb4ba9dd0ca0561f08b/users/35d6f4af057e4fa4868e0d418765be37/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.450835 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed335bbc-bcdb-437b-8ab6-b9363923d991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27c3689015e24bb4ba9dd0ca0561f08b, user_id=35d6f4af057e4fa4868e0d418765be37, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.453588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed335bbc-bcdb-437b-8ab6-b9363923d991 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.466766 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 811/1609] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:04 2022] PUT /identity/v3/projects/27c3689015e24bb4ba9dd0ca0561f08b/users/35d6f4af057e4fa4868e0d418765be37/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:04.468417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e91c7-8313-434f-af13-283c09f3b069 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.468705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e91c7-8313-434f-af13-283c09f3b069 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.468978 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e91c7-8313-434f-af13-283c09f3b069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.476561 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046032c5-32e0-4bbf-8c42-3c14fea1e9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.477234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046032c5-32e0-4bbf-8c42-3c14fea1e9ec admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.477515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046032c5-32e0-4bbf-8c42-3c14fea1e9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.477790 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046032c5-32e0-4bbf-8c42-3c14fea1e9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.478505 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046032c5-32e0-4bbf-8c42-3c14fea1e9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.480126 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046032c5-32e0-4bbf-8c42-3c14fea1e9ec admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.485354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c05e91c7-8313-434f-af13-283c09f3b069 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:04.486553 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c05e91c7-8313-434f-af13-283c09f3b069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:04.489785 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 799/1610] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:04.490413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046032c5-32e0-4bbf-8c42-3c14fea1e9ec admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.499391 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046032c5-32e0-4bbf-8c42-3c14fea1e9ec admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.544411 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 812/1611] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:04.551795 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e91c7-8313-434f-af13-283c09f3b069 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.552787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1be33-1820-4d38-8652-45f9cd9439b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.553504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1be33-1820-4d38-8652-45f9cd9439b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.553949 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1be33-1820-4d38-8652-45f9cd9439b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.554068 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1be33-1820-4d38-8652-45f9cd9439b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.554746 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1be33-1820-4d38-8652-45f9cd9439b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.556395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1be33-1820-4d38-8652-45f9cd9439b0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.561886 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e91c7-8313-434f-af13-283c09f3b069 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.566676 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 800/1612] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:04.566676 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02428bd-0847-413b-99c6-236e50793394 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.566676 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02428bd-0847-413b-99c6-236e50793394 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.566676 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02428bd-0847-413b-99c6-236e50793394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.570487 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208d057-8e33-4943-9b40-49a52adca7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.571431 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208d057-8e33-4943-9b40-49a52adca7a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.571709 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208d057-8e33-4943-9b40-49a52adca7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.571982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208d057-8e33-4943-9b40-49a52adca7a9 admin admin] PATH_INFO: `/v3/projects/fe49406d807c4471ab917e8e50f25fe2/users/63548f8706214c4e9b116dfd89fc0372/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.586364 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208d057-8e33-4943-9b40-49a52adca7a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe49406d807c4471ab917e8e50f25fe2, user_id=63548f8706214c4e9b116dfd89fc0372, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.589072 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208d057-8e33-4943-9b40-49a52adca7a9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.592953 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b02428bd-0847-413b-99c6-236e50793394 None None] MFA Rules not processed for user `fbe0721b94e14bb7a09ec03cdba22692`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:04.594183 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b02428bd-0847-413b-99c6-236e50793394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:04.602509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 813/1613] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:04 2022] PUT /identity/v3/projects/fe49406d807c4471ab917e8e50f25fe2/users/63548f8706214c4e9b116dfd89fc0372/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:04.603579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208d057-8e33-4943-9b40-49a52adca7a9 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.659967 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 801/1614] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:04.661494 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d22db-782b-40f8-a706-914e9993f6ca None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.661779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d22db-782b-40f8-a706-914e9993f6ca None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.662049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d22db-782b-40f8-a706-914e9993f6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.667098 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208d057-8e33-4943-9b40-49a52adca7a9 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.674580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efa05a-6c5c-41a6-8056-5e9400c3e7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.675482 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efa05a-6c5c-41a6-8056-5e9400c3e7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.675778 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efa05a-6c5c-41a6-8056-5e9400c3e7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.677007 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efa05a-6c5c-41a6-8056-5e9400c3e7f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.677759 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efa05a-6c5c-41a6-8056-5e9400c3e7f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.679421 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efa05a-6c5c-41a6-8056-5e9400c3e7f8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.693686 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 814/1615] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:04.693686 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb16f66-569f-4d54-8860-bb8095c8b924 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.693686 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb16f66-569f-4d54-8860-bb8095c8b924 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.693686 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb16f66-569f-4d54-8860-bb8095c8b924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.696358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5b5d22db-782b-40f8-a706-914e9993f6ca None None] MFA Rules not processed for user `1789de5479ed493cb3c461100e9d1c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:04.697612 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5b5d22db-782b-40f8-a706-914e9993f6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:04.711196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-acb16f66-569f-4d54-8860-bb8095c8b924 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:04.712439 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-acb16f66-569f-4d54-8860-bb8095c8b924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:04.720185 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 815/1616] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:04.721008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb16f66-569f-4d54-8860-bb8095c8b924 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.730517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb16f66-569f-4d54-8860-bb8095c8b924 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.735573 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f55dd-a8f8-4b47-a70d-fc4058b00b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.736459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f55dd-a8f8-4b47-a70d-fc4058b00b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.736737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f55dd-a8f8-4b47-a70d-fc4058b00b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.737009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f55dd-a8f8-4b47-a70d-fc4058b00b18 admin admin] PATH_INFO: `/v3/projects/59a2712ed9524f31a5d81224a99d4cf9/users/cffc26233de74f0ea2c438f588be3ade/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.751578 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f55dd-a8f8-4b47-a70d-fc4058b00b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a2712ed9524f31a5d81224a99d4cf9, user_id=cffc26233de74f0ea2c438f588be3ade, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.754230 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f55dd-a8f8-4b47-a70d-fc4058b00b18 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.761876 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 802/1617] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:04.762708 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d22db-782b-40f8-a706-914e9993f6ca None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.777798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 816/1618] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:04 2022] PUT /identity/v3/projects/59a2712ed9524f31a5d81224a99d4cf9/users/cffc26233de74f0ea2c438f588be3ade/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:04.778582 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f55dd-a8f8-4b47-a70d-fc4058b00b18 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.822282 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d22db-782b-40f8-a706-914e9993f6ca None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.838552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f55dd-a8f8-4b47-a70d-fc4058b00b18 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.843355 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead22cc-d57d-4df6-8fa8-e6341a988b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.844269 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead22cc-d57d-4df6-8fa8-e6341a988b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.844529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead22cc-d57d-4df6-8fa8-e6341a988b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.844803 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead22cc-d57d-4df6-8fa8-e6341a988b2d admin admin] PATH_INFO: `/v3/projects/31d9c281afe14e518b5fdbb5570f7c1d/users/790deb098a434290ab662055a00808ff/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.859250 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead22cc-d57d-4df6-8fa8-e6341a988b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d9c281afe14e518b5fdbb5570f7c1d, user_id=790deb098a434290ab662055a00808ff, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.861876 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead22cc-d57d-4df6-8fa8-e6341a988b2d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.869416 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd449b-165f-48fb-838b-d593a58d1d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.870174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd449b-165f-48fb-838b-d593a58d1d47 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.870459 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd449b-165f-48fb-838b-d593a58d1d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.870737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd449b-165f-48fb-838b-d593a58d1d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.875126 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 817/1619] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:04 2022] PUT /identity/v3/projects/31d9c281afe14e518b5fdbb5570f7c1d/users/790deb098a434290ab662055a00808ff/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:04.880133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd449b-165f-48fb-838b-d593a58d1d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.880465 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8b944-d901-41c3-8075-2b821a8a60fb None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.880753 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8b944-d901-41c3-8075-2b821a8a60fb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.881028 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8b944-d901-41c3-8075-2b821a8a60fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.881572 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd449b-165f-48fb-838b-d593a58d1d47 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.891350 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 803/1620] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:04.892064 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd449b-165f-48fb-838b-d593a58d1d47 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.897914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-98e8b944-d901-41c3-8075-2b821a8a60fb None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:04.899179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-98e8b944-d901-41c3-8075-2b821a8a60fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:04.902059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd449b-165f-48fb-838b-d593a58d1d47 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.961263 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8349c9d-d594-418e-b175-d1eaeb1e051e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.961933 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8349c9d-d594-418e-b175-d1eaeb1e051e admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.962216 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8349c9d-d594-418e-b175-d1eaeb1e051e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.962488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8349c9d-d594-418e-b175-d1eaeb1e051e admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.963205 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8349c9d-d594-418e-b175-d1eaeb1e051e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.965132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8349c9d-d594-418e-b175-d1eaeb1e051e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:04.974132 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 818/1621] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:04.974132 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8b944-d901-41c3-8075-2b821a8a60fb None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:04.982715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8b944-d901-41c3-8075-2b821a8a60fb None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:04.988981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8f38f-8e2b-4ebe-b0f2-ab907d07d703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:04.990086 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8f38f-8e2b-4ebe-b0f2-ab907d07d703 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:04.990368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8f38f-8e2b-4ebe-b0f2-ab907d07d703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:04.990641 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8f38f-8e2b-4ebe-b0f2-ab907d07d703 admin admin] PATH_INFO: `/v3/projects/a58468c143cd4d74b44853171625fae0/users/fc332499d33e43a385c1b531716acfd7/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:04.992750 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8f38f-8e2b-4ebe-b0f2-ab907d07d703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58468c143cd4d74b44853171625fae0, user_id=fc332499d33e43a385c1b531716acfd7, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:04.996502 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8f38f-8e2b-4ebe-b0f2-ab907d07d703 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:05.000517 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 804/1622] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:04 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:05.001597 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8349c9d-d594-418e-b175-d1eaeb1e051e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:05.008348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 819/1623] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:04 2022] PUT /identity/v3/projects/a58468c143cd4d74b44853171625fae0/users/fc332499d33e43a385c1b531716acfd7/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:05.020071 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f4367-9faf-49d2-b790-d19ed31d23c2 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:05.020424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f4367-9faf-49d2-b790-d19ed31d23c2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:05.021144 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f4367-9faf-49d2-b790-d19ed31d23c2 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:05.022362 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 820/1624] 10.222.0.77 () {54 vars in 961 bytes} [Wed May 11 06:55:05 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:55:05.023290 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385952d1-fa1e-4be4-a99e-c8feae2ef0be None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:05.023634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385952d1-fa1e-4be4-a99e-c8feae2ef0be None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:05.023918 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385952d1-fa1e-4be4-a99e-c8feae2ef0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:05.043329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-385952d1-fa1e-4be4-a99e-c8feae2ef0be None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:05.044558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-385952d1-fa1e-4be4-a99e-c8feae2ef0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:05.062808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8349c9d-d594-418e-b175-d1eaeb1e051e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:05.107188 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 821/1625] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:05.108710 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4026db-7b32-4a89-84f0-787056394667 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:05.109039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4026db-7b32-4a89-84f0-787056394667 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:05.109341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4026db-7b32-4a89-84f0-787056394667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:05.116861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925c515-3ea2-4c7b-a6dc-cdb52d5f80c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:05.117601 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925c515-3ea2-4c7b-a6dc-cdb52d5f80c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:05.117912 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925c515-3ea2-4c7b-a6dc-cdb52d5f80c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:05.118187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925c515-3ea2-4c7b-a6dc-cdb52d5f80c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:05.128633 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925c515-3ea2-4c7b-a6dc-cdb52d5f80c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:05.130092 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925c515-3ea2-4c7b-a6dc-cdb52d5f80c3 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:05.141805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 805/1626] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:05.142677 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925c515-3ea2-4c7b-a6dc-cdb52d5f80c3 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:05.143301 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ca4026db-7b32-4a89-84f0-787056394667 None None] MFA Rules not processed for user `790deb098a434290ab662055a00808ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:05.144136 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0925c515-3ea2-4c7b-a6dc-cdb52d5f80c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:05.144480 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ca4026db-7b32-4a89-84f0-787056394667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:05.155250 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925c515-3ea2-4c7b-a6dc-cdb52d5f80c3 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:05.159184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afaf41-29d0-4a33-8955-26f85302e56d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:05.159835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afaf41-29d0-4a33-8955-26f85302e56d service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:05.160115 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afaf41-29d0-4a33-8955-26f85302e56d service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:05.160392 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afaf41-29d0-4a33-8955-26f85302e56d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:05.171180 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afaf41-29d0-4a33-8955-26f85302e56d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:05.173762 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afaf41-29d0-4a33-8955-26f85302e56d service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:05.188222 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 806/1627] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:05.188974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afaf41-29d0-4a33-8955-26f85302e56d service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:05.201186 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afaf41-29d0-4a33-8955-26f85302e56d service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:05.207381 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657c58d-4012-4626-8dca-72b02fad59ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:05.208210 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657c58d-4012-4626-8dca-72b02fad59ea admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:05.208494 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657c58d-4012-4626-8dca-72b02fad59ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:05.208770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657c58d-4012-4626-8dca-72b02fad59ea admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:05.209873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657c58d-4012-4626-8dca-72b02fad59ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:05.211895 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657c58d-4012-4626-8dca-72b02fad59ea admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:05.217517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 822/1628] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:05.217517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6da4af-5190-4b5e-b844-5583f25c59dc None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:05.217517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6da4af-5190-4b5e-b844-5583f25c59dc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:05.217517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6da4af-5190-4b5e-b844-5583f25c59dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:05.234184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 807/1629] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:05 2022] POST /identity/v3/users => generated 299 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:05.236038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875994b-7425-4351-bac9-f4344ef66678 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:05.236184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875994b-7425-4351-bac9-f4344ef66678 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:05.236421 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875994b-7425-4351-bac9-f4344ef66678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:05.256197 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2d6da4af-5190-4b5e-b844-5583f25c59dc None None] MFA Rules not processed for user `fc332499d33e43a385c1b531716acfd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:05.257560 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2d6da4af-5190-4b5e-b844-5583f25c59dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:05.260692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c875994b-7425-4351-bac9-f4344ef66678 None None] MFA Rules not processed for user `edf9d57de89a4701ba1a5b079d0ad348`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:05.262225 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c875994b-7425-4351-bac9-f4344ef66678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:05.352270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 823/1630] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:05.352956 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 808/1631] 10.222.0.77 () {58 vars in 1058 bytes} [Wed May 11 06:55:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:05.353278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6da4af-5190-4b5e-b844-5583f25c59dc None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:05.354067 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875994b-7425-4351-bac9-f4344ef66678 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:05.364530 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6da4af-5190-4b5e-b844-5583f25c59dc None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:05.367423 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875994b-7425-4351-bac9-f4344ef66678 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:05.368938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23f793-4818-45b6-947c-c1945c5bc67d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:05.369600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23f793-4818-45b6-947c-c1945c5bc67d service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:05.369932 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23f793-4818-45b6-947c-c1945c5bc67d service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:05.370271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23f793-4818-45b6-947c-c1945c5bc67d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:05.373824 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb982ea-cd10-45ac-9330-1c8c9081b896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:05.374696 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb982ea-cd10-45ac-9330-1c8c9081b896 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:05.375205 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb982ea-cd10-45ac-9330-1c8c9081b896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:05.375335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb982ea-cd10-45ac-9330-1c8c9081b896 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:05.376268 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb982ea-cd10-45ac-9330-1c8c9081b896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:05.378908 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb982ea-cd10-45ac-9330-1c8c9081b896 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:05.380515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23f793-4818-45b6-947c-c1945c5bc67d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:05.382143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23f793-4818-45b6-947c-c1945c5bc67d service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:05.421403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 824/1632] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:05.422262 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23f793-4818-45b6-947c-c1945c5bc67d service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:05.422939 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 809/1633] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:05 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:05.423822 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb982ea-cd10-45ac-9330-1c8c9081b896 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:05.443313 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23f793-4818-45b6-947c-c1945c5bc67d service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:05.499613 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb982ea-cd10-45ac-9330-1c8c9081b896 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:05.504563 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631d3ee-9cd9-49ae-b165-c19739256bbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:05.506121 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631d3ee-9cd9-49ae-b165-c19739256bbe service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:05.506405 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631d3ee-9cd9-49ae-b165-c19739256bbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:05.506679 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631d3ee-9cd9-49ae-b165-c19739256bbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:05.550651 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f594fb-2d07-46e5-b817-bce8cdab82b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:05.551448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f594fb-2d07-46e5-b817-bce8cdab82b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:05.551674 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f594fb-2d07-46e5-b817-bce8cdab82b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:05.551950 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f594fb-2d07-46e5-b817-bce8cdab82b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:05.552683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f594fb-2d07-46e5-b817-bce8cdab82b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:05.554483 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f594fb-2d07-46e5-b817-bce8cdab82b5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:05.568241 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 825/1634] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:05.568241 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f594fb-2d07-46e5-b817-bce8cdab82b5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:05.594917 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631d3ee-9cd9-49ae-b165-c19739256bbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:05.597884 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631d3ee-9cd9-49ae-b165-c19739256bbe service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:05.613269 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 810/1635] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:05 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:05.614746 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631d3ee-9cd9-49ae-b165-c19739256bbe service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:05.625638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631d3ee-9cd9-49ae-b165-c19739256bbe service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:05.636440 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d28fb-f1ce-4001-a3f4-97b1b2f992ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:05.638569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d28fb-f1ce-4001-a3f4-97b1b2f992ef admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:05.638895 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d28fb-f1ce-4001-a3f4-97b1b2f992ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:05.639570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d28fb-f1ce-4001-a3f4-97b1b2f992ef admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:05.652331 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d28fb-f1ce-4001-a3f4-97b1b2f992ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:05.655358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d28fb-f1ce-4001-a3f4-97b1b2f992ef admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:05.704470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f594fb-2d07-46e5-b817-bce8cdab82b5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:05.710506 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da0a33-ef70-4dd8-9874-8b72b9762054 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:05.711197 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da0a33-ef70-4dd8-9874-8b72b9762054 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:05.711538 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da0a33-ef70-4dd8-9874-8b72b9762054 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:05.711814 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da0a33-ef70-4dd8-9874-8b72b9762054 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:05.717402 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 811/1636] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:05 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:05.718026 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d28fb-f1ce-4001-a3f4-97b1b2f992ef admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:05.747454 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d28fb-f1ce-4001-a3f4-97b1b2f992ef admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:05.763331 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b92ec6-c4c2-423e-91be-33b5f09c8b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:05.764250 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b92ec6-c4c2-423e-91be-33b5f09c8b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:05.765828 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b92ec6-c4c2-423e-91be-33b5f09c8b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:05.765828 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b92ec6-c4c2-423e-91be-33b5f09c8b6a admin admin] PATH_INFO: `/v3/projects/f03b20072dcb42bbbd8fe1d060dc489d/users/62ab8fc1e3854ad4ad42403a74270c1e/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:05.797371 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b92ec6-c4c2-423e-91be-33b5f09c8b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f03b20072dcb42bbbd8fe1d060dc489d, user_id=62ab8fc1e3854ad4ad42403a74270c1e, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:05.801111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b92ec6-c4c2-423e-91be-33b5f09c8b6a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:05.824968 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 812/1637] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:05 2022] PUT /identity/v3/projects/f03b20072dcb42bbbd8fe1d060dc489d/users/62ab8fc1e3854ad4ad42403a74270c1e/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:05.825568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b92ec6-c4c2-423e-91be-33b5f09c8b6a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:05.848540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da0a33-ef70-4dd8-9874-8b72b9762054 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:05.850488 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da0a33-ef70-4dd8-9874-8b72b9762054 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:05.861609 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 826/1638] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:05.862601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da0a33-ef70-4dd8-9874-8b72b9762054 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:05.872782 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da0a33-ef70-4dd8-9874-8b72b9762054 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:05.933861 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d06e1d-eed9-4b72-80c3-762f9072ba28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:05.934913 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d06e1d-eed9-4b72-80c3-762f9072ba28 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:05.935226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d06e1d-eed9-4b72-80c3-762f9072ba28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:05.935503 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d06e1d-eed9-4b72-80c3-762f9072ba28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:05.966374 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b92ec6-c4c2-423e-91be-33b5f09c8b6a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:05.980989 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dee0a0-0964-4404-ab60-31d878c397e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:05.982655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dee0a0-0964-4404-ab60-31d878c397e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:05.984074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dee0a0-0964-4404-ab60-31d878c397e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:05.985486 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dee0a0-0964-4404-ab60-31d878c397e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:05.987639 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dee0a0-0964-4404-ab60-31d878c397e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:05.993177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dee0a0-0964-4404-ab60-31d878c397e1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:06.020344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d06e1d-eed9-4b72-80c3-762f9072ba28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:06.020834 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 813/1639] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:06.022728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dee0a0-0964-4404-ab60-31d878c397e1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:06.023666 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d06e1d-eed9-4b72-80c3-762f9072ba28 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:06.040172 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dee0a0-0964-4404-ab60-31d878c397e1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:06.045674 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 827/1640] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:06.048529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d06e1d-eed9-4b72-80c3-762f9072ba28 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:06.053508 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247dc12-71cb-497b-967f-d508e243ba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:06.055040 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247dc12-71cb-497b-967f-d508e243ba08 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:06.070369 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d06e1d-eed9-4b72-80c3-762f9072ba28 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:06.071295 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247dc12-71cb-497b-967f-d508e243ba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:06.074087 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247dc12-71cb-497b-967f-d508e243ba08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:06.075651 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247dc12-71cb-497b-967f-d508e243ba08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:06.080519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247dc12-71cb-497b-967f-d508e243ba08 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:06.082297 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cdf884-7fbc-472a-82a7-9f66b8834036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:06.084727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdf884-7fbc-472a-82a7-9f66b8834036 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:06.085000 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdf884-7fbc-472a-82a7-9f66b8834036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:06.085720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdf884-7fbc-472a-82a7-9f66b8834036 admin admin] PATH_INFO: `/v3/projects/3b8c74e8031b4780aded4b0dd3e5bbc8/users/d7b54e6f05f844d697da47e5c67bfe0a/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:06.147750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 814/1641] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:06.149437 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cdf884-7fbc-472a-82a7-9f66b8834036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8c74e8031b4780aded4b0dd3e5bbc8, user_id=d7b54e6f05f844d697da47e5c67bfe0a, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:06.154453 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cdf884-7fbc-472a-82a7-9f66b8834036 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:06.154681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa59dad-8455-4bf5-8532-cc0faff84dfb None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:06.155223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa59dad-8455-4bf5-8532-cc0faff84dfb None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:06.156618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa59dad-8455-4bf5-8532-cc0faff84dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:06.191840 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 828/1642] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:06 2022] PUT /identity/v3/projects/3b8c74e8031b4780aded4b0dd3e5bbc8/users/d7b54e6f05f844d697da47e5c67bfe0a/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:06.192567 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cdf884-7fbc-472a-82a7-9f66b8834036 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:06.224253 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-cfa59dad-8455-4bf5-8532-cc0faff84dfb None None] MFA Rules not processed for user `35d6f4af057e4fa4868e0d418765be37`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:06.226269 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cfa59dad-8455-4bf5-8532-cc0faff84dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:06.358588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cdf884-7fbc-472a-82a7-9f66b8834036 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:06.370664 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63600895-5b39-4883-b4da-a76a80bbb8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:06.371656 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63600895-5b39-4883-b4da-a76a80bbb8d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:06.373354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63600895-5b39-4883-b4da-a76a80bbb8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:06.373644 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63600895-5b39-4883-b4da-a76a80bbb8d2 admin admin] PATH_INFO: `/v3/projects/f03b20072dcb42bbbd8fe1d060dc489d/users/62ab8fc1e3854ad4ad42403a74270c1e/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:06.378282 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63600895-5b39-4883-b4da-a76a80bbb8d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f03b20072dcb42bbbd8fe1d060dc489d, user_id=62ab8fc1e3854ad4ad42403a74270c1e, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:06.381400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63600895-5b39-4883-b4da-a76a80bbb8d2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:06.417474 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 829/1643] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:06 2022] PUT /identity/v3/projects/f03b20072dcb42bbbd8fe1d060dc489d/users/62ab8fc1e3854ad4ad42403a74270c1e/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:06.418581 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63600895-5b39-4883-b4da-a76a80bbb8d2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:06.501811 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 815/1644] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:06.504491 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8813f-8eee-4392-93b5-ae223c9e8273 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:06.504791 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8813f-8eee-4392-93b5-ae223c9e8273 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:06.505053 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8813f-8eee-4392-93b5-ae223c9e8273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:06.550659 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63600895-5b39-4883-b4da-a76a80bbb8d2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:06.560676 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825a55b-7354-462b-b7ee-b17763943330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:06.562354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825a55b-7354-462b-b7ee-b17763943330 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:06.562939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825a55b-7354-462b-b7ee-b17763943330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:06.563539 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825a55b-7354-462b-b7ee-b17763943330 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:06.565045 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825a55b-7354-462b-b7ee-b17763943330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:06.569939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825a55b-7354-462b-b7ee-b17763943330 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:06.593798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 830/1645] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:06.597221 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04c1f9-d76e-498a-81a2-6fc1cf5aa7b3 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:06.597400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04c1f9-d76e-498a-81a2-6fc1cf5aa7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:06.598883 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04c1f9-d76e-498a-81a2-6fc1cf5aa7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:06.604459 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5bb8813f-8eee-4392-93b5-ae223c9e8273 None None] MFA Rules not processed for user `62ab8fc1e3854ad4ad42403a74270c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:06.605903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5bb8813f-8eee-4392-93b5-ae223c9e8273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:06.633260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-cc04c1f9-d76e-498a-81a2-6fc1cf5aa7b3 None None] MFA Rules not processed for user `35d6f4af057e4fa4868e0d418765be37`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:06.637044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cc04c1f9-d76e-498a-81a2-6fc1cf5aa7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:06.757735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 831/1646] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:06.759932 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b950b6c-5bbe-4877-a93e-3ddd60084376 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:06.760488 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b950b6c-5bbe-4877-a93e-3ddd60084376 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:06.761043 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b950b6c-5bbe-4877-a93e-3ddd60084376 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:06.762632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 832/1647] 10.222.0.77 () {54 vars in 912 bytes} [Wed May 11 06:55:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:55:06.763764 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b950b6c-5bbe-4877-a93e-3ddd60084376 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:06.788611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 816/1648] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:06.788611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f4d05-422f-44ea-b129-55f10ef8a769 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:06.788611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f4d05-422f-44ea-b129-55f10ef8a769 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:06.788611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f4d05-422f-44ea-b129-55f10ef8a769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:06.795253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b950b6c-5bbe-4877-a93e-3ddd60084376 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:06.810111 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f474529-d542-4577-879f-4786c0d2f669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:06.814037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f474529-d542-4577-879f-4786c0d2f669 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:06.814600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f474529-d542-4577-879f-4786c0d2f669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:06.815019 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f474529-d542-4577-879f-4786c0d2f669 admin admin] PATH_INFO: `/v3/projects/3b8c74e8031b4780aded4b0dd3e5bbc8/users/d7b54e6f05f844d697da47e5c67bfe0a/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:06.818206 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f474529-d542-4577-879f-4786c0d2f669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8c74e8031b4780aded4b0dd3e5bbc8, user_id=d7b54e6f05f844d697da47e5c67bfe0a, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:06.822237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f474529-d542-4577-879f-4786c0d2f669 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:06.830697 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-426f4d05-422f-44ea-b129-55f10ef8a769 None None] MFA Rules not processed for user `edf9d57de89a4701ba1a5b079d0ad348`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:06.835543 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-426f4d05-422f-44ea-b129-55f10ef8a769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:06.847413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 833/1649] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:06 2022] PUT /identity/v3/projects/3b8c74e8031b4780aded4b0dd3e5bbc8/users/d7b54e6f05f844d697da47e5c67bfe0a/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:06.851234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57173b71-f125-4857-b78d-6af7dbb080f3 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:06.851513 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57173b71-f125-4857-b78d-6af7dbb080f3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:06.852774 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57173b71-f125-4857-b78d-6af7dbb080f3 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:06.855565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 834/1650] 10.222.0.77 () {54 vars in 961 bytes} [Wed May 11 06:55:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:55:06.859483 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57173b71-f125-4857-b78d-6af7dbb080f3 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:06.961049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 817/1651] 10.222.0.77 () {58 vars in 1009 bytes} [Wed May 11 06:55:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:06.963003 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1f81c-ee5d-471a-b202-d73d2e90d26a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:06.963300 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1f81c-ee5d-471a-b202-d73d2e90d26a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:06.963581 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1f81c-ee5d-471a-b202-d73d2e90d26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:06.984488 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57173b71-f125-4857-b78d-6af7dbb080f3 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:06.994151 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538e1f8-554a-4969-8b03-79a5880b6343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:06.995717 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538e1f8-554a-4969-8b03-79a5880b6343 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:06.999102 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538e1f8-554a-4969-8b03-79a5880b6343 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:06.999652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538e1f8-554a-4969-8b03-79a5880b6343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:07.006559 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-74f1f81c-ee5d-471a-b202-d73d2e90d26a None None] MFA Rules not processed for user `d7b54e6f05f844d697da47e5c67bfe0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:07.007844 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-74f1f81c-ee5d-471a-b202-d73d2e90d26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:07.097853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538e1f8-554a-4969-8b03-79a5880b6343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:07.100064 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538e1f8-554a-4969-8b03-79a5880b6343 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:07.118063 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 835/1652] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:07.119677 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43a908-551b-4faf-972f-58690aaf66de None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:07.120012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43a908-551b-4faf-972f-58690aaf66de None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:07.120348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43a908-551b-4faf-972f-58690aaf66de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:07.160243 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-af43a908-551b-4faf-972f-58690aaf66de None None] MFA Rules not processed for user `edf9d57de89a4701ba1a5b079d0ad348`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:07.170749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-af43a908-551b-4faf-972f-58690aaf66de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:07.204085 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 836/1653] 10.222.0.77 () {58 vars in 1058 bytes} [Wed May 11 06:55:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:07.205967 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43a908-551b-4faf-972f-58690aaf66de None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:07.217481 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 818/1654] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:07.219733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1f81c-ee5d-471a-b202-d73d2e90d26a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:07.230409 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43a908-551b-4faf-972f-58690aaf66de None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:07.242583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f27b3b-2f97-45af-8721-779bba03c3b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:07.250278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f27b3b-2f97-45af-8721-779bba03c3b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:07.250554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f27b3b-2f97-45af-8721-779bba03c3b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:07.250649 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f27b3b-2f97-45af-8721-779bba03c3b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:07.269070 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f27b3b-2f97-45af-8721-779bba03c3b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:07.270760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f27b3b-2f97-45af-8721-779bba03c3b4 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:07.297730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 837/1655] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:07.312949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f27b3b-2f97-45af-8721-779bba03c3b4 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:07.339787 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f27b3b-2f97-45af-8721-779bba03c3b4 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:07.347428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa039928-94d1-4ba3-90a6-17d2dfcddfd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:07.348105 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa039928-94d1-4ba3-90a6-17d2dfcddfd4 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:07.348390 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa039928-94d1-4ba3-90a6-17d2dfcddfd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:07.348857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa039928-94d1-4ba3-90a6-17d2dfcddfd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:07.374225 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1f81c-ee5d-471a-b202-d73d2e90d26a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:07.387760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3742b0-6e39-4c96-9f7d-fb2ea3a981d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:07.388744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3742b0-6e39-4c96-9f7d-fb2ea3a981d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:07.389153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3742b0-6e39-4c96-9f7d-fb2ea3a981d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:07.389363 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3742b0-6e39-4c96-9f7d-fb2ea3a981d8 admin admin] PATH_INFO: `/v3/users/fbe0721b94e14bb7a09ec03cdba22692` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:07.394106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3742b0-6e39-4c96-9f7d-fb2ea3a981d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe0721b94e14bb7a09ec03cdba22692)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:07.399801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3742b0-6e39-4c96-9f7d-fb2ea3a981d8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:07.500718 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa039928-94d1-4ba3-90a6-17d2dfcddfd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:07.504695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa039928-94d1-4ba3-90a6-17d2dfcddfd4 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:07.508776 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6c3742b0-6e39-4c96-9f7d-fb2ea3a981d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe0721b94e14bb7a09ec03cdba22692'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:07.531947 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 838/1656] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:07.532883 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa039928-94d1-4ba3-90a6-17d2dfcddfd4 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:07.543137 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa039928-94d1-4ba3-90a6-17d2dfcddfd4 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:07.554699 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50773bcb-1030-4a83-aaab-5b5df7389a81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:07.555602 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50773bcb-1030-4a83-aaab-5b5df7389a81 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:07.555886 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50773bcb-1030-4a83-aaab-5b5df7389a81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:07.556156 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50773bcb-1030-4a83-aaab-5b5df7389a81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:07.556814 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6c3742b0-6e39-4c96-9f7d-fb2ea3a981d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe0721b94e14bb7a09ec03cdba22692'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:07.558571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6c3742b0-6e39-4c96-9f7d-fb2ea3a981d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe0721b94e14bb7a09ec03cdba22692'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:07.560618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6c3742b0-6e39-4c96-9f7d-fb2ea3a981d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe0721b94e14bb7a09ec03cdba22692'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:07.567483 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50773bcb-1030-4a83-aaab-5b5df7389a81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:07.569086 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50773bcb-1030-4a83-aaab-5b5df7389a81 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:07.587831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 839/1657] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:07.601529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6c3742b0-6e39-4c96-9f7d-fb2ea3a981d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe0721b94e14bb7a09ec03cdba22692'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:07.634751 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 819/1658] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:55:07 2022] DELETE /identity/v3/users/fbe0721b94e14bb7a09ec03cdba22692 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:07.642221 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd6d31-3166-44d6-8042-d380418284f6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:07.642734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd6d31-3166-44d6-8042-d380418284f6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:07.643062 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd6d31-3166-44d6-8042-d380418284f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:07.702025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7bfd6d31-3166-44d6-8042-d380418284f6 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:07.707862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7bfd6d31-3166-44d6-8042-d380418284f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:07.894623 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 840/1659] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:07.930779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3742b0-6e39-4c96-9f7d-fb2ea3a981d8 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:07.933975 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6c3742b0-6e39-4c96-9f7d-fb2ea3a981d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:08.053003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df743d6a-6577-4475-b2d5-b0bb1dac46aa None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:08.053555 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df743d6a-6577-4475-b2d5-b0bb1dac46aa None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:08.054764 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df743d6a-6577-4475-b2d5-b0bb1dac46aa None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:08.057319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 841/1660] 10.222.0.77 () {54 vars in 912 bytes} [Wed May 11 06:55:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:55:08.064578 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07baff-be31-45f1-8065-43228df0306a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:08.065342 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07baff-be31-45f1-8065-43228df0306a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:08.065927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07baff-be31-45f1-8065-43228df0306a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:08.095590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bb07baff-be31-45f1-8065-43228df0306a None None] MFA Rules not processed for user `edf9d57de89a4701ba1a5b079d0ad348`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:08.096113 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3742b0-6e39-4c96-9f7d-fb2ea3a981d8 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:08.097673 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bb07baff-be31-45f1-8065-43228df0306a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:08.105433 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b201d0-dbdf-4998-9dd2-15f74c6fd1ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:08.106764 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b201d0-dbdf-4998-9dd2-15f74c6fd1ca service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:08.107285 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b201d0-dbdf-4998-9dd2-15f74c6fd1ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:08.107795 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b201d0-dbdf-4998-9dd2-15f74c6fd1ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:08.129482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b201d0-dbdf-4998-9dd2-15f74c6fd1ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:08.133483 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b201d0-dbdf-4998-9dd2-15f74c6fd1ca service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:08.158109 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 820/1661] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:08.227756 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 842/1662] 10.222.0.77 () {58 vars in 1009 bytes} [Wed May 11 06:55:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:55:08.241475 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b201d0-dbdf-4998-9dd2-15f74c6fd1ca service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:08.244001 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-38b201d0-dbdf-4998-9dd2-15f74c6fd1ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:08.358417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b201d0-dbdf-4998-9dd2-15f74c6fd1ca service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:08.365057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a947629-e22f-4428-a220-f5e79ce0a210 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '281c923b01a143dbb79d8c0ea04f55b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:08.365268 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a947629-e22f-4428-a220-f5e79ce0a210 service glance] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:08.365512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a947629-e22f-4428-a220-f5e79ce0a210 service glance] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:08.365766 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a947629-e22f-4428-a220-f5e79ce0a210 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:08.396710 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a947629-e22f-4428-a220-f5e79ce0a210 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:08.398714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a947629-e22f-4428-a220-f5e79ce0a210 service glance] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:08.432351 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 821/1663] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:08.961630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cdc8e-a053-4980-94b9-90698d892752 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:08.962135 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cdc8e-a053-4980-94b9-90698d892752 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:08.962135 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cdc8e-a053-4980-94b9-90698d892752 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:08.963375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 843/1664] 10.222.0.77 () {54 vars in 912 bytes} [Wed May 11 06:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:55:08.969027 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e2dbc-71a6-4a95-985e-1b07929aeb02 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:08.969536 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e2dbc-71a6-4a95-985e-1b07929aeb02 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:08.969636 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e2dbc-71a6-4a95-985e-1b07929aeb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:09.045454 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-035e2dbc-71a6-4a95-985e-1b07929aeb02 None None] MFA Rules not processed for user `3c92f4b777a644ad8055f15b1a8bd0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:09.046721 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-035e2dbc-71a6-4a95-985e-1b07929aeb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:09.063613 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 822/1665] 10.222.0.77 () {58 vars in 1009 bytes} [Wed May 11 06:55:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:55:09.102582 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cdc8e-a053-4980-94b9-90698d892752 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:09.117438 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cdc8e-a053-4980-94b9-90698d892752 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:09.122563 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d5d71-cd84-4c2c-a34d-cafbaea3c9d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:09.123518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d5d71-cd84-4c2c-a34d-cafbaea3c9d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:09.124065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d5d71-cd84-4c2c-a34d-cafbaea3c9d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:09.124527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d5d71-cd84-4c2c-a34d-cafbaea3c9d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:09.133065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d5d71-cd84-4c2c-a34d-cafbaea3c9d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:09.134727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d5d71-cd84-4c2c-a34d-cafbaea3c9d9 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:09.148130 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 844/1666] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:09.325798 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e2dbc-71a6-4a95-985e-1b07929aeb02 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:09.327326 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-035e2dbc-71a6-4a95-985e-1b07929aeb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:09.347934 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e2dbc-71a6-4a95-985e-1b07929aeb02 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:09.379135 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c89c63-6fda-4954-9d21-b1a06328e0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:09.380838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c89c63-6fda-4954-9d21-b1a06328e0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:09.382036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c89c63-6fda-4954-9d21-b1a06328e0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:09.382462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c89c63-6fda-4954-9d21-b1a06328e0a4 admin admin] PATH_INFO: `/v3/users/790deb098a434290ab662055a00808ff` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:09.388540 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c89c63-6fda-4954-9d21-b1a06328e0a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=790deb098a434290ab662055a00808ff)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:09.391483 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c89c63-6fda-4954-9d21-b1a06328e0a4 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:09.492682 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-32c89c63-6fda-4954-9d21-b1a06328e0a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '790deb098a434290ab662055a00808ff'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:09.514308 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-32c89c63-6fda-4954-9d21-b1a06328e0a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '790deb098a434290ab662055a00808ff'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:09.516293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-32c89c63-6fda-4954-9d21-b1a06328e0a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '790deb098a434290ab662055a00808ff'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:09.517707 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-32c89c63-6fda-4954-9d21-b1a06328e0a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '790deb098a434290ab662055a00808ff'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:09.534820 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-32c89c63-6fda-4954-9d21-b1a06328e0a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '790deb098a434290ab662055a00808ff'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:09.573009 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 823/1667] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:55:09 2022] DELETE /identity/v3/users/790deb098a434290ab662055a00808ff => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:09.578005 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca33c83-2bf3-4f87-b38b-c10f9e55d0d1 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:09.578425 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca33c83-2bf3-4f87-b38b-c10f9e55d0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:09.579289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca33c83-2bf3-4f87-b38b-c10f9e55d0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:09.638919 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5ca33c83-2bf3-4f87-b38b-c10f9e55d0d1 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:09.640452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5ca33c83-2bf3-4f87-b38b-c10f9e55d0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:09.742562 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 845/1668] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:55:09.785759 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c89c63-6fda-4954-9d21-b1a06328e0a4 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:09.787334 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-32c89c63-6fda-4954-9d21-b1a06328e0a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:09.981760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c89c63-6fda-4954-9d21-b1a06328e0a4 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:09.992436 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94e520-5ace-4273-8a46-ca1cd288f28a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:09.993437 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94e520-5ace-4273-8a46-ca1cd288f28a service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:09.993729 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94e520-5ace-4273-8a46-ca1cd288f28a service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:09.994008 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94e520-5ace-4273-8a46-ca1cd288f28a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:10.015443 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94e520-5ace-4273-8a46-ca1cd288f28a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:10.016747 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94e520-5ace-4273-8a46-ca1cd288f28a service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:10.038866 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 824/1669] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:10.938433 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca33c83-2bf3-4f87-b38b-c10f9e55d0d1 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:10.939992 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5ca33c83-2bf3-4f87-b38b-c10f9e55d0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:10.967340 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca33c83-2bf3-4f87-b38b-c10f9e55d0d1 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:10.967785 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94e520-5ace-4273-8a46-ca1cd288f28a service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:10.969487 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4c94e520-5ace-4273-8a46-ca1cd288f28a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:10.975751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319d668-4b80-4efc-8532-bb3b8cb1b165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:11.017265 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319d668-4b80-4efc-8532-bb3b8cb1b165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:11.017265 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319d668-4b80-4efc-8532-bb3b8cb1b165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:11.017265 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319d668-4b80-4efc-8532-bb3b8cb1b165 admin admin] PATH_INFO: `/v3/projects/98a55aa6d6354e2c8876c06d6c50b6a0` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:11.017265 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319d668-4b80-4efc-8532-bb3b8cb1b165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98a55aa6d6354e2c8876c06d6c50b6a0)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:11.017265 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319d668-4b80-4efc-8532-bb3b8cb1b165 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:11.034872 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94e520-5ace-4273-8a46-ca1cd288f28a service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:11.057119 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde6067-9d2d-4b7c-9dfd-4a1a9c0649ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:11.057906 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde6067-9d2d-4b7c-9dfd-4a1a9c0649ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:11.058186 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde6067-9d2d-4b7c-9dfd-4a1a9c0649ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:11.058458 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde6067-9d2d-4b7c-9dfd-4a1a9c0649ba admin admin] PATH_INFO: `/v3/projects/31d9c281afe14e518b5fdbb5570f7c1d` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:11.060833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde6067-9d2d-4b7c-9dfd-4a1a9c0649ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=31d9c281afe14e518b5fdbb5570f7c1d)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:11.061927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: WARNING py.warnings [None req-4dde6067-9d2d-4b7c-9dfd-4a1a9c0649ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 06:55:11.061927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: warnings.warn(msg) May 11 06:55:11.061927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: May 11 06:55:11.065693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde6067-9d2d-4b7c-9dfd-4a1a9c0649ba admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:11.163946 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9319d668-4b80-4efc-8532-bb3b8cb1b165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98a55aa6d6354e2c8876c06d6c50b6a0', 'request_id': 'req-9319d668-4b80-4efc-8532-bb3b8cb1b165'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:11.180706 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9319d668-4b80-4efc-8532-bb3b8cb1b165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98a55aa6d6354e2c8876c06d6c50b6a0', 'request_id': 'req-9319d668-4b80-4efc-8532-bb3b8cb1b165'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:11.200949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9319d668-4b80-4efc-8532-bb3b8cb1b165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98a55aa6d6354e2c8876c06d6c50b6a0', 'request_id': 'req-9319d668-4b80-4efc-8532-bb3b8cb1b165'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:11.255887 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9319d668-4b80-4efc-8532-bb3b8cb1b165 admin admin] The token cache is being invalidate because project 98a55aa6d6354e2c8876c06d6c50b6a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:55:11.257063 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9319d668-4b80-4efc-8532-bb3b8cb1b165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:11.257896 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9319d668-4b80-4efc-8532-bb3b8cb1b165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:11.261819 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 846/1670] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:55:10 2022] DELETE /identity/v3/projects/98a55aa6d6354e2c8876c06d6c50b6a0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:11.269051 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319d668-4b80-4efc-8532-bb3b8cb1b165 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:11.273519 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9319d668-4b80-4efc-8532-bb3b8cb1b165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:11.299195 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4dde6067-9d2d-4b7c-9dfd-4a1a9c0649ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31d9c281afe14e518b5fdbb5570f7c1d', 'request_id': 'req-4dde6067-9d2d-4b7c-9dfd-4a1a9c0649ba'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:11.347698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4dde6067-9d2d-4b7c-9dfd-4a1a9c0649ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31d9c281afe14e518b5fdbb5570f7c1d', 'request_id': 'req-4dde6067-9d2d-4b7c-9dfd-4a1a9c0649ba'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:11.377915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4dde6067-9d2d-4b7c-9dfd-4a1a9c0649ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31d9c281afe14e518b5fdbb5570f7c1d', 'request_id': 'req-4dde6067-9d2d-4b7c-9dfd-4a1a9c0649ba'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:11.404044 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4dde6067-9d2d-4b7c-9dfd-4a1a9c0649ba admin admin] The token cache is being invalidate because project 31d9c281afe14e518b5fdbb5570f7c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:55:11.404571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4dde6067-9d2d-4b7c-9dfd-4a1a9c0649ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:11.405538 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4dde6067-9d2d-4b7c-9dfd-4a1a9c0649ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:11.413157 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 825/1671] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:55:10 2022] DELETE /identity/v3/projects/31d9c281afe14e518b5fdbb5570f7c1d => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:55:11.414941 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3ab70-73ae-4b7a-af70-b65a2397f904 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:11.416025 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3ab70-73ae-4b7a-af70-b65a2397f904 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:11.416490 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3ab70-73ae-4b7a-af70-b65a2397f904 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:11.428317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 826/1672] 10.222.0.77 () {54 vars in 960 bytes} [Wed May 11 06:55:11 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:55:11.429583 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3ab70-73ae-4b7a-af70-b65a2397f904 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:11.432749 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2aa3ab70-73ae-4b7a-af70-b65a2397f904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:11.433463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319d668-4b80-4efc-8532-bb3b8cb1b165 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:11.608386 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70b142-4dbe-4ea5-a7d2-28bf3d81f09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:11.608968 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3ab70-73ae-4b7a-af70-b65a2397f904 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:11.609329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70b142-4dbe-4ea5-a7d2-28bf3d81f09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:11.609630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70b142-4dbe-4ea5-a7d2-28bf3d81f09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:11.609905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70b142-4dbe-4ea5-a7d2-28bf3d81f09c admin admin] PATH_INFO: `/v3/users/62ab8fc1e3854ad4ad42403a74270c1e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:11.612034 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70b142-4dbe-4ea5-a7d2-28bf3d81f09c admin admin] RBAC: Authorizing `identity:delete_user(user_id=62ab8fc1e3854ad4ad42403a74270c1e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:11.613255 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: WARNING py.warnings [None req-ef70b142-4dbe-4ea5-a7d2-28bf3d81f09c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 06:55:11.613255 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: warnings.warn(msg) May 11 06:55:11.613255 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: May 11 06:55:11.618671 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43821daa-eab2-4121-b0cd-d6fa806d5d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:11.620131 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43821daa-eab2-4121-b0cd-d6fa806d5d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:11.620600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43821daa-eab2-4121-b0cd-d6fa806d5d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:11.621058 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43821daa-eab2-4121-b0cd-d6fa806d5d5a admin admin] PATH_INFO: `/v3/users/d7b54e6f05f844d697da47e5c67bfe0a` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:11.622780 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43821daa-eab2-4121-b0cd-d6fa806d5d5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7b54e6f05f844d697da47e5c67bfe0a)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:11.627129 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43821daa-eab2-4121-b0cd-d6fa806d5d5a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:11.631047 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70b142-4dbe-4ea5-a7d2-28bf3d81f09c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:11.723873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43821daa-eab2-4121-b0cd-d6fa806d5d5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b54e6f05f844d697da47e5c67bfe0a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:11.754657 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43821daa-eab2-4121-b0cd-d6fa806d5d5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b54e6f05f844d697da47e5c67bfe0a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:11.763017 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43821daa-eab2-4121-b0cd-d6fa806d5d5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b54e6f05f844d697da47e5c67bfe0a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:11.764405 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43821daa-eab2-4121-b0cd-d6fa806d5d5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b54e6f05f844d697da47e5c67bfe0a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:11.785647 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43821daa-eab2-4121-b0cd-d6fa806d5d5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b54e6f05f844d697da47e5c67bfe0a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:11.794683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ef70b142-4dbe-4ea5-a7d2-28bf3d81f09c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62ab8fc1e3854ad4ad42403a74270c1e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:11.834414 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 827/1673] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:55:11 2022] DELETE /identity/v3/users/d7b54e6f05f844d697da47e5c67bfe0a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:11.836185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa561b-67d4-4eed-b110-233af78d1265 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:11.836937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa561b-67d4-4eed-b110-233af78d1265 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:11.837809 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa561b-67d4-4eed-b110-233af78d1265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:11.851349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ef70b142-4dbe-4ea5-a7d2-28bf3d81f09c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62ab8fc1e3854ad4ad42403a74270c1e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:11.852149 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ef70b142-4dbe-4ea5-a7d2-28bf3d81f09c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62ab8fc1e3854ad4ad42403a74270c1e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:11.852841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ef70b142-4dbe-4ea5-a7d2-28bf3d81f09c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62ab8fc1e3854ad4ad42403a74270c1e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:11.867128 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ef70b142-4dbe-4ea5-a7d2-28bf3d81f09c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62ab8fc1e3854ad4ad42403a74270c1e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:11.884411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-36fa561b-67d4-4eed-b110-233af78d1265 None None] MFA Rules not processed for user `d46e2703839e498da8f3e2c3fda1d61c`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:11.886449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-36fa561b-67d4-4eed-b110-233af78d1265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:11.914009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 847/1674] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:55:11 2022] DELETE /identity/v3/users/62ab8fc1e3854ad4ad42403a74270c1e => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:11.914792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70b142-4dbe-4ea5-a7d2-28bf3d81f09c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:11.919133 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ef70b142-4dbe-4ea5-a7d2-28bf3d81f09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:12.045978 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70b142-4dbe-4ea5-a7d2-28bf3d81f09c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:12.059175 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab055a4-2e5c-4af2-b73c-c8b0b79c4227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:12.060269 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab055a4-2e5c-4af2-b73c-c8b0b79c4227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:12.060697 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab055a4-2e5c-4af2-b73c-c8b0b79c4227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:12.061128 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab055a4-2e5c-4af2-b73c-c8b0b79c4227 admin admin] PATH_INFO: `/v3/users/1789de5479ed493cb3c461100e9d1c1a` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:12.062640 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab055a4-2e5c-4af2-b73c-c8b0b79c4227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1789de5479ed493cb3c461100e9d1c1a)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:12.064808 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab055a4-2e5c-4af2-b73c-c8b0b79c4227 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:12.122215 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 828/1675] 10.222.0.77 () {58 vars in 1057 bytes} [Wed May 11 06:55:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:12.125450 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa561b-67d4-4eed-b110-233af78d1265 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:12.137259 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa561b-67d4-4eed-b110-233af78d1265 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:12.168855 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-aab055a4-2e5c-4af2-b73c-c8b0b79c4227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1789de5479ed493cb3c461100e9d1c1a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:12.196985 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-aab055a4-2e5c-4af2-b73c-c8b0b79c4227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1789de5479ed493cb3c461100e9d1c1a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:12.200863 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-aab055a4-2e5c-4af2-b73c-c8b0b79c4227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1789de5479ed493cb3c461100e9d1c1a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:12.203679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-aab055a4-2e5c-4af2-b73c-c8b0b79c4227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1789de5479ed493cb3c461100e9d1c1a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:12.230060 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f28d28-b3e4-4f1b-86a0-ac3a141cfe0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46e2703839e498da8f3e2c3fda1d61c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:12.230293 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-aab055a4-2e5c-4af2-b73c-c8b0b79c4227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1789de5479ed493cb3c461100e9d1c1a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:12.231211 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f28d28-b3e4-4f1b-86a0-ac3a141cfe0e service placement] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:12.231861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f28d28-b3e4-4f1b-86a0-ac3a141cfe0e service placement] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:12.232761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f28d28-b3e4-4f1b-86a0-ac3a141cfe0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:12.235872 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-20f28d28-b3e4-4f1b-86a0-ac3a141cfe0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:12.251826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 848/1676] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:55:11 2022] DELETE /identity/v3/users/1789de5479ed493cb3c461100e9d1c1a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:12.253484 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f28d28-b3e4-4f1b-86a0-ac3a141cfe0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:12.255561 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f28d28-b3e4-4f1b-86a0-ac3a141cfe0e service placement] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:12.256544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddc1f8-3148-455b-af86-09ffdf8c2e00 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:12.256840 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddc1f8-3148-455b-af86-09ffdf8c2e00 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:12.257126 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddc1f8-3148-455b-af86-09ffdf8c2e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:12.307922 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 829/1677] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:12.313401 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ddddc1f8-3148-455b-af86-09ffdf8c2e00 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:12.314674 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ddddc1f8-3148-455b-af86-09ffdf8c2e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:12.456925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 849/1678] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:12.517862 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f28d28-b3e4-4f1b-86a0-ac3a141cfe0e service placement] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:12.519564 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-20f28d28-b3e4-4f1b-86a0-ac3a141cfe0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:12.648289 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f28d28-b3e4-4f1b-86a0-ac3a141cfe0e service placement] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:12.758203 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b65892-a130-4685-b4d0-bd3d041640c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:12.759393 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b65892-a130-4685-b4d0-bd3d041640c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:12.760314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b65892-a130-4685-b4d0-bd3d041640c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:12.762156 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b65892-a130-4685-b4d0-bd3d041640c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:12.780501 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b65892-a130-4685-b4d0-bd3d041640c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:12.791971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b65892-a130-4685-b4d0-bd3d041640c1 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:12.813493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 830/1679] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:13.630880 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddc1f8-3148-455b-af86-09ffdf8c2e00 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:13.632421 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ddddc1f8-3148-455b-af86-09ffdf8c2e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:13.648278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddc1f8-3148-455b-af86-09ffdf8c2e00 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:13.662578 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0096f-0c0c-40ec-b92a-038037167033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:13.663358 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0096f-0c0c-40ec-b92a-038037167033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:13.670384 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0096f-0c0c-40ec-b92a-038037167033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:13.671083 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0096f-0c0c-40ec-b92a-038037167033 admin admin] PATH_INFO: `/v3/projects/f03b20072dcb42bbbd8fe1d060dc489d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:13.673711 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0096f-0c0c-40ec-b92a-038037167033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f03b20072dcb42bbbd8fe1d060dc489d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:13.675996 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0096f-0c0c-40ec-b92a-038037167033 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:13.811993 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-43c0096f-0c0c-40ec-b92a-038037167033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f03b20072dcb42bbbd8fe1d060dc489d', 'request_id': 'req-43c0096f-0c0c-40ec-b92a-038037167033'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:13.819695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-43c0096f-0c0c-40ec-b92a-038037167033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f03b20072dcb42bbbd8fe1d060dc489d', 'request_id': 'req-43c0096f-0c0c-40ec-b92a-038037167033'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:13.829676 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-43c0096f-0c0c-40ec-b92a-038037167033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f03b20072dcb42bbbd8fe1d060dc489d', 'request_id': 'req-43c0096f-0c0c-40ec-b92a-038037167033'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:13.853612 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-43c0096f-0c0c-40ec-b92a-038037167033 admin admin] The token cache is being invalidate because project f03b20072dcb42bbbd8fe1d060dc489d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:55:13.853908 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-43c0096f-0c0c-40ec-b92a-038037167033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:13.856555 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-43c0096f-0c0c-40ec-b92a-038037167033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:13.865492 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b65892-a130-4685-b4d0-bd3d041640c1 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:13.868231 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 850/1680] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:55:13 2022] DELETE /identity/v3/projects/f03b20072dcb42bbbd8fe1d060dc489d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:13.868424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-94b65892-a130-4685-b4d0-bd3d041640c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:13.870383 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd40dc5-f3ca-4ce8-a012-21fb04aa97c2 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:13.870678 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd40dc5-f3ca-4ce8-a012-21fb04aa97c2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:13.870978 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd40dc5-f3ca-4ce8-a012-21fb04aa97c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:13.889734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b65892-a130-4685-b4d0-bd3d041640c1 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:13.910442 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2bd40dc5-f3ca-4ce8-a012-21fb04aa97c2 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:13.915177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2bd40dc5-f3ca-4ce8-a012-21fb04aa97c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:14.040502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f14011-c352-4219-b6a5-14778b0c5b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:14.041679 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f14011-c352-4219-b6a5-14778b0c5b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:14.042087 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f14011-c352-4219-b6a5-14778b0c5b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:14.042482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f14011-c352-4219-b6a5-14778b0c5b19 admin admin] PATH_INFO: `/v3/projects/da09c37173634c1cae0c84c546e327a9` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:14.047338 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f14011-c352-4219-b6a5-14778b0c5b19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da09c37173634c1cae0c84c546e327a9)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:14.047825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 851/1681] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:14.049922 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f14011-c352-4219-b6a5-14778b0c5b19 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:14.057943 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a09a3-b9d3-4fdb-832b-c8fce9b47425 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:14.058504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a09a3-b9d3-4fdb-832b-c8fce9b47425 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:14.058504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a09a3-b9d3-4fdb-832b-c8fce9b47425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:14.138320 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9d1a09a3-b9d3-4fdb-832b-c8fce9b47425 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:14.139629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9d1a09a3-b9d3-4fdb-832b-c8fce9b47425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:14.178466 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f0f14011-c352-4219-b6a5-14778b0c5b19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da09c37173634c1cae0c84c546e327a9', 'request_id': 'req-f0f14011-c352-4219-b6a5-14778b0c5b19'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.191257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f0f14011-c352-4219-b6a5-14778b0c5b19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da09c37173634c1cae0c84c546e327a9', 'request_id': 'req-f0f14011-c352-4219-b6a5-14778b0c5b19'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.208311 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f0f14011-c352-4219-b6a5-14778b0c5b19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da09c37173634c1cae0c84c546e327a9', 'request_id': 'req-f0f14011-c352-4219-b6a5-14778b0c5b19'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.229791 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f0f14011-c352-4219-b6a5-14778b0c5b19 admin admin] The token cache is being invalidate because project da09c37173634c1cae0c84c546e327a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:55:14.230263 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f0f14011-c352-4219-b6a5-14778b0c5b19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.231233 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f0f14011-c352-4219-b6a5-14778b0c5b19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.233579 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 831/1682] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:55:13 2022] DELETE /identity/v3/projects/da09c37173634c1cae0c84c546e327a9 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:14.235967 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f14011-c352-4219-b6a5-14778b0c5b19 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:14.239977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f0f14011-c352-4219-b6a5-14778b0c5b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:14.274944 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 852/1683] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:14.282412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907399a-5124-494c-887d-dcb367c44285 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:14.282711 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907399a-5124-494c-887d-dcb367c44285 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:14.283128 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907399a-5124-494c-887d-dcb367c44285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:14.327406 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f907399a-5124-494c-887d-dcb367c44285 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:14.328644 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f907399a-5124-494c-887d-dcb367c44285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:14.366484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 853/1684] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:14.366484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907399a-5124-494c-887d-dcb367c44285 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:14.368798 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f14011-c352-4219-b6a5-14778b0c5b19 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:14.390129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907399a-5124-494c-887d-dcb367c44285 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:14.391250 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2caa93-e289-4951-a4f5-fdcd5f4f8719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:14.397238 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2caa93-e289-4951-a4f5-fdcd5f4f8719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:14.397238 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2caa93-e289-4951-a4f5-fdcd5f4f8719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:14.397238 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2caa93-e289-4951-a4f5-fdcd5f4f8719 admin admin] PATH_INFO: `/v3/projects/3b8c74e8031b4780aded4b0dd3e5bbc8` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:14.398065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2caa93-e289-4951-a4f5-fdcd5f4f8719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b8c74e8031b4780aded4b0dd3e5bbc8)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:14.400076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2caa93-e289-4951-a4f5-fdcd5f4f8719 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:14.414822 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45651a03-6fe7-44af-a5c9-390a81a67377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:14.422237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45651a03-6fe7-44af-a5c9-390a81a67377 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:14.422509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45651a03-6fe7-44af-a5c9-390a81a67377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:14.422795 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45651a03-6fe7-44af-a5c9-390a81a67377 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:14.423605 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45651a03-6fe7-44af-a5c9-390a81a67377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:55:14.423920 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45651a03-6fe7-44af-a5c9-390a81a67377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:14.425623 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45651a03-6fe7-44af-a5c9-390a81a67377 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:14.478528 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 854/1685] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:55:14.479968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bab455-979a-4beb-acec-6b6f61191eec None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:14.480399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bab455-979a-4beb-acec-6b6f61191eec None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:14.480536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bab455-979a-4beb-acec-6b6f61191eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:14.520120 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-65bab455-979a-4beb-acec-6b6f61191eec None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:14.521915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-65bab455-979a-4beb-acec-6b6f61191eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:14.526343 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3a2caa93-e289-4951-a4f5-fdcd5f4f8719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b8c74e8031b4780aded4b0dd3e5bbc8', 'request_id': 'req-3a2caa93-e289-4951-a4f5-fdcd5f4f8719'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.542864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3a2caa93-e289-4951-a4f5-fdcd5f4f8719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b8c74e8031b4780aded4b0dd3e5bbc8', 'request_id': 'req-3a2caa93-e289-4951-a4f5-fdcd5f4f8719'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.562910 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3a2caa93-e289-4951-a4f5-fdcd5f4f8719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b8c74e8031b4780aded4b0dd3e5bbc8', 'request_id': 'req-3a2caa93-e289-4951-a4f5-fdcd5f4f8719'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.590333 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3a2caa93-e289-4951-a4f5-fdcd5f4f8719 admin admin] The token cache is being invalidate because project 3b8c74e8031b4780aded4b0dd3e5bbc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:55:14.593932 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3a2caa93-e289-4951-a4f5-fdcd5f4f8719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.593932 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3a2caa93-e289-4951-a4f5-fdcd5f4f8719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.599937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 832/1686] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:55:14 2022] DELETE /identity/v3/projects/3b8c74e8031b4780aded4b0dd3e5bbc8 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:14.603274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2caa93-e289-4951-a4f5-fdcd5f4f8719 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:14.608859 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3a2caa93-e289-4951-a4f5-fdcd5f4f8719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:14.624641 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 855/1687] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:14.626266 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c19519-f2c2-49fd-b6f3-3e3a808e95ed None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:14.626754 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c19519-f2c2-49fd-b6f3-3e3a808e95ed None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:14.627380 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c19519-f2c2-49fd-b6f3-3e3a808e95ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:14.642523 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2caa93-e289-4951-a4f5-fdcd5f4f8719 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:14.652416 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759dbcb-874b-4298-b8e1-f2495173c0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:14.652866 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-19c19519-f2c2-49fd-b6f3-3e3a808e95ed None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:14.653304 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759dbcb-874b-4298-b8e1-f2495173c0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:14.653585 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759dbcb-874b-4298-b8e1-f2495173c0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:14.654556 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759dbcb-874b-4298-b8e1-f2495173c0e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:14.655084 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-19c19519-f2c2-49fd-b6f3-3e3a808e95ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:14.656204 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759dbcb-874b-4298-b8e1-f2495173c0e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:14.661030 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759dbcb-874b-4298-b8e1-f2495173c0e0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:14.666810 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 856/1688] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:14.667982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c19519-f2c2-49fd-b6f3-3e3a808e95ed None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:14.683045 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c19519-f2c2-49fd-b6f3-3e3a808e95ed None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:14.690509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff66f79-cf16-478f-ac1d-f2c52b473b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:14.691745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff66f79-cf16-478f-ac1d-f2c52b473b8c admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:14.692163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff66f79-cf16-478f-ac1d-f2c52b473b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:14.692697 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff66f79-cf16-478f-ac1d-f2c52b473b8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:14.693751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff66f79-cf16-478f-ac1d-f2c52b473b8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:55:14.694344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff66f79-cf16-478f-ac1d-f2c52b473b8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:14.696157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff66f79-cf16-478f-ac1d-f2c52b473b8c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:14.715522 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 857/1689] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:55:14.717413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c599cf0-93dc-4637-8330-03eb878b60fc None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:14.717889 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c599cf0-93dc-4637-8330-03eb878b60fc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:14.718435 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c599cf0-93dc-4637-8330-03eb878b60fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:14.729326 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 833/1690] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:14 2022] POST /identity/v3/projects => generated 393 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:14.734750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759dbcb-874b-4298-b8e1-f2495173c0e0 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:14.770434 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3c599cf0-93dc-4637-8330-03eb878b60fc None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:14.772284 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3c599cf0-93dc-4637-8330-03eb878b60fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:14.861562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759dbcb-874b-4298-b8e1-f2495173c0e0 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:14.874433 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63539eb6-f8cc-4de0-916f-1db4bc6216c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:14.875373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63539eb6-f8cc-4de0-916f-1db4bc6216c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:14.875480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63539eb6-f8cc-4de0-916f-1db4bc6216c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:14.875675 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63539eb6-f8cc-4de0-916f-1db4bc6216c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:14.878902 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63539eb6-f8cc-4de0-916f-1db4bc6216c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:14.882509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63539eb6-f8cc-4de0-916f-1db4bc6216c1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:14.907342 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 858/1691] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:14.908307 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c599cf0-93dc-4637-8330-03eb878b60fc None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:14.940296 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c599cf0-93dc-4637-8330-03eb878b60fc None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:14.954537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba43615-6e19-4a0f-91ea-4cb899ed5320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:14.955316 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba43615-6e19-4a0f-91ea-4cb899ed5320 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:14.955595 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba43615-6e19-4a0f-91ea-4cb899ed5320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:14.955881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba43615-6e19-4a0f-91ea-4cb899ed5320 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:14.956886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 834/1692] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:14 2022] POST /identity/v3/projects => generated 373 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:14.958021 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba43615-6e19-4a0f-91ea-4cb899ed5320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:14.961527 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63539eb6-f8cc-4de0-916f-1db4bc6216c1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:14.962987 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba43615-6e19-4a0f-91ea-4cb899ed5320 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:15.014789 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 859/1693] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:14 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:15.015795 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba43615-6e19-4a0f-91ea-4cb899ed5320 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:15.032628 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba43615-6e19-4a0f-91ea-4cb899ed5320 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:15.053606 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63539eb6-f8cc-4de0-916f-1db4bc6216c1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:15.059528 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bc121-6edc-4662-ae5a-f848d40ec8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:15.059702 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bc121-6edc-4662-ae5a-f848d40ec8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:15.059983 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bc121-6edc-4662-ae5a-f848d40ec8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:15.060254 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bc121-6edc-4662-ae5a-f848d40ec8c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:15.060990 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bc121-6edc-4662-ae5a-f848d40ec8c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:55:15.061361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bc121-6edc-4662-ae5a-f848d40ec8c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:15.063314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bc121-6edc-4662-ae5a-f848d40ec8c9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:15.076093 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 835/1694] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:55:15.077647 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bc121-6edc-4662-ae5a-f848d40ec8c9 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:15.089006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bc121-6edc-4662-ae5a-f848d40ec8c9 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:15.099694 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c79b81-9eb3-48d8-af9f-cf89c2726ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:15.101039 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c79b81-9eb3-48d8-af9f-cf89c2726ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:15.101649 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c79b81-9eb3-48d8-af9f-cf89c2726ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:15.101649 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c79b81-9eb3-48d8-af9f-cf89c2726ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:15.102284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c79b81-9eb3-48d8-af9f-cf89c2726ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:15.106020 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c79b81-9eb3-48d8-af9f-cf89c2726ce1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:15.132826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 836/1695] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:15.133794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c79b81-9eb3-48d8-af9f-cf89c2726ce1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:15.148235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c79b81-9eb3-48d8-af9f-cf89c2726ce1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:15.163739 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fabdc4-72ff-45f1-b884-d2c8514ac96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:15.164390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fabdc4-72ff-45f1-b884-d2c8514ac96b admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:15.164669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fabdc4-72ff-45f1-b884-d2c8514ac96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:15.164943 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fabdc4-72ff-45f1-b884-d2c8514ac96b admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:15.168516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fabdc4-72ff-45f1-b884-d2c8514ac96b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:15.169428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f36139-9e61-4cb3-b243-b9e60c46960c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:15.171340 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f36139-9e61-4cb3-b243-b9e60c46960c admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:15.171340 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f36139-9e61-4cb3-b243-b9e60c46960c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:15.171340 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f36139-9e61-4cb3-b243-b9e60c46960c admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:15.172996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fabdc4-72ff-45f1-b884-d2c8514ac96b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:15.174777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f36139-9e61-4cb3-b243-b9e60c46960c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:15.176923 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f36139-9e61-4cb3-b243-b9e60c46960c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:15.234376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 860/1696] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:15 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:15.235281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f36139-9e61-4cb3-b243-b9e60c46960c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:15.253887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 837/1697] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:15 2022] POST /identity/v3/projects => generated 363 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:15.254995 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fabdc4-72ff-45f1-b884-d2c8514ac96b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:15.288762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f36139-9e61-4cb3-b243-b9e60c46960c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:15.486994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1004b-6844-4256-b587-226e7da0440a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:15.486994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1004b-6844-4256-b587-226e7da0440a admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:15.486994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1004b-6844-4256-b587-226e7da0440a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:15.486994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1004b-6844-4256-b587-226e7da0440a admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:15.487392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1004b-6844-4256-b587-226e7da0440a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:15.487392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1004b-6844-4256-b587-226e7da0440a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:15.491614 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fabdc4-72ff-45f1-b884-d2c8514ac96b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:15.511928 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 861/1698] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:15.517606 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168519b-31bd-441b-8248-d8d5cd158c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:15.518313 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168519b-31bd-441b-8248-d8d5cd158c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:15.518601 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168519b-31bd-441b-8248-d8d5cd158c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:15.518881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168519b-31bd-441b-8248-d8d5cd158c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:15.519729 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168519b-31bd-441b-8248-d8d5cd158c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:15.521388 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168519b-31bd-441b-8248-d8d5cd158c88 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:15.535475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1004b-6844-4256-b587-226e7da0440a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:15.559098 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 838/1699] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:15.559940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168519b-31bd-441b-8248-d8d5cd158c88 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:15.566148 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1004b-6844-4256-b587-226e7da0440a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:15.581882 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01644d12-cb8e-4477-90cf-66e7e102bb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:15.582582 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01644d12-cb8e-4477-90cf-66e7e102bb4b admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:15.583398 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01644d12-cb8e-4477-90cf-66e7e102bb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:15.584959 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01644d12-cb8e-4477-90cf-66e7e102bb4b admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:15.586652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01644d12-cb8e-4477-90cf-66e7e102bb4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:15.587588 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168519b-31bd-441b-8248-d8d5cd158c88 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:15.610453 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01644d12-cb8e-4477-90cf-66e7e102bb4b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:15.617999 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116444bf-6c8f-4c85-b196-4ec9479ae56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:15.619330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116444bf-6c8f-4c85-b196-4ec9479ae56e admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:15.619618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116444bf-6c8f-4c85-b196-4ec9479ae56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:15.619893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116444bf-6c8f-4c85-b196-4ec9479ae56e admin admin] PATH_INFO: `/v3/projects/429eee4244e64a58994e98973467faa0/users/453885a038634571b6ad63ff2da576a8/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:15.662685 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 862/1700] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:15 2022] POST /identity/v3/users => generated 282 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:15.663565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01644d12-cb8e-4477-90cf-66e7e102bb4b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:15.677641 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116444bf-6c8f-4c85-b196-4ec9479ae56e admin admin] RBAC: Authorizing `identity:create_grant(project_id=429eee4244e64a58994e98973467faa0, user_id=453885a038634571b6ad63ff2da576a8, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:15.691350 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116444bf-6c8f-4c85-b196-4ec9479ae56e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:15.710708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01644d12-cb8e-4477-90cf-66e7e102bb4b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:15.720047 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0d63b-0434-430f-88f0-08761d22bcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:15.720969 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0d63b-0434-430f-88f0-08761d22bcf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:15.721382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0d63b-0434-430f-88f0-08761d22bcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:15.721794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0d63b-0434-430f-88f0-08761d22bcf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:15.722801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0d63b-0434-430f-88f0-08761d22bcf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:15.725002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0d63b-0434-430f-88f0-08761d22bcf9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:15.741882 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 839/1701] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:15 2022] PUT /identity/v3/projects/429eee4244e64a58994e98973467faa0/users/453885a038634571b6ad63ff2da576a8/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:15.741882 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116444bf-6c8f-4c85-b196-4ec9479ae56e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:15.750418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 863/1702] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:15.752056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee500674-7c20-41db-af6c-d4fee10c76f3 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:15.752481 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee500674-7c20-41db-af6c-d4fee10c76f3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:15.753200 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee500674-7c20-41db-af6c-d4fee10c76f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:15.810278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ee500674-7c20-41db-af6c-d4fee10c76f3 None None] MFA Rules not processed for user `453885a038634571b6ad63ff2da576a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:15.811931 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ee500674-7c20-41db-af6c-d4fee10c76f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:15.873474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116444bf-6c8f-4c85-b196-4ec9479ae56e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:15.898470 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed8422-080e-45da-a30a-6edcbfbc9b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:15.905266 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed8422-080e-45da-a30a-6edcbfbc9b98 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:15.909123 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed8422-080e-45da-a30a-6edcbfbc9b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:15.909417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed8422-080e-45da-a30a-6edcbfbc9b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:15.910197 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed8422-080e-45da-a30a-6edcbfbc9b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:15.912025 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed8422-080e-45da-a30a-6edcbfbc9b98 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:15.968832 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 840/1703] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:15.969722 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed8422-080e-45da-a30a-6edcbfbc9b98 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:15.992156 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed8422-080e-45da-a30a-6edcbfbc9b98 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:16.006068 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97eed41-d430-4737-bf4f-25a7fc387127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:16.006939 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97eed41-d430-4737-bf4f-25a7fc387127 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:16.007249 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97eed41-d430-4737-bf4f-25a7fc387127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:16.007575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97eed41-d430-4737-bf4f-25a7fc387127 admin admin] PATH_INFO: `/v3/projects/4756c05ea0d04c98bb14feb948573710/users/3bdd869c2f234f308d9e5646806adaf8/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:16.016054 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 864/1704] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:16.017399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee500674-7c20-41db-af6c-d4fee10c76f3 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:16.045896 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee500674-7c20-41db-af6c-d4fee10c76f3 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:16.050924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97eed41-d430-4737-bf4f-25a7fc387127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4756c05ea0d04c98bb14feb948573710, user_id=3bdd869c2f234f308d9e5646806adaf8, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:16.055105 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97eed41-d430-4737-bf4f-25a7fc387127 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:16.062141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379620d-138e-49b3-9116-bc6fa7335031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:16.062927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379620d-138e-49b3-9116-bc6fa7335031 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:16.066173 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379620d-138e-49b3-9116-bc6fa7335031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:16.068847 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379620d-138e-49b3-9116-bc6fa7335031 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:16.070744 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379620d-138e-49b3-9116-bc6fa7335031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:16.075423 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379620d-138e-49b3-9116-bc6fa7335031 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:16.096203 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 841/1705] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:15 2022] PUT /identity/v3/projects/4756c05ea0d04c98bb14feb948573710/users/3bdd869c2f234f308d9e5646806adaf8/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:16.098202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97eed41-d430-4737-bf4f-25a7fc387127 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:16.118833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 865/1706] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:16.122180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721de35e-5bf8-4031-a218-986bc9b8d527 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:16.123527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721de35e-5bf8-4031-a218-986bc9b8d527 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:16.125102 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721de35e-5bf8-4031-a218-986bc9b8d527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:16.218005 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-721de35e-5bf8-4031-a218-986bc9b8d527 None None] MFA Rules not processed for user `3bdd869c2f234f308d9e5646806adaf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:16.220720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-721de35e-5bf8-4031-a218-986bc9b8d527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:16.305461 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97eed41-d430-4737-bf4f-25a7fc387127 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:16.318239 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b7bf7-a1ca-4a64-8957-98f7fc4727e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:16.321316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b7bf7-a1ca-4a64-8957-98f7fc4727e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:16.321678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b7bf7-a1ca-4a64-8957-98f7fc4727e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:16.322033 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b7bf7-a1ca-4a64-8957-98f7fc4727e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:16.322820 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b7bf7-a1ca-4a64-8957-98f7fc4727e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:16.327294 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b7bf7-a1ca-4a64-8957-98f7fc4727e5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:16.370015 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 866/1707] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:16.370015 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721de35e-5bf8-4031-a218-986bc9b8d527 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:16.370596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 842/1708] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:16 2022] POST /identity/v3/projects => generated 391 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:16.374171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526a856-60d9-4749-9b85-3f9706b072ad None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:16.374463 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526a856-60d9-4749-9b85-3f9706b072ad None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:16.375964 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526a856-60d9-4749-9b85-3f9706b072ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:16.400237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721de35e-5bf8-4031-a218-986bc9b8d527 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:16.425457 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1526a856-60d9-4749-9b85-3f9706b072ad None None] MFA Rules not processed for user `63548f8706214c4e9b116dfd89fc0372`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:16.426928 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1526a856-60d9-4749-9b85-3f9706b072ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:16.483139 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e194b3-042e-4583-88ae-6c026da7b510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:16.484767 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e194b3-042e-4583-88ae-6c026da7b510 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:16.485047 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e194b3-042e-4583-88ae-6c026da7b510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:16.485322 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e194b3-042e-4583-88ae-6c026da7b510 admin admin] PATH_INFO: `/v3/projects/ae69cddb39244d658156c8eabaa8fbfc/users/9863e5587ac348ce877f6c2b1b6ddf99/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:16.510800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e194b3-042e-4583-88ae-6c026da7b510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae69cddb39244d658156c8eabaa8fbfc, user_id=9863e5587ac348ce877f6c2b1b6ddf99, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:16.515416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e194b3-042e-4583-88ae-6c026da7b510 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:16.538676 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 867/1709] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:16 2022] PUT /identity/v3/projects/ae69cddb39244d658156c8eabaa8fbfc/users/9863e5587ac348ce877f6c2b1b6ddf99/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:16.539937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e194b3-042e-4583-88ae-6c026da7b510 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:16.542713 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 843/1710] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:16.543707 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526a856-60d9-4749-9b85-3f9706b072ad None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:16.545063 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1526a856-60d9-4749-9b85-3f9706b072ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:16.660158 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526a856-60d9-4749-9b85-3f9706b072ad None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:16.662696 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e194b3-042e-4583-88ae-6c026da7b510 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:16.668892 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1dc03-db81-47ec-be68-2ec013b3412b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:16.670326 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1dc03-db81-47ec-be68-2ec013b3412b admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:16.670825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1dc03-db81-47ec-be68-2ec013b3412b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:16.671344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1dc03-db81-47ec-be68-2ec013b3412b admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:16.672621 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1dc03-db81-47ec-be68-2ec013b3412b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:16.674910 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1dc03-db81-47ec-be68-2ec013b3412b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:16.721951 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 868/1711] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:16 2022] POST /identity/v3/users => generated 302 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:16.723755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c4a3a-4c02-49c0-98f0-fffcf7bf52c2 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:16.727249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c4a3a-4c02-49c0-98f0-fffcf7bf52c2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:16.727668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c4a3a-4c02-49c0-98f0-fffcf7bf52c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:16.776727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2a5c4a3a-4c02-49c0-98f0-fffcf7bf52c2 None None] MFA Rules not processed for user `63548f8706214c4e9b116dfd89fc0372`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:16.778037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2a5c4a3a-4c02-49c0-98f0-fffcf7bf52c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:16.807445 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a0d08-496b-424c-84a0-6e155a3d4589 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:16.808548 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a0d08-496b-424c-84a0-6e155a3d4589 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:16.809026 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a0d08-496b-424c-84a0-6e155a3d4589 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:16.809634 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a0d08-496b-424c-84a0-6e155a3d4589 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:16.874043 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a0d08-496b-424c-84a0-6e155a3d4589 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:16.876079 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a0d08-496b-424c-84a0-6e155a3d4589 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:16.886565 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 844/1712] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:16.888535 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddea87-06c9-4b18-b7bb-a5ebe0028f34 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:16.889024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddea87-06c9-4b18-b7bb-a5ebe0028f34 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:16.889596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddea87-06c9-4b18-b7bb-a5ebe0028f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:16.922903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 869/1713] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:16.924156 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c4a3a-4c02-49c0-98f0-fffcf7bf52c2 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:16.925509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a3ddea87-06c9-4b18-b7bb-a5ebe0028f34 None None] MFA Rules not processed for user `9863e5587ac348ce877f6c2b1b6ddf99`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:16.927461 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a3ddea87-06c9-4b18-b7bb-a5ebe0028f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:16.936689 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c4a3a-4c02-49c0-98f0-fffcf7bf52c2 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:16.942119 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b584a6-e30e-49f0-bdf6-0daf206a5be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:16.943159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b584a6-e30e-49f0-bdf6-0daf206a5be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:16.943450 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b584a6-e30e-49f0-bdf6-0daf206a5be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:16.943731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b584a6-e30e-49f0-bdf6-0daf206a5be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:16.944805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b584a6-e30e-49f0-bdf6-0daf206a5be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:16.946492 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b584a6-e30e-49f0-bdf6-0daf206a5be4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:16.962562 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 870/1714] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:16.966713 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b584a6-e30e-49f0-bdf6-0daf206a5be4 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:16.981289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b584a6-e30e-49f0-bdf6-0daf206a5be4 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:16.986906 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cb0e2-8631-49d5-9a6f-d97f79688713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:16.988033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cb0e2-8631-49d5-9a6f-d97f79688713 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:16.988454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cb0e2-8631-49d5-9a6f-d97f79688713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:16.988868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cb0e2-8631-49d5-9a6f-d97f79688713 admin admin] PATH_INFO: `/v3/projects/4e63931060e14f8c947eb9e28ee6f0a7/users/cc9e189ef42b4fea813361af1f64a6d0/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:17.018357 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642cb0e2-8631-49d5-9a6f-d97f79688713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e63931060e14f8c947eb9e28ee6f0a7, user_id=cc9e189ef42b4fea813361af1f64a6d0, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:17.022370 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642cb0e2-8631-49d5-9a6f-d97f79688713 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:17.049529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 871/1715] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:16 2022] PUT /identity/v3/projects/4e63931060e14f8c947eb9e28ee6f0a7/users/cc9e189ef42b4fea813361af1f64a6d0/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:17.051982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cb0e2-8631-49d5-9a6f-d97f79688713 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:17.075260 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 845/1716] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:16 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:17.078839 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddea87-06c9-4b18-b7bb-a5ebe0028f34 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:17.120864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddea87-06c9-4b18-b7bb-a5ebe0028f34 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:17.146251 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cb0e2-8631-49d5-9a6f-d97f79688713 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:17.154582 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab218b-2d91-4c0e-b3f1-4bb28afd7ffe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:17.155365 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab218b-2d91-4c0e-b3f1-4bb28afd7ffe service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:17.155714 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab218b-2d91-4c0e-b3f1-4bb28afd7ffe service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:17.156062 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab218b-2d91-4c0e-b3f1-4bb28afd7ffe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:17.245656 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab218b-2d91-4c0e-b3f1-4bb28afd7ffe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:17.250116 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab218b-2d91-4c0e-b3f1-4bb28afd7ffe service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:17.256974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13a4a7-4c0b-4d70-875f-e1fbb9f005dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:17.257685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13a4a7-4c0b-4d70-875f-e1fbb9f005dd admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:17.257973 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13a4a7-4c0b-4d70-875f-e1fbb9f005dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:17.259486 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13a4a7-4c0b-4d70-875f-e1fbb9f005dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:17.259486 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13a4a7-4c0b-4d70-875f-e1fbb9f005dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:17.260626 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13a4a7-4c0b-4d70-875f-e1fbb9f005dd admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:17.264785 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 872/1717] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:17.265999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab218b-2d91-4c0e-b3f1-4bb28afd7ffe service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:17.282053 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 846/1718] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:17.284083 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab218b-2d91-4c0e-b3f1-4bb28afd7ffe service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:17.285569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13a4a7-4c0b-4d70-875f-e1fbb9f005dd admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:17.289927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0dcbd7-f1b6-407a-be0f-be9cd19c3292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:17.290813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dcbd7-f1b6-407a-be0f-be9cd19c3292 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:17.291206 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dcbd7-f1b6-407a-be0f-be9cd19c3292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:17.291555 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dcbd7-f1b6-407a-be0f-be9cd19c3292 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:17.292485 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0dcbd7-f1b6-407a-be0f-be9cd19c3292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:17.294660 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0dcbd7-f1b6-407a-be0f-be9cd19c3292 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:17.326035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13a4a7-4c0b-4d70-875f-e1fbb9f005dd admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:17.336030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 873/1719] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:17 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:17.336030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0dcbd7-f1b6-407a-be0f-be9cd19c3292 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:17.340645 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a0abc-850f-4b1a-b8d8-793d2caf4708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:17.341568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a0abc-850f-4b1a-b8d8-793d2caf4708 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:17.341850 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a0abc-850f-4b1a-b8d8-793d2caf4708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:17.342125 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a0abc-850f-4b1a-b8d8-793d2caf4708 admin admin] PATH_INFO: `/v3/projects/4e63931060e14f8c947eb9e28ee6f0a7/users/cc9e189ef42b4fea813361af1f64a6d0/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:17.348370 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a0abc-850f-4b1a-b8d8-793d2caf4708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e63931060e14f8c947eb9e28ee6f0a7, user_id=cc9e189ef42b4fea813361af1f64a6d0, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:17.351049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a0abc-850f-4b1a-b8d8-793d2caf4708 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:17.375869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 847/1720] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:17 2022] PUT /identity/v3/projects/4e63931060e14f8c947eb9e28ee6f0a7/users/cc9e189ef42b4fea813361af1f64a6d0/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:17.376776 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a0abc-850f-4b1a-b8d8-793d2caf4708 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:17.422789 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0dcbd7-f1b6-407a-be0f-be9cd19c3292 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:17.497419 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a0253-f0f8-4654-b203-6da4c8d8c89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:17.498273 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a0253-f0f8-4654-b203-6da4c8d8c89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:17.498562 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a0253-f0f8-4654-b203-6da4c8d8c89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:17.498916 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a0253-f0f8-4654-b203-6da4c8d8c89a admin admin] PATH_INFO: `/v3/users/3bdd869c2f234f308d9e5646806adaf8` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:17.500179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a0253-f0f8-4654-b203-6da4c8d8c89a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bdd869c2f234f308d9e5646806adaf8)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:17.503022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a0253-f0f8-4654-b203-6da4c8d8c89a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:17.511639 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a0abc-850f-4b1a-b8d8-793d2caf4708 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:17.518189 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f44d91-0c3d-4049-9449-0fda5ef6e7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:17.519194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f44d91-0c3d-4049-9449-0fda5ef6e7e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:17.519673 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f44d91-0c3d-4049-9449-0fda5ef6e7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:17.520164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f44d91-0c3d-4049-9449-0fda5ef6e7e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:17.521055 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f44d91-0c3d-4049-9449-0fda5ef6e7e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:17.523587 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f44d91-0c3d-4049-9449-0fda5ef6e7e0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:17.566278 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 848/1721] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:17 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:17.572476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf44345-9529-4272-b84e-c5f22edd6272 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:17.572964 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf44345-9529-4272-b84e-c5f22edd6272 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:17.573844 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf44345-9529-4272-b84e-c5f22edd6272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:17.614554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-eaf44345-9529-4272-b84e-c5f22edd6272 None None] MFA Rules not processed for user `cc9e189ef42b4fea813361af1f64a6d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:17.616284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-eaf44345-9529-4272-b84e-c5f22edd6272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:17.617804 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f96a0253-f0f8-4654-b203-6da4c8d8c89a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bdd869c2f234f308d9e5646806adaf8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:17.644937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f96a0253-f0f8-4654-b203-6da4c8d8c89a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bdd869c2f234f308d9e5646806adaf8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:17.646970 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f96a0253-f0f8-4654-b203-6da4c8d8c89a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bdd869c2f234f308d9e5646806adaf8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:17.647721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f96a0253-f0f8-4654-b203-6da4c8d8c89a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bdd869c2f234f308d9e5646806adaf8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:17.667182 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f96a0253-f0f8-4654-b203-6da4c8d8c89a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bdd869c2f234f308d9e5646806adaf8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:17.693588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 874/1722] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:55:17 2022] DELETE /identity/v3/users/3bdd869c2f234f308d9e5646806adaf8 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:17.696425 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a0253-f0f8-4654-b203-6da4c8d8c89a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:17.700029 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f96a0253-f0f8-4654-b203-6da4c8d8c89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:17.715152 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 849/1723] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:17.717389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5405534-e0bc-47ad-9e7e-b035538a2dfd None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:17.718077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5405534-e0bc-47ad-9e7e-b035538a2dfd None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:17.728643 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5405534-e0bc-47ad-9e7e-b035538a2dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:17.758388 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f5405534-e0bc-47ad-9e7e-b035538a2dfd None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:17.759914 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f5405534-e0bc-47ad-9e7e-b035538a2dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:17.856424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 850/1724] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:17.857648 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5405534-e0bc-47ad-9e7e-b035538a2dfd None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:17.859774 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f5405534-e0bc-47ad-9e7e-b035538a2dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:17.878672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a0253-f0f8-4654-b203-6da4c8d8c89a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:17.899146 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5dbb7-1767-4309-9c6b-f495d2c68651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:17.899857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5dbb7-1767-4309-9c6b-f495d2c68651 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:17.900144 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5dbb7-1767-4309-9c6b-f495d2c68651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:17.900478 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5dbb7-1767-4309-9c6b-f495d2c68651 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:17.901262 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5dbb7-1767-4309-9c6b-f495d2c68651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:17.902999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5dbb7-1767-4309-9c6b-f495d2c68651 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:17.933253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 875/1725] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:17.934758 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5dbb7-1767-4309-9c6b-f495d2c68651 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:17.972264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5dbb7-1767-4309-9c6b-f495d2c68651 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:17.980675 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a4175-b67e-4b78-bd6f-146d7d3741f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:17.982476 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a4175-b67e-4b78-bd6f-146d7d3741f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:17.982888 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a4175-b67e-4b78-bd6f-146d7d3741f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:17.983354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a4175-b67e-4b78-bd6f-146d7d3741f8 admin admin] PATH_INFO: `/v3/projects/52037d5d6253430e81a756b993b97172/users/94600fd74a394b5bb1a1226fbadef694/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:18.028587 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a4175-b67e-4b78-bd6f-146d7d3741f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52037d5d6253430e81a756b993b97172, user_id=94600fd74a394b5bb1a1226fbadef694, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:18.031668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a4175-b67e-4b78-bd6f-146d7d3741f8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:18.039870 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5405534-e0bc-47ad-9e7e-b035538a2dfd None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:18.059808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9e366-af37-4777-b2b4-e7f9ed776845 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:18.065432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 876/1726] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:17 2022] PUT /identity/v3/projects/52037d5d6253430e81a756b993b97172/users/94600fd74a394b5bb1a1226fbadef694/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:18.065432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a4175-b67e-4b78-bd6f-146d7d3741f8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:18.067697 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9e366-af37-4777-b2b4-e7f9ed776845 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:18.067865 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ab6a4175-b67e-4b78-bd6f-146d7d3741f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:18.068716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9e366-af37-4777-b2b4-e7f9ed776845 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:18.069175 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9e366-af37-4777-b2b4-e7f9ed776845 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:18.216515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9e366-af37-4777-b2b4-e7f9ed776845 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:18.219271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9e366-af37-4777-b2b4-e7f9ed776845 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:18.262760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 851/1727] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:18.267425 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9e366-af37-4777-b2b4-e7f9ed776845 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:18.287737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a4175-b67e-4b78-bd6f-146d7d3741f8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:18.312214 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192dbaf-8e68-4fc2-9c0c-98142b433aa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:18.314331 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192dbaf-8e68-4fc2-9c0c-98142b433aa9 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:18.315982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192dbaf-8e68-4fc2-9c0c-98142b433aa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:18.317724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192dbaf-8e68-4fc2-9c0c-98142b433aa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:18.319959 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9e366-af37-4777-b2b4-e7f9ed776845 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:18.495223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f158eb0-3729-43a6-b23c-377bc96278aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:18.497350 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f158eb0-3729-43a6-b23c-377bc96278aa admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:18.497773 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f158eb0-3729-43a6-b23c-377bc96278aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:18.498185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f158eb0-3729-43a6-b23c-377bc96278aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:18.499137 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f158eb0-3729-43a6-b23c-377bc96278aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:18.505407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f158eb0-3729-43a6-b23c-377bc96278aa admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:18.531619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 852/1728] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:18.532887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f158eb0-3729-43a6-b23c-377bc96278aa admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:18.719583 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f158eb0-3729-43a6-b23c-377bc96278aa admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:18.738714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bac200-ba67-43c8-9de6-55b31d0f107d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:18.739468 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bac200-ba67-43c8-9de6-55b31d0f107d service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:18.739786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bac200-ba67-43c8-9de6-55b31d0f107d service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:18.740061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bac200-ba67-43c8-9de6-55b31d0f107d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:18.747389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c9bac200-ba67-43c8-9de6-55b31d0f107d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:18.984582 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bac200-ba67-43c8-9de6-55b31d0f107d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:18.990631 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bac200-ba67-43c8-9de6-55b31d0f107d service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:19.023019 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 853/1729] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:19.025611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bac200-ba67-43c8-9de6-55b31d0f107d service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:19.030794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192dbaf-8e68-4fc2-9c0c-98142b433aa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:19.032327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192dbaf-8e68-4fc2-9c0c-98142b433aa9 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:19.066423 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bac200-ba67-43c8-9de6-55b31d0f107d service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:19.070443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 877/1730] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 1007 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:19.091739 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7aa489-d119-4bb6-aecf-536b7e0161fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:19.093493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aa489-d119-4bb6-aecf-536b7e0161fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:19.093923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aa489-d119-4bb6-aecf-536b7e0161fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:19.094320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aa489-d119-4bb6-aecf-536b7e0161fc admin admin] PATH_INFO: `/v3/projects/52037d5d6253430e81a756b993b97172/users/94600fd74a394b5bb1a1226fbadef694/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:19.100086 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7aa489-d119-4bb6-aecf-536b7e0161fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=52037d5d6253430e81a756b993b97172, user_id=94600fd74a394b5bb1a1226fbadef694, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:19.107162 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7aa489-d119-4bb6-aecf-536b7e0161fc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:19.158775 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 854/1731] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:19 2022] PUT /identity/v3/projects/52037d5d6253430e81a756b993b97172/users/94600fd74a394b5bb1a1226fbadef694/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:19.170193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62845a38-2a5d-45e3-aa92-7d2d9e4ea208 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:19.173946 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62845a38-2a5d-45e3-aa92-7d2d9e4ea208 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:19.174864 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62845a38-2a5d-45e3-aa92-7d2d9e4ea208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:19.279780 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-62845a38-2a5d-45e3-aa92-7d2d9e4ea208 None None] MFA Rules not processed for user `94600fd74a394b5bb1a1226fbadef694`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:19.283519 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-62845a38-2a5d-45e3-aa92-7d2d9e4ea208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:19.636672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 878/1732] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:19 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:19.796410 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7aa489-d119-4bb6-aecf-536b7e0161fc admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:19.909379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7aa489-d119-4bb6-aecf-536b7e0161fc admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:19.913421 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c67530-2733-4307-945e-fa79655c6be8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:19.914934 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c67530-2733-4307-945e-fa79655c6be8 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:19.915291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c67530-2733-4307-945e-fa79655c6be8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:19.915675 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c67530-2733-4307-945e-fa79655c6be8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:19.928764 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c67530-2733-4307-945e-fa79655c6be8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:19.930397 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c67530-2733-4307-945e-fa79655c6be8 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:19.943020 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 855/1733] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:19 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:20.105497 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62845a38-2a5d-45e3-aa92-7d2d9e4ea208 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:20.139758 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62845a38-2a5d-45e3-aa92-7d2d9e4ea208 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:20.158549 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ae1d2-f20c-446f-b778-74c3fdcac80c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:20.166424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ae1d2-f20c-446f-b778-74c3fdcac80c service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:20.166712 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ae1d2-f20c-446f-b778-74c3fdcac80c service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:20.167013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ae1d2-f20c-446f-b778-74c3fdcac80c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:20.187070 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-009ae1d2-f20c-446f-b778-74c3fdcac80c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:20.224060 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbbb69-f03a-46d3-85f4-22302b91aa99 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:20.224589 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbbb69-f03a-46d3-85f4-22302b91aa99 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:20.224808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbbb69-f03a-46d3-85f4-22302b91aa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:20.286615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-12dbbb69-f03a-46d3-85f4-22302b91aa99 None None] MFA Rules not processed for user `63548f8706214c4e9b116dfd89fc0372`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:20.288192 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-12dbbb69-f03a-46d3-85f4-22302b91aa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:20.397787 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ae1d2-f20c-446f-b778-74c3fdcac80c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:20.400423 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ae1d2-f20c-446f-b778-74c3fdcac80c service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:20.424210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 879/1734] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:20 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:20.425538 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452d81c-abc5-4428-a307-7493c0d8a2db None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:20.425826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452d81c-abc5-4428-a307-7493c0d8a2db None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:20.426103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452d81c-abc5-4428-a307-7493c0d8a2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:20.469987 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 856/1735] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:20.488188 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0452d81c-abc5-4428-a307-7493c0d8a2db None None] MFA Rules not processed for user `99cbf80fc74c4183a6eed3e97f7196f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:20.489431 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0452d81c-abc5-4428-a307-7493c0d8a2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:20.582785 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697ef67-c03f-4c36-a4c7-794801664cd9 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:20.583660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697ef67-c03f-4c36-a4c7-794801664cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:20.583935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697ef67-c03f-4c36-a4c7-794801664cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:20.666244 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a697ef67-c03f-4c36-a4c7-794801664cd9 None None] MFA Rules not processed for user `3abe8bdd0c8948eb97dcc7292359520c`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:20.667528 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a697ef67-c03f-4c36-a4c7-794801664cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:20.690619 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 880/1736] 10.222.0.77 () {58 vars in 1009 bytes} [Wed May 11 06:55:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:20.912156 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 857/1737] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:55:20.927614 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452d81c-abc5-4428-a307-7493c0d8a2db None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:20.929054 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0452d81c-abc5-4428-a307-7493c0d8a2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:21.054023 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697ef67-c03f-4c36-a4c7-794801664cd9 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:21.059436 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a697ef67-c03f-4c36-a4c7-794801664cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:21.136370 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452d81c-abc5-4428-a307-7493c0d8a2db None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:21.161227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc27ab-e245-4567-b4c7-7f306b9b8d05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:21.161926 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc27ab-e245-4567-b4c7-7f306b9b8d05 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:21.162216 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc27ab-e245-4567-b4c7-7f306b9b8d05 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:21.162492 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc27ab-e245-4567-b4c7-7f306b9b8d05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:21.189425 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc27ab-e245-4567-b4c7-7f306b9b8d05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:21.192106 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc27ab-e245-4567-b4c7-7f306b9b8d05 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:21.231718 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 881/1738] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:21.364582 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697ef67-c03f-4c36-a4c7-794801664cd9 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:21.387234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28405d9-e7c9-492f-85c7-8a03dc5c5612 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f726f58d30734be7abf15400bff89533', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:21.388302 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28405d9-e7c9-492f-85c7-8a03dc5c5612 service swift] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:21.391585 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28405d9-e7c9-492f-85c7-8a03dc5c5612 service swift] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:21.392209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28405d9-e7c9-492f-85c7-8a03dc5c5612 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:21.422682 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28405d9-e7c9-492f-85c7-8a03dc5c5612 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:21.429568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28405d9-e7c9-492f-85c7-8a03dc5c5612 service swift] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:21.463696 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 858/1739] 10.222.0.77 () {60 vars in 1384 bytes} [Wed May 11 06:55:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 06:55:21.501452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc27ab-e245-4567-b4c7-7f306b9b8d05 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:21.502898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-51cc27ab-e245-4567-b4c7-7f306b9b8d05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:21.841918 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc27ab-e245-4567-b4c7-7f306b9b8d05 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:21.887775 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779cc2f-c8b6-4729-bc43-f47c20ab91ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:21.888897 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779cc2f-c8b6-4729-bc43-f47c20ab91ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:21.891892 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779cc2f-c8b6-4729-bc43-f47c20ab91ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:21.892366 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779cc2f-c8b6-4729-bc43-f47c20ab91ce admin admin] PATH_INFO: `/v3/projects/4756c05ea0d04c98bb14feb948573710` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:21.895870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779cc2f-c8b6-4729-bc43-f47c20ab91ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=4756c05ea0d04c98bb14feb948573710)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:21.902224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779cc2f-c8b6-4729-bc43-f47c20ab91ce admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:22.111535 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6779cc2f-c8b6-4729-bc43-f47c20ab91ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4756c05ea0d04c98bb14feb948573710', 'request_id': 'req-6779cc2f-c8b6-4729-bc43-f47c20ab91ce'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:22.130046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6779cc2f-c8b6-4729-bc43-f47c20ab91ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4756c05ea0d04c98bb14feb948573710', 'request_id': 'req-6779cc2f-c8b6-4729-bc43-f47c20ab91ce'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:22.170069 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6779cc2f-c8b6-4729-bc43-f47c20ab91ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4756c05ea0d04c98bb14feb948573710', 'request_id': 'req-6779cc2f-c8b6-4729-bc43-f47c20ab91ce'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:22.207857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6779cc2f-c8b6-4729-bc43-f47c20ab91ce admin admin] The token cache is being invalidate because project 4756c05ea0d04c98bb14feb948573710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:55:22.208313 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6779cc2f-c8b6-4729-bc43-f47c20ab91ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:22.209177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6779cc2f-c8b6-4729-bc43-f47c20ab91ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:22.214107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 882/1740] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:55:21 2022] DELETE /identity/v3/projects/4756c05ea0d04c98bb14feb948573710 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:22.218800 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc362a0-f628-4fbe-bb70-44ad74a32daf None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:22.219238 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc362a0-f628-4fbe-bb70-44ad74a32daf None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:22.219627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc362a0-f628-4fbe-bb70-44ad74a32daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:22.310085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2bc362a0-f628-4fbe-bb70-44ad74a32daf None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:22.316312 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2bc362a0-f628-4fbe-bb70-44ad74a32daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:22.676486 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 859/1741] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:22.685854 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1a26f-8f1c-4f43-b350-dcbea00f7e03 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:22.686516 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1a26f-8f1c-4f43-b350-dcbea00f7e03 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:22.686912 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1a26f-8f1c-4f43-b350-dcbea00f7e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:22.781937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0ae1a26f-8f1c-4f43-b350-dcbea00f7e03 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:22.791087 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0ae1a26f-8f1c-4f43-b350-dcbea00f7e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:22.836183 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 883/1742] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:55:22.840947 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc362a0-f628-4fbe-bb70-44ad74a32daf None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:22.850981 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc362a0-f628-4fbe-bb70-44ad74a32daf None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:22.885774 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192dff6-26b4-4b1f-a149-3ecd54b483bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:22.885774 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192dff6-26b4-4b1f-a149-3ecd54b483bd admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:22.885774 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192dff6-26b4-4b1f-a149-3ecd54b483bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:22.885774 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192dff6-26b4-4b1f-a149-3ecd54b483bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:22.886040 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192dff6-26b4-4b1f-a149-3ecd54b483bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:55:22.886040 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192dff6-26b4-4b1f-a149-3ecd54b483bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:22.886562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192dff6-26b4-4b1f-a149-3ecd54b483bd admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:22.982567 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 860/1743] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:55:22.990215 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1a26f-8f1c-4f43-b350-dcbea00f7e03 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:23.002048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1a26f-8f1c-4f43-b350-dcbea00f7e03 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:23.035711 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a60c2d-f36f-4756-bc70-bd38bb762d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:23.036781 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a60c2d-f36f-4756-bc70-bd38bb762d08 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:23.037860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a60c2d-f36f-4756-bc70-bd38bb762d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:23.038569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a60c2d-f36f-4756-bc70-bd38bb762d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:23.039457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a60c2d-f36f-4756-bc70-bd38bb762d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:23.057254 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a60c2d-f36f-4756-bc70-bd38bb762d08 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:23.178223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192dff6-26b4-4b1f-a149-3ecd54b483bd admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:23.181002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 884/1744] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:22 2022] POST /identity/v3/projects => generated 405 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:23.204795 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192dff6-26b4-4b1f-a149-3ecd54b483bd admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:23.544165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ba394-7073-46a8-bf26-33090e8a4b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:23.546727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ba394-7073-46a8-bf26-33090e8a4b7b admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:23.549250 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ba394-7073-46a8-bf26-33090e8a4b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:23.552342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ba394-7073-46a8-bf26-33090e8a4b7b admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:23.555050 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ba394-7073-46a8-bf26-33090e8a4b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:23.557681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ba394-7073-46a8-bf26-33090e8a4b7b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:23.630001 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 861/1745] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:23 2022] POST /identity/v3/users => generated 303 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:23.630997 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a60c2d-f36f-4756-bc70-bd38bb762d08 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:23.644044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a60c2d-f36f-4756-bc70-bd38bb762d08 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:23.670334 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65c89f-c6fb-44d6-a775-fcef3a431018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:23.674277 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65c89f-c6fb-44d6-a775-fcef3a431018 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:23.675327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65c89f-c6fb-44d6-a775-fcef3a431018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:23.681629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65c89f-c6fb-44d6-a775-fcef3a431018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:23.684596 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65c89f-c6fb-44d6-a775-fcef3a431018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:23.690443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65c89f-c6fb-44d6-a775-fcef3a431018 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:23.754006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ba394-7073-46a8-bf26-33090e8a4b7b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:23.770707 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ba394-7073-46a8-bf26-33090e8a4b7b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:23.775057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 885/1746] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:23.795664 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdfc94-d674-4825-a2af-51e1710544aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:23.798490 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdfc94-d674-4825-a2af-51e1710544aa admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:23.799096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdfc94-d674-4825-a2af-51e1710544aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:23.800315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdfc94-d674-4825-a2af-51e1710544aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:23.803459 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bdfc94-d674-4825-a2af-51e1710544aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:23.820615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bdfc94-d674-4825-a2af-51e1710544aa admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:23.870889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 862/1747] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:23.873270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65c89f-c6fb-44d6-a775-fcef3a431018 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:23.894028 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65c89f-c6fb-44d6-a775-fcef3a431018 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:23.907740 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf3a23-d75b-4cf9-a3f2-99a3e62e002d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:23.911152 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf3a23-d75b-4cf9-a3f2-99a3e62e002d admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:23.911152 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf3a23-d75b-4cf9-a3f2-99a3e62e002d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:23.911152 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf3a23-d75b-4cf9-a3f2-99a3e62e002d admin admin] PATH_INFO: `/v3/projects/7fc10a2342ea4e55bc59541b97dd61fe/users/e4cdb1f1c4ad4fd5a2ce893c7c9965cd/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:23.954153 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf3a23-d75b-4cf9-a3f2-99a3e62e002d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc10a2342ea4e55bc59541b97dd61fe, user_id=e4cdb1f1c4ad4fd5a2ce893c7c9965cd, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:23.958399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf3a23-d75b-4cf9-a3f2-99a3e62e002d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:23.999437 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 886/1748] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:23 2022] PUT /identity/v3/projects/7fc10a2342ea4e55bc59541b97dd61fe/users/e4cdb1f1c4ad4fd5a2ce893c7c9965cd/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:24.005400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c7fa0-982f-4003-bf78-b1250e88b731 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:24.005695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c7fa0-982f-4003-bf78-b1250e88b731 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:24.006165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c7fa0-982f-4003-bf78-b1250e88b731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:24.050418 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f90c7fa0-982f-4003-bf78-b1250e88b731 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:24.071118 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f90c7fa0-982f-4003-bf78-b1250e88b731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:24.267429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 863/1749] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:24.268103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf3a23-d75b-4cf9-a3f2-99a3e62e002d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:24.269960 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-30bf3a23-d75b-4cf9-a3f2-99a3e62e002d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:24.484702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf3a23-d75b-4cf9-a3f2-99a3e62e002d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:24.496146 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adde27c-d6fc-4b46-97a6-d2ff8d62235c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:24.499343 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adde27c-d6fc-4b46-97a6-d2ff8d62235c service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:24.501016 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adde27c-d6fc-4b46-97a6-d2ff8d62235c service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:24.504233 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adde27c-d6fc-4b46-97a6-d2ff8d62235c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:24.534291 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adde27c-d6fc-4b46-97a6-d2ff8d62235c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:24.536483 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adde27c-d6fc-4b46-97a6-d2ff8d62235c service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:24.614471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 887/1750] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:24.994406 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef36aef-432f-4544-8176-06fe29e14df0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:24.996105 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef36aef-432f-4544-8176-06fe29e14df0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:24.997905 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef36aef-432f-4544-8176-06fe29e14df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:25.137083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1ef36aef-432f-4544-8176-06fe29e14df0 None None] MFA Rules not processed for user `cffc26233de74f0ea2c438f588be3ade`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:25.139093 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1ef36aef-432f-4544-8176-06fe29e14df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:25.426152 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 864/1751] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:25.432090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adde27c-d6fc-4b46-97a6-d2ff8d62235c service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:25.433630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8adde27c-d6fc-4b46-97a6-d2ff8d62235c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:25.893696 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adde27c-d6fc-4b46-97a6-d2ff8d62235c service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:25.943914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b74c79-b488-4bc0-be00-166991cf4052 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:25.944541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b74c79-b488-4bc0-be00-166991cf4052 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:25.944957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b74c79-b488-4bc0-be00-166991cf4052 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:25.945237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b74c79-b488-4bc0-be00-166991cf4052 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:25.992481 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b74c79-b488-4bc0-be00-166991cf4052 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:26.023796 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b74c79-b488-4bc0-be00-166991cf4052 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:26.105570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 888/1752] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:26.232027 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef36aef-432f-4544-8176-06fe29e14df0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:26.234575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1ef36aef-432f-4544-8176-06fe29e14df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:26.290482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef36aef-432f-4544-8176-06fe29e14df0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:26.330271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5592f8c-09eb-4c89-9eb7-8f5aed837fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:26.331539 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5592f8c-09eb-4c89-9eb7-8f5aed837fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:26.332373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5592f8c-09eb-4c89-9eb7-8f5aed837fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:26.339592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5592f8c-09eb-4c89-9eb7-8f5aed837fc3 admin admin] PATH_INFO: `/v3/users/453885a038634571b6ad63ff2da576a8` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:26.352377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5592f8c-09eb-4c89-9eb7-8f5aed837fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=453885a038634571b6ad63ff2da576a8)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:26.368615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5592f8c-09eb-4c89-9eb7-8f5aed837fc3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:26.551535 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e5592f8c-09eb-4c89-9eb7-8f5aed837fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453885a038634571b6ad63ff2da576a8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:26.600937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e5592f8c-09eb-4c89-9eb7-8f5aed837fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453885a038634571b6ad63ff2da576a8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:26.602291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e5592f8c-09eb-4c89-9eb7-8f5aed837fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453885a038634571b6ad63ff2da576a8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:26.605596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e5592f8c-09eb-4c89-9eb7-8f5aed837fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453885a038634571b6ad63ff2da576a8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:26.637678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e5592f8c-09eb-4c89-9eb7-8f5aed837fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453885a038634571b6ad63ff2da576a8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:26.663948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 865/1753] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:55:26 2022] DELETE /identity/v3/users/453885a038634571b6ad63ff2da576a8 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:26.669439 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ab92c-dda4-4782-81f9-bc16819ea848 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:26.671249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ab92c-dda4-4782-81f9-bc16819ea848 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:26.672099 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ab92c-dda4-4782-81f9-bc16819ea848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:26.757745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-318ab92c-dda4-4782-81f9-bc16819ea848 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:26.770205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-318ab92c-dda4-4782-81f9-bc16819ea848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:26.995842 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 889/1754] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:27.303658 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5592f8c-09eb-4c89-9eb7-8f5aed837fc3 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:27.305792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e5592f8c-09eb-4c89-9eb7-8f5aed837fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:27.504357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5592f8c-09eb-4c89-9eb7-8f5aed837fc3 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:27.515155 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e1250-92e7-48fe-9b78-7342fd323b50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:27.516042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e1250-92e7-48fe-9b78-7342fd323b50 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:27.516482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e1250-92e7-48fe-9b78-7342fd323b50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:27.516885 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e1250-92e7-48fe-9b78-7342fd323b50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:27.540312 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e1250-92e7-48fe-9b78-7342fd323b50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:27.542060 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e1250-92e7-48fe-9b78-7342fd323b50 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:27.567653 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 866/1755] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:28.728343 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befc151-1714-4895-adc6-df6979f4ebac None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:28.728910 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befc151-1714-4895-adc6-df6979f4ebac None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:28.728910 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befc151-1714-4895-adc6-df6979f4ebac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:28.798472 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5befc151-1714-4895-adc6-df6979f4ebac None None] MFA Rules not processed for user `e4cdb1f1c4ad4fd5a2ce893c7c9965cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:28.801169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5befc151-1714-4895-adc6-df6979f4ebac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:28.953750 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 890/1756] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:28 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:28.957279 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e1250-92e7-48fe-9b78-7342fd323b50 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:28.960499 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-513e1250-92e7-48fe-9b78-7342fd323b50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:28.987698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e1250-92e7-48fe-9b78-7342fd323b50 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:28.997454 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6f7ec-c822-465a-8d10-2e1c7685d8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:28.999365 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6f7ec-c822-465a-8d10-2e1c7685d8d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:28.999860 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6f7ec-c822-465a-8d10-2e1c7685d8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:29.000356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6f7ec-c822-465a-8d10-2e1c7685d8d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:29.001290 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6f7ec-c822-465a-8d10-2e1c7685d8d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:29.024276 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6f7ec-c822-465a-8d10-2e1c7685d8d6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:29.072668 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 867/1757] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:28 2022] POST /identity/v3/projects => generated 405 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:29.073871 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befc151-1714-4895-adc6-df6979f4ebac None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:29.091510 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befc151-1714-4895-adc6-df6979f4ebac None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:29.201229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633f415-43fb-4dd9-9118-6e06f2e46d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:29.204563 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633f415-43fb-4dd9-9118-6e06f2e46d63 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:29.206354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633f415-43fb-4dd9-9118-6e06f2e46d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:29.206652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633f415-43fb-4dd9-9118-6e06f2e46d63 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:29.207443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633f415-43fb-4dd9-9118-6e06f2e46d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:29.209420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633f415-43fb-4dd9-9118-6e06f2e46d63 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:29.261791 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6f7ec-c822-465a-8d10-2e1c7685d8d6 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:29.261942 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 891/1758] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:29 2022] POST /identity/v3/users => generated 309 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:55:29.275192 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6f7ec-c822-465a-8d10-2e1c7685d8d6 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:29.290775 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4adda3-6a34-43fb-a1f9-398b7a38ed9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:29.291504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4adda3-6a34-43fb-a1f9-398b7a38ed9b admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:29.291784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4adda3-6a34-43fb-a1f9-398b7a38ed9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:29.292054 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4adda3-6a34-43fb-a1f9-398b7a38ed9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:29.293042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4adda3-6a34-43fb-a1f9-398b7a38ed9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:29.296677 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4adda3-6a34-43fb-a1f9-398b7a38ed9b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:29.322265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 868/1759] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:29.327700 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633f415-43fb-4dd9-9118-6e06f2e46d63 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:29.343820 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633f415-43fb-4dd9-9118-6e06f2e46d63 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:29.353240 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd3417-32ca-418e-8027-1426ac27ec1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:29.355331 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd3417-32ca-418e-8027-1426ac27ec1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:29.364934 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd3417-32ca-418e-8027-1426ac27ec1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:29.365684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd3417-32ca-418e-8027-1426ac27ec1f admin admin] PATH_INFO: `/v3/projects/edcc7173288d4c38b8a037e42f7d9483/users/311f98f348ce4f73970b52369d6c4a47/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:29.452735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd3417-32ca-418e-8027-1426ac27ec1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=edcc7173288d4c38b8a037e42f7d9483, user_id=311f98f348ce4f73970b52369d6c4a47, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:29.458557 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd3417-32ca-418e-8027-1426ac27ec1f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:29.500247 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4adda3-6a34-43fb-a1f9-398b7a38ed9b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:29.500973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 892/1760] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:29 2022] PUT /identity/v3/projects/edcc7173288d4c38b8a037e42f7d9483/users/311f98f348ce4f73970b52369d6c4a47/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:29.520980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4adda3-6a34-43fb-a1f9-398b7a38ed9b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:29.701692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd3417-32ca-418e-8027-1426ac27ec1f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:29.705815 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-65fd3417-32ca-418e-8027-1426ac27ec1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:29.740751 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a4d89-da47-447c-9979-d11d86355eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:29.741686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a4d89-da47-447c-9979-d11d86355eff admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:29.741973 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a4d89-da47-447c-9979-d11d86355eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:29.742296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a4d89-da47-447c-9979-d11d86355eff admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:29.743074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a4d89-da47-447c-9979-d11d86355eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:29.747082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a4d89-da47-447c-9979-d11d86355eff admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:29.774662 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 869/1761] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:55:29.780422 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a4d89-da47-447c-9979-d11d86355eff admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:29.813403 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a4d89-da47-447c-9979-d11d86355eff admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:29.827325 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3ed8b-dd7d-4aa9-a1fe-ba4e1ff16878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:29.828251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3ed8b-dd7d-4aa9-a1fe-ba4e1ff16878 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:29.830683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3ed8b-dd7d-4aa9-a1fe-ba4e1ff16878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:29.830982 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3ed8b-dd7d-4aa9-a1fe-ba4e1ff16878 admin admin] PATH_INFO: `/v3/projects/edcc7173288d4c38b8a037e42f7d9483/users/311f98f348ce4f73970b52369d6c4a47/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:29.840797 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3ed8b-dd7d-4aa9-a1fe-ba4e1ff16878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edcc7173288d4c38b8a037e42f7d9483, user_id=311f98f348ce4f73970b52369d6c4a47, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:29.846073 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3ed8b-dd7d-4aa9-a1fe-ba4e1ff16878 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:29.883016 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 870/1762] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:29 2022] PUT /identity/v3/projects/edcc7173288d4c38b8a037e42f7d9483/users/311f98f348ce4f73970b52369d6c4a47/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:29.934057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd3417-32ca-418e-8027-1426ac27ec1f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:30.031608 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d9cbd-e672-4250-99d9-1866fe10fb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:30.032654 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d9cbd-e672-4250-99d9-1866fe10fb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:30.033142 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d9cbd-e672-4250-99d9-1866fe10fb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:30.033512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d9cbd-e672-4250-99d9-1866fe10fb7e admin admin] PATH_INFO: `/v3/projects/429eee4244e64a58994e98973467faa0` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:30.035159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d9cbd-e672-4250-99d9-1866fe10fb7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=429eee4244e64a58994e98973467faa0)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:30.038009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d9cbd-e672-4250-99d9-1866fe10fb7e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:30.144587 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3b1d9cbd-e672-4250-99d9-1866fe10fb7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '429eee4244e64a58994e98973467faa0', 'request_id': 'req-3b1d9cbd-e672-4250-99d9-1866fe10fb7e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:30.154050 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3b1d9cbd-e672-4250-99d9-1866fe10fb7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '429eee4244e64a58994e98973467faa0', 'request_id': 'req-3b1d9cbd-e672-4250-99d9-1866fe10fb7e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:30.167893 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3b1d9cbd-e672-4250-99d9-1866fe10fb7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '429eee4244e64a58994e98973467faa0', 'request_id': 'req-3b1d9cbd-e672-4250-99d9-1866fe10fb7e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:30.190414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3b1d9cbd-e672-4250-99d9-1866fe10fb7e admin admin] The token cache is being invalidate because project 429eee4244e64a58994e98973467faa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:55:30.190870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3b1d9cbd-e672-4250-99d9-1866fe10fb7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:30.192052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3b1d9cbd-e672-4250-99d9-1866fe10fb7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:30.199040 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3ed8b-dd7d-4aa9-a1fe-ba4e1ff16878 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:30.199567 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 893/1763] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:55:29 2022] DELETE /identity/v3/projects/429eee4244e64a58994e98973467faa0 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:30.204764 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-87d3ed8b-dd7d-4aa9-a1fe-ba4e1ff16878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:30.231330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3ed8b-dd7d-4aa9-a1fe-ba4e1ff16878 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:30.530528 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a97d6-2f36-46d2-a6f5-26038e8842bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:30.531493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a97d6-2f36-46d2-a6f5-26038e8842bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:30.531770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a97d6-2f36-46d2-a6f5-26038e8842bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:30.532044 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a97d6-2f36-46d2-a6f5-26038e8842bb admin admin] PATH_INFO: `/v3/users/cc9e189ef42b4fea813361af1f64a6d0` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:30.539140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a97d6-2f36-46d2-a6f5-26038e8842bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc9e189ef42b4fea813361af1f64a6d0)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:30.541040 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a97d6-2f36-46d2-a6f5-26038e8842bb admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:30.684954 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42dd79-683d-4c27-beb6-3740f09024a6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:30.685448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42dd79-683d-4c27-beb6-3740f09024a6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:30.685828 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42dd79-683d-4c27-beb6-3740f09024a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:30.722837 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-db42dd79-683d-4c27-beb6-3740f09024a6 None None] MFA Rules not processed for user `3abe8bdd0c8948eb97dcc7292359520c`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:30.725447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-db42dd79-683d-4c27-beb6-3740f09024a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:30.758690 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-641a97d6-2f36-46d2-a6f5-26038e8842bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc9e189ef42b4fea813361af1f64a6d0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:30.804749 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-641a97d6-2f36-46d2-a6f5-26038e8842bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc9e189ef42b4fea813361af1f64a6d0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:30.808006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-641a97d6-2f36-46d2-a6f5-26038e8842bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc9e189ef42b4fea813361af1f64a6d0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:30.811625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-641a97d6-2f36-46d2-a6f5-26038e8842bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc9e189ef42b4fea813361af1f64a6d0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:30.823363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 894/1764] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:30.862140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-641a97d6-2f36-46d2-a6f5-26038e8842bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc9e189ef42b4fea813361af1f64a6d0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:30.884771 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 871/1765] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:55:30 2022] DELETE /identity/v3/users/cc9e189ef42b4fea813361af1f64a6d0 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:32.169398 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42dd79-683d-4c27-beb6-3740f09024a6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:32.171428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-db42dd79-683d-4c27-beb6-3740f09024a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:32.197554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42dd79-683d-4c27-beb6-3740f09024a6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:32.349312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e92484-00f1-4de8-a987-e285de116621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:32.350137 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e92484-00f1-4de8-a987-e285de116621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:32.350413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e92484-00f1-4de8-a987-e285de116621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:32.351030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e92484-00f1-4de8-a987-e285de116621 admin admin] PATH_INFO: `/v3/projects/4e63931060e14f8c947eb9e28ee6f0a7` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:32.352423 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e92484-00f1-4de8-a987-e285de116621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e63931060e14f8c947eb9e28ee6f0a7)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:32.354743 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e92484-00f1-4de8-a987-e285de116621 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:32.443215 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-77e92484-00f1-4de8-a987-e285de116621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e63931060e14f8c947eb9e28ee6f0a7', 'request_id': 'req-77e92484-00f1-4de8-a987-e285de116621'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:32.455447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-77e92484-00f1-4de8-a987-e285de116621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e63931060e14f8c947eb9e28ee6f0a7', 'request_id': 'req-77e92484-00f1-4de8-a987-e285de116621'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:32.468802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-77e92484-00f1-4de8-a987-e285de116621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e63931060e14f8c947eb9e28ee6f0a7', 'request_id': 'req-77e92484-00f1-4de8-a987-e285de116621'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:32.507985 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-77e92484-00f1-4de8-a987-e285de116621 admin admin] The token cache is being invalidate because project 4e63931060e14f8c947eb9e28ee6f0a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:55:32.508666 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-77e92484-00f1-4de8-a987-e285de116621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:32.510643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-77e92484-00f1-4de8-a987-e285de116621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:32.512751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 895/1766] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:55:32 2022] DELETE /identity/v3/projects/4e63931060e14f8c947eb9e28ee6f0a7 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:32.518683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30925ca1-496b-4bd3-9938-59819965a9f5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:32.520252 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30925ca1-496b-4bd3-9938-59819965a9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:32.520893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30925ca1-496b-4bd3-9938-59819965a9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:32.552817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-30925ca1-496b-4bd3-9938-59819965a9f5 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:32.557483 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-30925ca1-496b-4bd3-9938-59819965a9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:32.583356 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0ea71-e3bb-46f8-bc3b-498c6c764e67 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:32.583764 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0ea71-e3bb-46f8-bc3b-498c6c764e67 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:32.585082 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0ea71-e3bb-46f8-bc3b-498c6c764e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:32.686759 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5ec0ea71-e3bb-46f8-bc3b-498c6c764e67 None None] MFA Rules not processed for user `311f98f348ce4f73970b52369d6c4a47`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:32.686759 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5ec0ea71-e3bb-46f8-bc3b-498c6c764e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:32.751175 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 872/1767] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:32.766632 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b5a10-c4e1-4a38-9196-6da2c1f62cd6 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:32.767294 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b5a10-c4e1-4a38-9196-6da2c1f62cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:32.768311 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b5a10-c4e1-4a38-9196-6da2c1f62cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:32.825048 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7c1b5a10-c4e1-4a38-9196-6da2c1f62cd6 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:32.826739 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7c1b5a10-c4e1-4a38-9196-6da2c1f62cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:32.837838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 873/1768] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:32.845198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b5a10-c4e1-4a38-9196-6da2c1f62cd6 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:32.866264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b5a10-c4e1-4a38-9196-6da2c1f62cd6 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:32.875104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 896/1769] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:32 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:32.895302 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e7b46-787a-4070-afac-b1442a0f56b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:32.898008 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e7b46-787a-4070-afac-b1442a0f56b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:32.898463 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e7b46-787a-4070-afac-b1442a0f56b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:32.899363 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e7b46-787a-4070-afac-b1442a0f56b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:32.900155 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e7b46-787a-4070-afac-b1442a0f56b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:55:32.900458 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e7b46-787a-4070-afac-b1442a0f56b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:32.904903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e7b46-787a-4070-afac-b1442a0f56b5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:32.941293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 874/1770] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:55:32.945843 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0ea71-e3bb-46f8-bc3b-498c6c764e67 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:32.958437 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0ea71-e3bb-46f8-bc3b-498c6c764e67 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:32.965633 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55118b6b-546e-4141-a065-e0987648b8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:32.966710 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55118b6b-546e-4141-a065-e0987648b8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:32.967267 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55118b6b-546e-4141-a065-e0987648b8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:32.968699 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55118b6b-546e-4141-a065-e0987648b8a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:32.969636 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55118b6b-546e-4141-a065-e0987648b8a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:32.972006 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55118b6b-546e-4141-a065-e0987648b8a9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:33.036306 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e7b46-787a-4070-afac-b1442a0f56b5 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:33.037336 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 897/1771] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:32 2022] POST /identity/v3/projects => generated 407 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:33.052381 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e7b46-787a-4070-afac-b1442a0f56b5 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:33.271281 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69494f-c8b1-4a1c-a1bd-e8706833fac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:33.271983 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69494f-c8b1-4a1c-a1bd-e8706833fac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:33.272265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69494f-c8b1-4a1c-a1bd-e8706833fac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:33.272540 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69494f-c8b1-4a1c-a1bd-e8706833fac8 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:33.277543 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69494f-c8b1-4a1c-a1bd-e8706833fac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:33.287614 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69494f-c8b1-4a1c-a1bd-e8706833fac8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:33.369299 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 875/1772] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:33 2022] POST /identity/v3/users => generated 304 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:55:33.371501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55118b6b-546e-4141-a065-e0987648b8a9 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:33.400584 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55118b6b-546e-4141-a065-e0987648b8a9 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:33.424896 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674fe42-b4a5-4278-bbc4-85f6d72994d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:33.426499 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674fe42-b4a5-4278-bbc4-85f6d72994d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:33.427998 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674fe42-b4a5-4278-bbc4-85f6d72994d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:33.430426 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674fe42-b4a5-4278-bbc4-85f6d72994d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:33.438200 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674fe42-b4a5-4278-bbc4-85f6d72994d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:33.444533 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674fe42-b4a5-4278-bbc4-85f6d72994d6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:33.492092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 898/1773] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:33.493472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69494f-c8b1-4a1c-a1bd-e8706833fac8 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:33.535854 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69494f-c8b1-4a1c-a1bd-e8706833fac8 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:33.536427 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31cbb2-4d15-499a-a308-5a40b7934d46 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:33.536427 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31cbb2-4d15-499a-a308-5a40b7934d46 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:33.536427 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31cbb2-4d15-499a-a308-5a40b7934d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:33.536656 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dfb5f-2203-4abf-bbf2-1cda6cf5f8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:33.536656 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dfb5f-2203-4abf-bbf2-1cda6cf5f8dc admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:33.536828 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dfb5f-2203-4abf-bbf2-1cda6cf5f8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:33.540110 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dfb5f-2203-4abf-bbf2-1cda6cf5f8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:33.546618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dfb5f-2203-4abf-bbf2-1cda6cf5f8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:33.553073 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dfb5f-2203-4abf-bbf2-1cda6cf5f8dc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:33.597864 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4d31cbb2-4d15-499a-a308-5a40b7934d46 None None] MFA Rules not processed for user `3c92f4b777a644ad8055f15b1a8bd0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:33.601146 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4d31cbb2-4d15-499a-a308-5a40b7934d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:33.608692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 876/1774] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:33.615285 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756314cd-b3c5-4c8d-b581-ecd554f8d1d3 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:33.617010 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756314cd-b3c5-4c8d-b581-ecd554f8d1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:33.617672 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756314cd-b3c5-4c8d-b581-ecd554f8d1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:33.729443 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-756314cd-b3c5-4c8d-b581-ecd554f8d1d3 None None] MFA Rules not processed for user `cffc26233de74f0ea2c438f588be3ade`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:33.739798 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-756314cd-b3c5-4c8d-b581-ecd554f8d1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:33.841480 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 899/1775] 10.222.0.75 () {58 vars in 1015 bytes} [Wed May 11 06:55:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:33.842424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31cbb2-4d15-499a-a308-5a40b7934d46 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:33.869299 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 877/1776] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:33.880172 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31cbb2-4d15-499a-a308-5a40b7934d46 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:33.892237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fc9a2-3bd6-4219-bb47-f4445e921d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:33.894229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fc9a2-3bd6-4219-bb47-f4445e921d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:33.895378 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fc9a2-3bd6-4219-bb47-f4445e921d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:33.896597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fc9a2-3bd6-4219-bb47-f4445e921d06 admin admin] PATH_INFO: `/v3/projects/f316efdcbca749b1a4418fbaa3d76830/users/b9366f2050684c09a6be07ee686a736a/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:33.939865 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22fc9a2-3bd6-4219-bb47-f4445e921d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f316efdcbca749b1a4418fbaa3d76830, user_id=b9366f2050684c09a6be07ee686a736a, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:33.946499 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22fc9a2-3bd6-4219-bb47-f4445e921d06 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:33.970069 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756314cd-b3c5-4c8d-b581-ecd554f8d1d3 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:33.977955 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-756314cd-b3c5-4c8d-b581-ecd554f8d1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:33.980331 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 900/1777] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:33 2022] PUT /identity/v3/projects/f316efdcbca749b1a4418fbaa3d76830/users/b9366f2050684c09a6be07ee686a736a/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:33.992094 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3e8fc-5ace-4e70-bedc-74b80a2a7e66 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:33.992742 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3e8fc-5ace-4e70-bedc-74b80a2a7e66 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:33.993234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3e8fc-5ace-4e70-bedc-74b80a2a7e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:34.004770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756314cd-b3c5-4c8d-b581-ecd554f8d1d3 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:34.086815 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-efb3e8fc-5ace-4e70-bedc-74b80a2a7e66 None None] MFA Rules not processed for user `b9366f2050684c09a6be07ee686a736a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:34.088201 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-efb3e8fc-5ace-4e70-bedc-74b80a2a7e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:34.252919 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 901/1778] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:33 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:34.257615 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3e8fc-5ace-4e70-bedc-74b80a2a7e66 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:34.272192 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16794f54-92d3-4998-a01e-f6ba304810d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:34.272933 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16794f54-92d3-4998-a01e-f6ba304810d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:34.273402 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16794f54-92d3-4998-a01e-f6ba304810d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:34.273968 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16794f54-92d3-4998-a01e-f6ba304810d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:34.300490 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16794f54-92d3-4998-a01e-f6ba304810d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:34.304388 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16794f54-92d3-4998-a01e-f6ba304810d0 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:34.317252 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 878/1779] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:34.328160 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16794f54-92d3-4998-a01e-f6ba304810d0 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:34.330775 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-16794f54-92d3-4998-a01e-f6ba304810d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:34.353920 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16794f54-92d3-4998-a01e-f6ba304810d0 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:34.363738 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cac29-2652-4a13-a103-749b27c68ca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:34.364459 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cac29-2652-4a13-a103-749b27c68ca4 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:34.366666 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cac29-2652-4a13-a103-749b27c68ca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:34.367048 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cac29-2652-4a13-a103-749b27c68ca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:34.395711 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cac29-2652-4a13-a103-749b27c68ca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:34.403225 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cac29-2652-4a13-a103-749b27c68ca4 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:34.430478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 879/1780] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:34.436976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3e8fc-5ace-4e70-bedc-74b80a2a7e66 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:34.454610 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140e438-f9ae-4295-9af5-7a0cf75244f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:34.455841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140e438-f9ae-4295-9af5-7a0cf75244f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:34.456325 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140e438-f9ae-4295-9af5-7a0cf75244f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:34.456797 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140e438-f9ae-4295-9af5-7a0cf75244f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:34.457704 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140e438-f9ae-4295-9af5-7a0cf75244f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:34.460987 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140e438-f9ae-4295-9af5-7a0cf75244f4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:34.698694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 902/1781] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:34 2022] POST /identity/v3/projects => generated 409 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:34.706784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cac29-2652-4a13-a103-749b27c68ca4 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:34.726521 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cac29-2652-4a13-a103-749b27c68ca4 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:34.850358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd151b-2b0c-46b6-b4ce-de250c1cb339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:34.851099 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd151b-2b0c-46b6-b4ce-de250c1cb339 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:34.851441 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd151b-2b0c-46b6-b4ce-de250c1cb339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:34.851757 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd151b-2b0c-46b6-b4ce-de250c1cb339 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:34.852719 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd151b-2b0c-46b6-b4ce-de250c1cb339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:34.856131 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd151b-2b0c-46b6-b4ce-de250c1cb339 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:34.898348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 880/1782] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:34 2022] POST /identity/v3/users => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:34.902767 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140e438-f9ae-4295-9af5-7a0cf75244f4 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:34.922817 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140e438-f9ae-4295-9af5-7a0cf75244f4 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:34.939174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7a66e-8f9f-401f-8228-a52f905ce2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:34.942703 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7a66e-8f9f-401f-8228-a52f905ce2bc admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:34.943481 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7a66e-8f9f-401f-8228-a52f905ce2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:34.944523 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7a66e-8f9f-401f-8228-a52f905ce2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:34.946279 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7a66e-8f9f-401f-8228-a52f905ce2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:34.948689 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7a66e-8f9f-401f-8228-a52f905ce2bc admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:34.966176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 903/1783] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:34.972940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd151b-2b0c-46b6-b4ce-de250c1cb339 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:34.997483 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd151b-2b0c-46b6-b4ce-de250c1cb339 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:35.004408 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc26d9-f959-4eeb-9ff2-6aa27a84dc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:35.006886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc26d9-f959-4eeb-9ff2-6aa27a84dc08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:35.007393 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc26d9-f959-4eeb-9ff2-6aa27a84dc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:35.007765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc26d9-f959-4eeb-9ff2-6aa27a84dc08 admin admin] PATH_INFO: `/v3/projects/15167e10d5784a2cbe2f15465f8b4d9a/users/5fc5ac1c569d4a5ea442cfaf5a865116/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:35.036217 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc26d9-f959-4eeb-9ff2-6aa27a84dc08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15167e10d5784a2cbe2f15465f8b4d9a, user_id=5fc5ac1c569d4a5ea442cfaf5a865116, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:35.042007 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc26d9-f959-4eeb-9ff2-6aa27a84dc08 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:35.085432 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 881/1784] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:34 2022] PUT /identity/v3/projects/15167e10d5784a2cbe2f15465f8b4d9a/users/5fc5ac1c569d4a5ea442cfaf5a865116/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:35.087126 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7a66e-8f9f-401f-8228-a52f905ce2bc admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:35.104680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7a66e-8f9f-401f-8228-a52f905ce2bc admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:35.297305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e26e3-ef70-4fc7-a30a-9add5b10fe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:35.299909 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e26e3-ef70-4fc7-a30a-9add5b10fe43 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:35.300337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e26e3-ef70-4fc7-a30a-9add5b10fe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:35.301098 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e26e3-ef70-4fc7-a30a-9add5b10fe43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:35.301990 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e26e3-ef70-4fc7-a30a-9add5b10fe43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:35.306300 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e26e3-ef70-4fc7-a30a-9add5b10fe43 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:35.335321 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 904/1785] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:35.338741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc26d9-f959-4eeb-9ff2-6aa27a84dc08 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:35.353209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc26d9-f959-4eeb-9ff2-6aa27a84dc08 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:35.370795 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c5ce9-759c-4dc8-9615-046e2e795e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:35.373827 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c5ce9-759c-4dc8-9615-046e2e795e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:35.374403 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c5ce9-759c-4dc8-9615-046e2e795e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:35.375551 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c5ce9-759c-4dc8-9615-046e2e795e50 admin admin] PATH_INFO: `/v3/projects/15167e10d5784a2cbe2f15465f8b4d9a/users/5fc5ac1c569d4a5ea442cfaf5a865116/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:35.383812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c5ce9-759c-4dc8-9615-046e2e795e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15167e10d5784a2cbe2f15465f8b4d9a, user_id=5fc5ac1c569d4a5ea442cfaf5a865116, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:35.390374 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c5ce9-759c-4dc8-9615-046e2e795e50 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:35.435396 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 882/1786] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:35 2022] PUT /identity/v3/projects/15167e10d5784a2cbe2f15465f8b4d9a/users/5fc5ac1c569d4a5ea442cfaf5a865116/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:35.443528 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be4d0d-3b22-47b1-9e94-ee1c33546a8e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:35.444085 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be4d0d-3b22-47b1-9e94-ee1c33546a8e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:35.444085 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be4d0d-3b22-47b1-9e94-ee1c33546a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:35.533319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c7be4d0d-3b22-47b1-9e94-ee1c33546a8e None None] MFA Rules not processed for user `5fc5ac1c569d4a5ea442cfaf5a865116`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:35.540298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c7be4d0d-3b22-47b1-9e94-ee1c33546a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:35.686470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 905/1787] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:35 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:35.694173 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c5ce9-759c-4dc8-9615-046e2e795e50 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:35.696138 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2a2c5ce9-759c-4dc8-9615-046e2e795e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:35.765443 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c5ce9-759c-4dc8-9615-046e2e795e50 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:35.770980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d903d9-35d7-423d-b678-3531be7a6204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:35.771715 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d903d9-35d7-423d-b678-3531be7a6204 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:35.772001 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d903d9-35d7-423d-b678-3531be7a6204 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:35.772277 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d903d9-35d7-423d-b678-3531be7a6204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:35.783638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d903d9-35d7-423d-b678-3531be7a6204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:35.785311 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d903d9-35d7-423d-b678-3531be7a6204 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:35.800528 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 883/1788] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:35 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:36.012057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be4d0d-3b22-47b1-9e94-ee1c33546a8e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:36.028661 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be4d0d-3b22-47b1-9e94-ee1c33546a8e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:36.032729 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a718c6-71d2-49a0-bc06-eb2a67f46493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:36.033665 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a718c6-71d2-49a0-bc06-eb2a67f46493 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:36.034052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a718c6-71d2-49a0-bc06-eb2a67f46493 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:36.034200 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a718c6-71d2-49a0-bc06-eb2a67f46493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:36.117673 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a718c6-71d2-49a0-bc06-eb2a67f46493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:36.121083 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a718c6-71d2-49a0-bc06-eb2a67f46493 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:36.133551 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 906/1789] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:36 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:37.540429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d903d9-35d7-423d-b678-3531be7a6204 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:37.542006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e4d903d9-35d7-423d-b678-3531be7a6204 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:37.675589 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d903d9-35d7-423d-b678-3531be7a6204 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:37.684455 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df774308-d557-487d-8c1f-1cffbfbd07be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:37.686220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df774308-d557-487d-8c1f-1cffbfbd07be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:37.686702 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df774308-d557-487d-8c1f-1cffbfbd07be admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:37.687113 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df774308-d557-487d-8c1f-1cffbfbd07be admin admin] PATH_INFO: `/v3/users/9863e5587ac348ce877f6c2b1b6ddf99` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:37.688530 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df774308-d557-487d-8c1f-1cffbfbd07be admin admin] RBAC: Authorizing `identity:delete_user(user_id=9863e5587ac348ce877f6c2b1b6ddf99)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:37.691631 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df774308-d557-487d-8c1f-1cffbfbd07be admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:37.909837 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c563d-29f6-4576-8afd-02f647af6d19 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:37.910361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c563d-29f6-4576-8afd-02f647af6d19 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:37.910453 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c563d-29f6-4576-8afd-02f647af6d19 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:37.911855 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 907/1790] 10.222.0.77 () {54 vars in 921 bytes} [Wed May 11 06:55:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:55:37.928078 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3790080-10e1-4aef-9b34-c3c7d319167c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:37.928416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3790080-10e1-4aef-9b34-c3c7d319167c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:37.928727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3790080-10e1-4aef-9b34-c3c7d319167c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:37.968208 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d3790080-10e1-4aef-9b34-c3c7d319167c None None] MFA Rules not processed for user `edf9d57de89a4701ba1a5b079d0ad348`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:37.969737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d3790080-10e1-4aef-9b34-c3c7d319167c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:38.032994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-df774308-d557-487d-8c1f-1cffbfbd07be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9863e5587ac348ce877f6c2b1b6ddf99'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:38.057432 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-df774308-d557-487d-8c1f-1cffbfbd07be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9863e5587ac348ce877f6c2b1b6ddf99'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:38.058509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-df774308-d557-487d-8c1f-1cffbfbd07be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9863e5587ac348ce877f6c2b1b6ddf99'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:38.059206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-df774308-d557-487d-8c1f-1cffbfbd07be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9863e5587ac348ce877f6c2b1b6ddf99'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:38.071664 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-df774308-d557-487d-8c1f-1cffbfbd07be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9863e5587ac348ce877f6c2b1b6ddf99'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:38.094670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 884/1791] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:55:37 2022] DELETE /identity/v3/users/9863e5587ac348ce877f6c2b1b6ddf99 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:38.099189 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aaa71-41bd-435f-9886-a34a0b9b206f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:38.099632 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aaa71-41bd-435f-9886-a34a0b9b206f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:38.100083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aaa71-41bd-435f-9886-a34a0b9b206f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:38.114054 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 908/1792] 10.222.0.77 () {58 vars in 1018 bytes} [Wed May 11 06:55:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:38.120712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-dd6aaa71-41bd-435f-9886-a34a0b9b206f None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:38.121981 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-dd6aaa71-41bd-435f-9886-a34a0b9b206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:38.201235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 885/1793] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:38.202248 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3790080-10e1-4aef-9b34-c3c7d319167c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:38.203795 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d3790080-10e1-4aef-9b34-c3c7d319167c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:38.247541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3790080-10e1-4aef-9b34-c3c7d319167c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:38.261222 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6aaa71-41bd-435f-9886-a34a0b9b206f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:38.263230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-dd6aaa71-41bd-435f-9886-a34a0b9b206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:38.345540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f8acd-d54a-401b-8a24-510c8fd7ebf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:38.346520 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f8acd-d54a-401b-8a24-510c8fd7ebf6 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:38.347083 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f8acd-d54a-401b-8a24-510c8fd7ebf6 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:38.348029 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f8acd-d54a-401b-8a24-510c8fd7ebf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:38.362190 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f8acd-d54a-401b-8a24-510c8fd7ebf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:38.364131 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f8acd-d54a-401b-8a24-510c8fd7ebf6 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:38.380496 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 909/1794] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:55:38.426632 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6aaa71-41bd-435f-9886-a34a0b9b206f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:38.430478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945cfc4-649f-4794-a27c-ffcc58df7041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:38.431848 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945cfc4-649f-4794-a27c-ffcc58df7041 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:38.432197 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945cfc4-649f-4794-a27c-ffcc58df7041 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:38.432386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945cfc4-649f-4794-a27c-ffcc58df7041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:38.443694 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945cfc4-649f-4794-a27c-ffcc58df7041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:38.445203 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945cfc4-649f-4794-a27c-ffcc58df7041 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:38.466896 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 886/1795] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:55:38.502756 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f8acd-d54a-401b-8a24-510c8fd7ebf6 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:38.505090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-053f8acd-d54a-401b-8a24-510c8fd7ebf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:38.521624 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f8acd-d54a-401b-8a24-510c8fd7ebf6 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:38.539041 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3ec6b-c41f-40f7-921b-79a62bd59715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:38.541364 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3ec6b-c41f-40f7-921b-79a62bd59715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:38.541602 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3ec6b-c41f-40f7-921b-79a62bd59715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:38.544940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3ec6b-c41f-40f7-921b-79a62bd59715 admin admin] PATH_INFO: `/v3/users/e4cdb1f1c4ad4fd5a2ce893c7c9965cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:38.547478 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3ec6b-c41f-40f7-921b-79a62bd59715 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4cdb1f1c4ad4fd5a2ce893c7c9965cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:38.550730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3ec6b-c41f-40f7-921b-79a62bd59715 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:38.674650 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f1d3ec6b-c41f-40f7-921b-79a62bd59715 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4cdb1f1c4ad4fd5a2ce893c7c9965cd'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:38.705809 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f1d3ec6b-c41f-40f7-921b-79a62bd59715 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4cdb1f1c4ad4fd5a2ce893c7c9965cd'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:38.707348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f1d3ec6b-c41f-40f7-921b-79a62bd59715 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4cdb1f1c4ad4fd5a2ce893c7c9965cd'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:38.713846 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f1d3ec6b-c41f-40f7-921b-79a62bd59715 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4cdb1f1c4ad4fd5a2ce893c7c9965cd'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:38.730645 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f1d3ec6b-c41f-40f7-921b-79a62bd59715 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4cdb1f1c4ad4fd5a2ce893c7c9965cd'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:38.758413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 910/1796] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:55:38 2022] DELETE /identity/v3/users/e4cdb1f1c4ad4fd5a2ce893c7c9965cd => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:38.789486 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17af123-1cea-4967-83da-0e5401069d41 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:38.790053 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17af123-1cea-4967-83da-0e5401069d41 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:38.790253 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17af123-1cea-4967-83da-0e5401069d41 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:38.792622 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 887/1797] 10.222.0.77 () {54 vars in 921 bytes} [Wed May 11 06:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:55:38.804639 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fad41d-fe07-4b64-9dee-857f0f99d4ca None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:38.804928 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fad41d-fe07-4b64-9dee-857f0f99d4ca None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:38.805203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fad41d-fe07-4b64-9dee-857f0f99d4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:38.861056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-21fad41d-fe07-4b64-9dee-857f0f99d4ca None None] MFA Rules not processed for user `edf9d57de89a4701ba1a5b079d0ad348`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:38.862295 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-21fad41d-fe07-4b64-9dee-857f0f99d4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:38.979868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 911/1798] 10.222.0.77 () {58 vars in 1018 bytes} [Wed May 11 06:55:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:39.014902 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17af123-1cea-4967-83da-0e5401069d41 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:39.017009 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a17af123-1cea-4967-83da-0e5401069d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:39.048301 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17af123-1cea-4967-83da-0e5401069d41 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:39.055616 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68c482-59a5-41ff-a12a-9b12b24c5433 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:39.056623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68c482-59a5-41ff-a12a-9b12b24c5433 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:39.056926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68c482-59a5-41ff-a12a-9b12b24c5433 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:39.057369 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68c482-59a5-41ff-a12a-9b12b24c5433 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:39.085459 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68c482-59a5-41ff-a12a-9b12b24c5433 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:39.088971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68c482-59a5-41ff-a12a-9b12b24c5433 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:39.127170 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 888/1799] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:39.359094 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fad41d-fe07-4b64-9dee-857f0f99d4ca None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:39.361144 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-21fad41d-fe07-4b64-9dee-857f0f99d4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:39.397618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68c482-59a5-41ff-a12a-9b12b24c5433 service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:39.399368 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ce68c482-59a5-41ff-a12a-9b12b24c5433 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:39.505487 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fad41d-fe07-4b64-9dee-857f0f99d4ca None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:39.512027 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd904ccf-dfd1-4c99-9d4f-621aecb2696c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:39.513098 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd904ccf-dfd1-4c99-9d4f-621aecb2696c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:39.513821 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd904ccf-dfd1-4c99-9d4f-621aecb2696c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:39.513821 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd904ccf-dfd1-4c99-9d4f-621aecb2696c admin admin] PATH_INFO: `/v3/projects/ae69cddb39244d658156c8eabaa8fbfc` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:39.515235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd904ccf-dfd1-4c99-9d4f-621aecb2696c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae69cddb39244d658156c8eabaa8fbfc)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:39.518031 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd904ccf-dfd1-4c99-9d4f-621aecb2696c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:39.520468 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68c482-59a5-41ff-a12a-9b12b24c5433 service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:39.525205 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5ee7c-939b-4a80-8c43-7edf96257991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:39.526073 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5ee7c-939b-4a80-8c43-7edf96257991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:39.526350 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5ee7c-939b-4a80-8c43-7edf96257991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:39.526621 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5ee7c-939b-4a80-8c43-7edf96257991 admin admin] PATH_INFO: `/v3/projects/7fc10a2342ea4e55bc59541b97dd61fe` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:39.527856 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c5ee7c-939b-4a80-8c43-7edf96257991 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fc10a2342ea4e55bc59541b97dd61fe)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:39.530119 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c5ee7c-939b-4a80-8c43-7edf96257991 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:39.589670 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cd904ccf-dfd1-4c99-9d4f-621aecb2696c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae69cddb39244d658156c8eabaa8fbfc', 'request_id': 'req-cd904ccf-dfd1-4c99-9d4f-621aecb2696c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:39.592784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b8c5ee7c-939b-4a80-8c43-7edf96257991 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fc10a2342ea4e55bc59541b97dd61fe', 'request_id': 'req-b8c5ee7c-939b-4a80-8c43-7edf96257991'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:39.596344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cd904ccf-dfd1-4c99-9d4f-621aecb2696c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae69cddb39244d658156c8eabaa8fbfc', 'request_id': 'req-cd904ccf-dfd1-4c99-9d4f-621aecb2696c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:39.598905 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b8c5ee7c-939b-4a80-8c43-7edf96257991 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fc10a2342ea4e55bc59541b97dd61fe', 'request_id': 'req-b8c5ee7c-939b-4a80-8c43-7edf96257991'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:39.604513 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cd904ccf-dfd1-4c99-9d4f-621aecb2696c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae69cddb39244d658156c8eabaa8fbfc', 'request_id': 'req-cd904ccf-dfd1-4c99-9d4f-621aecb2696c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:39.610175 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b8c5ee7c-939b-4a80-8c43-7edf96257991 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fc10a2342ea4e55bc59541b97dd61fe', 'request_id': 'req-b8c5ee7c-939b-4a80-8c43-7edf96257991'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:39.618982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cd904ccf-dfd1-4c99-9d4f-621aecb2696c admin admin] The token cache is being invalidate because project ae69cddb39244d658156c8eabaa8fbfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:55:39.619287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cd904ccf-dfd1-4c99-9d4f-621aecb2696c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:39.619920 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cd904ccf-dfd1-4c99-9d4f-621aecb2696c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:39.621481 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 912/1800] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:55:39 2022] DELETE /identity/v3/projects/ae69cddb39244d658156c8eabaa8fbfc => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:39.621601 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b8c5ee7c-939b-4a80-8c43-7edf96257991 admin admin] The token cache is being invalidate because project 7fc10a2342ea4e55bc59541b97dd61fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:55:39.621804 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b8c5ee7c-939b-4a80-8c43-7edf96257991 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:39.622563 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b8c5ee7c-939b-4a80-8c43-7edf96257991 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:39.624367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 889/1801] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:55:39 2022] DELETE /identity/v3/projects/7fc10a2342ea4e55bc59541b97dd61fe => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:39.627908 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd904ccf-dfd1-4c99-9d4f-621aecb2696c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:39.628047 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5ee7c-939b-4a80-8c43-7edf96257991 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:39.629221 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cd904ccf-dfd1-4c99-9d4f-621aecb2696c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:39.629323 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b8c5ee7c-939b-4a80-8c43-7edf96257991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:39.693383 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd904ccf-dfd1-4c99-9d4f-621aecb2696c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:39.696130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5ee7c-939b-4a80-8c43-7edf96257991 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:39.701172 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818266b-3f97-4107-9608-8372aa628fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:39.702122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818266b-3f97-4107-9608-8372aa628fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:39.702416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818266b-3f97-4107-9608-8372aa628fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:39.702774 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818266b-3f97-4107-9608-8372aa628fb1 admin admin] PATH_INFO: `/v3/users/311f98f348ce4f73970b52369d6c4a47` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:39.703606 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149b354-326d-4f3c-9d06-0b3021700879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:39.703990 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818266b-3f97-4107-9608-8372aa628fb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=311f98f348ce4f73970b52369d6c4a47)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:39.704801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149b354-326d-4f3c-9d06-0b3021700879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:39.705129 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149b354-326d-4f3c-9d06-0b3021700879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:39.705379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149b354-326d-4f3c-9d06-0b3021700879 admin admin] PATH_INFO: `/v3/users/94600fd74a394b5bb1a1226fbadef694` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:39.707104 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149b354-326d-4f3c-9d06-0b3021700879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94600fd74a394b5bb1a1226fbadef694)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:39.709086 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149b354-326d-4f3c-9d06-0b3021700879 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:39.709974 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818266b-3f97-4107-9608-8372aa628fb1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:39.760325 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0818266b-3f97-4107-9608-8372aa628fb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '311f98f348ce4f73970b52369d6c4a47'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:39.761432 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c149b354-326d-4f3c-9d06-0b3021700879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94600fd74a394b5bb1a1226fbadef694'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:39.773565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0818266b-3f97-4107-9608-8372aa628fb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '311f98f348ce4f73970b52369d6c4a47'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:39.774339 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0818266b-3f97-4107-9608-8372aa628fb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '311f98f348ce4f73970b52369d6c4a47'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:39.775307 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0818266b-3f97-4107-9608-8372aa628fb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '311f98f348ce4f73970b52369d6c4a47'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:39.779932 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c149b354-326d-4f3c-9d06-0b3021700879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94600fd74a394b5bb1a1226fbadef694'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:39.781661 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c149b354-326d-4f3c-9d06-0b3021700879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94600fd74a394b5bb1a1226fbadef694'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:39.782819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c149b354-326d-4f3c-9d06-0b3021700879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94600fd74a394b5bb1a1226fbadef694'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:39.784625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0818266b-3f97-4107-9608-8372aa628fb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '311f98f348ce4f73970b52369d6c4a47'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:39.791126 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c149b354-326d-4f3c-9d06-0b3021700879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94600fd74a394b5bb1a1226fbadef694'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:39.798784 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 913/1802] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:55:39 2022] DELETE /identity/v3/users/311f98f348ce4f73970b52369d6c4a47 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:39.805698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 890/1803] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:55:39 2022] DELETE /identity/v3/users/94600fd74a394b5bb1a1226fbadef694 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:55:40.081423 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818266b-3f97-4107-9608-8372aa628fb1 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:40.083022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0818266b-3f97-4107-9608-8372aa628fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:40.159431 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149b354-326d-4f3c-9d06-0b3021700879 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:40.161033 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c149b354-326d-4f3c-9d06-0b3021700879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:40.164186 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818266b-3f97-4107-9608-8372aa628fb1 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:40.224329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bdebc-183a-4d13-8167-0b3cfc1d2dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:40.225242 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bdebc-183a-4d13-8167-0b3cfc1d2dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:40.225534 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bdebc-183a-4d13-8167-0b3cfc1d2dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:40.225812 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bdebc-183a-4d13-8167-0b3cfc1d2dd0 admin admin] PATH_INFO: `/v3/projects/edcc7173288d4c38b8a037e42f7d9483` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:40.227051 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bdebc-183a-4d13-8167-0b3cfc1d2dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edcc7173288d4c38b8a037e42f7d9483)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:40.228982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bdebc-183a-4d13-8167-0b3cfc1d2dd0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:40.232226 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149b354-326d-4f3c-9d06-0b3021700879 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:40.236957 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c707c20-e948-4707-8ac3-dac50eab953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:40.237831 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c707c20-e948-4707-8ac3-dac50eab953e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:40.238112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c707c20-e948-4707-8ac3-dac50eab953e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:40.238382 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c707c20-e948-4707-8ac3-dac50eab953e admin admin] PATH_INFO: `/v3/projects/52037d5d6253430e81a756b993b97172` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:40.239727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c707c20-e948-4707-8ac3-dac50eab953e admin admin] RBAC: Authorizing `identity:delete_project(project_id=52037d5d6253430e81a756b993b97172)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:40.241683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c707c20-e948-4707-8ac3-dac50eab953e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:40.281156 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a82bdebc-183a-4d13-8167-0b3cfc1d2dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edcc7173288d4c38b8a037e42f7d9483', 'request_id': 'req-a82bdebc-183a-4d13-8167-0b3cfc1d2dd0'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:40.288315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a82bdebc-183a-4d13-8167-0b3cfc1d2dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edcc7173288d4c38b8a037e42f7d9483', 'request_id': 'req-a82bdebc-183a-4d13-8167-0b3cfc1d2dd0'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:40.290112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9c707c20-e948-4707-8ac3-dac50eab953e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52037d5d6253430e81a756b993b97172', 'request_id': 'req-9c707c20-e948-4707-8ac3-dac50eab953e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:40.296954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9c707c20-e948-4707-8ac3-dac50eab953e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52037d5d6253430e81a756b993b97172', 'request_id': 'req-9c707c20-e948-4707-8ac3-dac50eab953e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:40.299982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a82bdebc-183a-4d13-8167-0b3cfc1d2dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edcc7173288d4c38b8a037e42f7d9483', 'request_id': 'req-a82bdebc-183a-4d13-8167-0b3cfc1d2dd0'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:40.305501 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9c707c20-e948-4707-8ac3-dac50eab953e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52037d5d6253430e81a756b993b97172', 'request_id': 'req-9c707c20-e948-4707-8ac3-dac50eab953e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:40.312360 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a82bdebc-183a-4d13-8167-0b3cfc1d2dd0 admin admin] The token cache is being invalidate because project edcc7173288d4c38b8a037e42f7d9483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:55:40.312701 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a82bdebc-183a-4d13-8167-0b3cfc1d2dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:40.313381 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a82bdebc-183a-4d13-8167-0b3cfc1d2dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:40.315215 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 914/1804] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:55:40 2022] DELETE /identity/v3/projects/edcc7173288d4c38b8a037e42f7d9483 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:40.318583 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9c707c20-e948-4707-8ac3-dac50eab953e admin admin] The token cache is being invalidate because project 52037d5d6253430e81a756b993b97172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:55:40.319038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9c707c20-e948-4707-8ac3-dac50eab953e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:40.319814 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9c707c20-e948-4707-8ac3-dac50eab953e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:40.319950 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a246fcc-5f2b-4716-84fe-83d40f381b92 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:40.320174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a246fcc-5f2b-4716-84fe-83d40f381b92 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:40.320505 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a246fcc-5f2b-4716-84fe-83d40f381b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:40.321537 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 891/1805] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:55:40 2022] DELETE /identity/v3/projects/52037d5d6253430e81a756b993b97172 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:55:40.325995 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16172a-03b4-42db-9348-3cb7db00f17c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:40.326287 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16172a-03b4-42db-9348-3cb7db00f17c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:40.326633 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16172a-03b4-42db-9348-3cb7db00f17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:40.338570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5a246fcc-5f2b-4716-84fe-83d40f381b92 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:40.339964 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5a246fcc-5f2b-4716-84fe-83d40f381b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:40.345988 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9e16172a-03b4-42db-9348-3cb7db00f17c None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:40.347291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9e16172a-03b4-42db-9348-3cb7db00f17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:40.396859 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 915/1806] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:55:40.403968 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 892/1807] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:55:40.404250 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0cf3e-0ea4-4229-a9ed-be36b8c4a279 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:40.404640 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0cf3e-0ea4-4229-a9ed-be36b8c4a279 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:40.404961 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0cf3e-0ea4-4229-a9ed-be36b8c4a279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:40.411532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28763a-be6b-43be-8f7e-31ed62e48981 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:40.411821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28763a-be6b-43be-8f7e-31ed62e48981 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:40.412104 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28763a-be6b-43be-8f7e-31ed62e48981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:40.423603 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-13e0cf3e-0ea4-4229-a9ed-be36b8c4a279 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:40.424814 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-13e0cf3e-0ea4-4229-a9ed-be36b8c4a279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:40.429579 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5e28763a-be6b-43be-8f7e-31ed62e48981 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:40.431116 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5e28763a-be6b-43be-8f7e-31ed62e48981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:40.433039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 916/1808] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:55:40.437041 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0cf3e-0ea4-4229-a9ed-be36b8c4a279 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:40.439132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 893/1809] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:55:40.443505 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28763a-be6b-43be-8f7e-31ed62e48981 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:40.445821 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0cf3e-0ea4-4229-a9ed-be36b8c4a279 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:40.450285 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05927fec-daaa-4d73-b73e-706a4b2e0199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:40.450932 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05927fec-daaa-4d73-b73e-706a4b2e0199 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:40.451242 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05927fec-daaa-4d73-b73e-706a4b2e0199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:40.451573 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05927fec-daaa-4d73-b73e-706a4b2e0199 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:40.452298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05927fec-daaa-4d73-b73e-706a4b2e0199 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:55:40.452384 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28763a-be6b-43be-8f7e-31ed62e48981 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:40.452605 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05927fec-daaa-4d73-b73e-706a4b2e0199 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:40.454196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05927fec-daaa-4d73-b73e-706a4b2e0199 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:40.456916 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26729271-e280-45ae-afcc-41e2d220f1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:40.457586 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26729271-e280-45ae-afcc-41e2d220f1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:40.457867 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26729271-e280-45ae-afcc-41e2d220f1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:40.458142 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26729271-e280-45ae-afcc-41e2d220f1e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:40.458863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26729271-e280-45ae-afcc-41e2d220f1e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:55:40.459211 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26729271-e280-45ae-afcc-41e2d220f1e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:40.460834 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26729271-e280-45ae-afcc-41e2d220f1e4 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:40.465357 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 917/1810] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:55:40.469651 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05927fec-daaa-4d73-b73e-706a4b2e0199 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:40.472318 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 894/1811] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:55:40.477015 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26729271-e280-45ae-afcc-41e2d220f1e4 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:40.480709 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05927fec-daaa-4d73-b73e-706a4b2e0199 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:40.487513 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49641c68-061c-4607-9838-81762f94ddf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:40.488395 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49641c68-061c-4607-9838-81762f94ddf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:40.488687 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49641c68-061c-4607-9838-81762f94ddf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:40.488889 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49641c68-061c-4607-9838-81762f94ddf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:40.489521 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49641c68-061c-4607-9838-81762f94ddf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:40.490670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26729271-e280-45ae-afcc-41e2d220f1e4 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:40.491475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49641c68-061c-4607-9838-81762f94ddf9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:40.495984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95012f41-b032-4125-a3ea-219ef06db1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:40.496860 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95012f41-b032-4125-a3ea-219ef06db1bd admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:40.497546 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95012f41-b032-4125-a3ea-219ef06db1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:40.497966 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95012f41-b032-4125-a3ea-219ef06db1bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:40.499262 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95012f41-b032-4125-a3ea-219ef06db1bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:40.501456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95012f41-b032-4125-a3ea-219ef06db1bd admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:40.525155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 918/1812] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:40 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:40.529613 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49641c68-061c-4607-9838-81762f94ddf9 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:40.539157 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 895/1813] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:40 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:55:40.540041 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95012f41-b032-4125-a3ea-219ef06db1bd admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:40.608971 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49641c68-061c-4607-9838-81762f94ddf9 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:40.630235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95012f41-b032-4125-a3ea-219ef06db1bd admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:40.638690 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f46c69-6d81-4a68-afcc-de122b2c02fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:40.639742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f46c69-6d81-4a68-afcc-de122b2c02fe admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:40.640336 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f46c69-6d81-4a68-afcc-de122b2c02fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:40.641017 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f46c69-6d81-4a68-afcc-de122b2c02fe admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:40.641949 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f46c69-6d81-4a68-afcc-de122b2c02fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:40.649300 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f46c69-6d81-4a68-afcc-de122b2c02fe admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:40.674506 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 896/1814] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:40 2022] POST /identity/v3/users => generated 294 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:40.675368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d5399-f29e-432f-9a5a-4f446fe3023f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:40.676148 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d5399-f29e-432f-9a5a-4f446fe3023f admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:40.676601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d5399-f29e-432f-9a5a-4f446fe3023f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:40.678857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f46c69-6d81-4a68-afcc-de122b2c02fe admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:40.679702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d5399-f29e-432f-9a5a-4f446fe3023f admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:40.680475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d5399-f29e-432f-9a5a-4f446fe3023f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:40.682796 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d5399-f29e-432f-9a5a-4f446fe3023f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:40.689849 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f46c69-6d81-4a68-afcc-de122b2c02fe admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:40.695465 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a996e-ecee-4eca-99dd-f1e5a14388fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:40.696301 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a996e-ecee-4eca-99dd-f1e5a14388fa admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:40.696661 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a996e-ecee-4eca-99dd-f1e5a14388fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:40.696987 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a996e-ecee-4eca-99dd-f1e5a14388fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:40.697997 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a996e-ecee-4eca-99dd-f1e5a14388fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:40.699893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a996e-ecee-4eca-99dd-f1e5a14388fa admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:40.712320 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 919/1816] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:40 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:55:40.713356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 897/1815] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:40.714586 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a996e-ecee-4eca-99dd-f1e5a14388fa admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:40.714708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d5399-f29e-432f-9a5a-4f446fe3023f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:40.724906 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a996e-ecee-4eca-99dd-f1e5a14388fa admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:40.726003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d5399-f29e-432f-9a5a-4f446fe3023f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:40.729538 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a10e9-95ab-40f8-bab5-f02db070679e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:40.730235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a10e9-95ab-40f8-bab5-f02db070679e admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:40.730482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a10e9-95ab-40f8-bab5-f02db070679e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:40.730781 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a10e9-95ab-40f8-bab5-f02db070679e admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:40.731597 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a10e9-95ab-40f8-bab5-f02db070679e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:40.733158 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a10e9-95ab-40f8-bab5-f02db070679e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:40.733283 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e811d-7370-4e4f-a657-9c2015e44044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:40.734030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e811d-7370-4e4f-a657-9c2015e44044 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:40.734908 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e811d-7370-4e4f-a657-9c2015e44044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:40.734908 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e811d-7370-4e4f-a657-9c2015e44044 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:40.735828 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e811d-7370-4e4f-a657-9c2015e44044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:40.737458 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e811d-7370-4e4f-a657-9c2015e44044 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:40.747607 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 898/1817] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:40.748525 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a10e9-95ab-40f8-bab5-f02db070679e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:40.751403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 920/1818] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:40.752256 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e811d-7370-4e4f-a657-9c2015e44044 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:40.758768 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a10e9-95ab-40f8-bab5-f02db070679e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:40.762113 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e811d-7370-4e4f-a657-9c2015e44044 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:40.763540 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097acf1f-73a6-4f6a-bd4f-c22f54730858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:40.764551 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097acf1f-73a6-4f6a-bd4f-c22f54730858 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:40.764834 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097acf1f-73a6-4f6a-bd4f-c22f54730858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:40.765106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097acf1f-73a6-4f6a-bd4f-c22f54730858 admin admin] PATH_INFO: `/v3/projects/560e4266533d433fbda39105299cfe48/users/8107fc778f3247acb65d1a427e52851c/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:40.770036 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac3c07-34ff-44de-9e28-742e7627accc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:40.770771 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac3c07-34ff-44de-9e28-742e7627accc admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:40.771143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac3c07-34ff-44de-9e28-742e7627accc admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:40.771759 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac3c07-34ff-44de-9e28-742e7627accc admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:40.772272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac3c07-34ff-44de-9e28-742e7627accc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:40.773957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac3c07-34ff-44de-9e28-742e7627accc admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:40.780219 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097acf1f-73a6-4f6a-bd4f-c22f54730858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560e4266533d433fbda39105299cfe48, user_id=8107fc778f3247acb65d1a427e52851c, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:40.782900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097acf1f-73a6-4f6a-bd4f-c22f54730858 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:40.787599 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 921/1819] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:55:40.788816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac3c07-34ff-44de-9e28-742e7627accc admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:40.796601 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 899/1820] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:40 2022] PUT /identity/v3/projects/560e4266533d433fbda39105299cfe48/users/8107fc778f3247acb65d1a427e52851c/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:40.798600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac3c07-34ff-44de-9e28-742e7627accc admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:40.807053 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2d1eb-8ad8-4be7-bec9-b2cba13d5b0d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:40.807461 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2d1eb-8ad8-4be7-bec9-b2cba13d5b0d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:40.807764 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2d1eb-8ad8-4be7-bec9-b2cba13d5b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:40.834267 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0ba2d1eb-8ad8-4be7-bec9-b2cba13d5b0d None None] MFA Rules not processed for user `8107fc778f3247acb65d1a427e52851c`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:40.835330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0ba2d1eb-8ad8-4be7-bec9-b2cba13d5b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:40.861604 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de77e7-f88c-40ee-ae32-ed537b17d39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:40.862517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de77e7-f88c-40ee-ae32-ed537b17d39a admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:40.862795 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de77e7-f88c-40ee-ae32-ed537b17d39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:40.863102 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de77e7-f88c-40ee-ae32-ed537b17d39a admin admin] PATH_INFO: `/v3/projects/4e79677801644c7a9eb407ba67f17904/users/4dcd4fefa36a4884841f3f80f92cd36c/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:40.877813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de77e7-f88c-40ee-ae32-ed537b17d39a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e79677801644c7a9eb407ba67f17904, user_id=4dcd4fefa36a4884841f3f80f92cd36c, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:40.880805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de77e7-f88c-40ee-ae32-ed537b17d39a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:40.897884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 922/1821] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:40 2022] PUT /identity/v3/projects/4e79677801644c7a9eb407ba67f17904/users/4dcd4fefa36a4884841f3f80f92cd36c/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:55:40.900398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 900/1822] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:55:40.904939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de77e7-f88c-40ee-ae32-ed537b17d39a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:40.913447 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df3c42-7d32-478a-adf4-f480c59dddd3 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:40.913748 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df3c42-7d32-478a-adf4-f480c59dddd3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:40.913748 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df3c42-7d32-478a-adf4-f480c59dddd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:40.944142 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e5df3c42-7d32-478a-adf4-f480c59dddd3 None None] MFA Rules not processed for user `4dcd4fefa36a4884841f3f80f92cd36c`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:40.945374 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e5df3c42-7d32-478a-adf4-f480c59dddd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:40.971664 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de77e7-f88c-40ee-ae32-ed537b17d39a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:40.977674 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a8919-a186-4893-af64-671292ec8684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:40.978367 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a8919-a186-4893-af64-671292ec8684 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:40.978644 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a8919-a186-4893-af64-671292ec8684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:40.978915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a8919-a186-4893-af64-671292ec8684 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:40.979643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a8919-a186-4893-af64-671292ec8684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:40.982238 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a8919-a186-4893-af64-671292ec8684 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:41.011178 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 923/1823] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:40 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:55:41.011330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 901/1824] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:55:41.012206 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a8919-a186-4893-af64-671292ec8684 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:41.021787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df3c42-7d32-478a-adf4-f480c59dddd3 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:41.024139 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e5df3c42-7d32-478a-adf4-f480c59dddd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:41.078159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a8919-a186-4893-af64-671292ec8684 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:41.083351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a15d0-fd6d-474d-ae25-83c02264318a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:41.084075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a15d0-fd6d-474d-ae25-83c02264318a admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:41.084336 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a15d0-fd6d-474d-ae25-83c02264318a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:41.084757 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a15d0-fd6d-474d-ae25-83c02264318a admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:41.085583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a15d0-fd6d-474d-ae25-83c02264318a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:41.087680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a15d0-fd6d-474d-ae25-83c02264318a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:41.095915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df3c42-7d32-478a-adf4-f480c59dddd3 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:41.109451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 924/1825] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:41 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:41.113213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a15d0-fd6d-474d-ae25-83c02264318a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:41.122613 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a15d0-fd6d-474d-ae25-83c02264318a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:41.127703 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ea6de-c6c5-4e80-8a42-3eb8a24d9aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:41.128369 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ea6de-c6c5-4e80-8a42-3eb8a24d9aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:41.128657 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ea6de-c6c5-4e80-8a42-3eb8a24d9aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:41.128936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ea6de-c6c5-4e80-8a42-3eb8a24d9aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:41.129670 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ea6de-c6c5-4e80-8a42-3eb8a24d9aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:41.131354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ea6de-c6c5-4e80-8a42-3eb8a24d9aa7 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:41.141188 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 925/1826] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:55:41.145144 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ea6de-c6c5-4e80-8a42-3eb8a24d9aa7 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:41.155051 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ea6de-c6c5-4e80-8a42-3eb8a24d9aa7 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:41.159714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb5efb-e7ce-495c-a225-603fb001ccb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:41.160140 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea68e56-2ec9-4e6a-952d-a9e53df2cba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:41.160369 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb5efb-e7ce-495c-a225-603fb001ccb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:41.160651 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb5efb-e7ce-495c-a225-603fb001ccb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:41.160922 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb5efb-e7ce-495c-a225-603fb001ccb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:41.161157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea68e56-2ec9-4e6a-952d-a9e53df2cba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:41.161436 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea68e56-2ec9-4e6a-952d-a9e53df2cba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:41.161712 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea68e56-2ec9-4e6a-952d-a9e53df2cba5 admin admin] PATH_INFO: `/v3/projects/f289ca3962f949cea23ddd58c1f0dfd8/users/44aca6b8a84045b590f71348628d4857/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:41.177150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea68e56-2ec9-4e6a-952d-a9e53df2cba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f289ca3962f949cea23ddd58c1f0dfd8, user_id=44aca6b8a84045b590f71348628d4857, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:41.180224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea68e56-2ec9-4e6a-952d-a9e53df2cba5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:41.193798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 926/1827] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:41 2022] PUT /identity/v3/projects/f289ca3962f949cea23ddd58c1f0dfd8/users/44aca6b8a84045b590f71348628d4857/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:55:41.197597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea68e56-2ec9-4e6a-952d-a9e53df2cba5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:41.219214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb5efb-e7ce-495c-a225-603fb001ccb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:41.220657 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb5efb-e7ce-495c-a225-603fb001ccb3 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:41.229427 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 902/1828] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:41.251565 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb5efb-e7ce-495c-a225-603fb001ccb3 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:41.261476 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea68e56-2ec9-4e6a-952d-a9e53df2cba5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:41.262318 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb5efb-e7ce-495c-a225-603fb001ccb3 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:41.266446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d42a04-ae47-4312-9bda-5b7a9c29f8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:41.267143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d42a04-ae47-4312-9bda-5b7a9c29f8ec admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:41.267302 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e30a9b-56c2-44d5-abc3-28bcf0c95501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:41.267548 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d42a04-ae47-4312-9bda-5b7a9c29f8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:41.267823 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d42a04-ae47-4312-9bda-5b7a9c29f8ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:41.268182 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e30a9b-56c2-44d5-abc3-28bcf0c95501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:41.268462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e30a9b-56c2-44d5-abc3-28bcf0c95501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:41.268565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d42a04-ae47-4312-9bda-5b7a9c29f8ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:41.268735 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e30a9b-56c2-44d5-abc3-28bcf0c95501 admin admin] PATH_INFO: `/v3/users/4dcd4fefa36a4884841f3f80f92cd36c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:41.269930 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e30a9b-56c2-44d5-abc3-28bcf0c95501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dcd4fefa36a4884841f3f80f92cd36c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:41.270106 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d42a04-ae47-4312-9bda-5b7a9c29f8ec admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:41.271871 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e30a9b-56c2-44d5-abc3-28bcf0c95501 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:41.285275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 927/1829] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:55:41.285275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d42a04-ae47-4312-9bda-5b7a9c29f8ec admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:41.294477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d42a04-ae47-4312-9bda-5b7a9c29f8ec admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:41.299869 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54032730-e185-4fe1-9523-bbce559b23a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:41.300757 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54032730-e185-4fe1-9523-bbce559b23a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:41.301076 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54032730-e185-4fe1-9523-bbce559b23a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:41.301413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54032730-e185-4fe1-9523-bbce559b23a8 admin admin] PATH_INFO: `/v3/projects/f289ca3962f949cea23ddd58c1f0dfd8/users/44aca6b8a84045b590f71348628d4857/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:41.303654 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54032730-e185-4fe1-9523-bbce559b23a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f289ca3962f949cea23ddd58c1f0dfd8, user_id=44aca6b8a84045b590f71348628d4857, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:41.307094 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54032730-e185-4fe1-9523-bbce559b23a8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:41.317342 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 928/1830] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:41 2022] PUT /identity/v3/projects/f289ca3962f949cea23ddd58c1f0dfd8/users/44aca6b8a84045b590f71348628d4857/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:41.319921 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-04e30a9b-56c2-44d5-abc3-28bcf0c95501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dcd4fefa36a4884841f3f80f92cd36c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:41.328659 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169d8ab-aac9-4945-b639-815895974dcb None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:41.328945 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169d8ab-aac9-4945-b639-815895974dcb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:41.329211 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169d8ab-aac9-4945-b639-815895974dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:41.331389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-04e30a9b-56c2-44d5-abc3-28bcf0c95501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dcd4fefa36a4884841f3f80f92cd36c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:41.332122 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-04e30a9b-56c2-44d5-abc3-28bcf0c95501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dcd4fefa36a4884841f3f80f92cd36c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:41.332744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-04e30a9b-56c2-44d5-abc3-28bcf0c95501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dcd4fefa36a4884841f3f80f92cd36c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:41.340619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-04e30a9b-56c2-44d5-abc3-28bcf0c95501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dcd4fefa36a4884841f3f80f92cd36c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:41.352471 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 903/1831] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:55:41 2022] DELETE /identity/v3/users/4dcd4fefa36a4884841f3f80f92cd36c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:41.354871 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9169d8ab-aac9-4945-b639-815895974dcb None None] MFA Rules not processed for user `44aca6b8a84045b590f71348628d4857`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:41.356118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9169d8ab-aac9-4945-b639-815895974dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:41.356718 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5f6bb-f045-4f96-84a6-fdffbc7d5e26 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:41.357007 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5f6bb-f045-4f96-84a6-fdffbc7d5e26 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:41.357285 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5f6bb-f045-4f96-84a6-fdffbc7d5e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:41.374674 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-56b5f6bb-f045-4f96-84a6-fdffbc7d5e26 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:41.376202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-56b5f6bb-f045-4f96-84a6-fdffbc7d5e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:41.428139 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 929/1832] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:41.441344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169d8ab-aac9-4945-b639-815895974dcb None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:41.442855 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9169d8ab-aac9-4945-b639-815895974dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:41.444080 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 904/1833] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:55:41.454756 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5f6bb-f045-4f96-84a6-fdffbc7d5e26 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:41.456816 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-56b5f6bb-f045-4f96-84a6-fdffbc7d5e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:41.500424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169d8ab-aac9-4945-b639-815895974dcb None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:41.504128 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12953f6-3196-475a-9835-2a6c83d8dc04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:41.505223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12953f6-3196-475a-9835-2a6c83d8dc04 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:41.505223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12953f6-3196-475a-9835-2a6c83d8dc04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:41.505451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12953f6-3196-475a-9835-2a6c83d8dc04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:41.515775 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5f6bb-f045-4f96-84a6-fdffbc7d5e26 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:41.517107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12953f6-3196-475a-9835-2a6c83d8dc04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:41.518547 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12953f6-3196-475a-9835-2a6c83d8dc04 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:41.519620 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf848c-d288-4777-89a3-7702c0b227f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:41.520340 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf848c-d288-4777-89a3-7702c0b227f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:41.520682 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf848c-d288-4777-89a3-7702c0b227f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:41.521110 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf848c-d288-4777-89a3-7702c0b227f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:41.530404 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 930/1834] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:55:41.542856 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf848c-d288-4777-89a3-7702c0b227f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:41.544405 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf848c-d288-4777-89a3-7702c0b227f7 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:41.554229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 905/1835] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:55:41.597490 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12953f6-3196-475a-9835-2a6c83d8dc04 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:41.599160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c12953f6-3196-475a-9835-2a6c83d8dc04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:41.616873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12953f6-3196-475a-9835-2a6c83d8dc04 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:41.623855 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c158a-ff3a-4915-91d1-f30a2b233baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:41.624748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c158a-ff3a-4915-91d1-f30a2b233baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:41.625030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c158a-ff3a-4915-91d1-f30a2b233baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:41.625301 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c158a-ff3a-4915-91d1-f30a2b233baf admin admin] PATH_INFO: `/v3/users/8107fc778f3247acb65d1a427e52851c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:41.626765 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c158a-ff3a-4915-91d1-f30a2b233baf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8107fc778f3247acb65d1a427e52851c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:41.628882 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c158a-ff3a-4915-91d1-f30a2b233baf admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:41.680717 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fc7c158a-ff3a-4915-91d1-f30a2b233baf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8107fc778f3247acb65d1a427e52851c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:41.698347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fc7c158a-ff3a-4915-91d1-f30a2b233baf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8107fc778f3247acb65d1a427e52851c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:41.699109 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fc7c158a-ff3a-4915-91d1-f30a2b233baf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8107fc778f3247acb65d1a427e52851c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:41.699815 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fc7c158a-ff3a-4915-91d1-f30a2b233baf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8107fc778f3247acb65d1a427e52851c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:41.710204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fc7c158a-ff3a-4915-91d1-f30a2b233baf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8107fc778f3247acb65d1a427e52851c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:41.728062 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 931/1836] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:55:41 2022] DELETE /identity/v3/users/8107fc778f3247acb65d1a427e52851c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:41.732617 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7d607-b4c6-449b-8861-5890a9be9b12 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:41.733183 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7d607-b4c6-449b-8861-5890a9be9b12 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:41.733464 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7d607-b4c6-449b-8861-5890a9be9b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:41.751730 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-43a7d607-b4c6-449b-8861-5890a9be9b12 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:41.752947 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-43a7d607-b4c6-449b-8861-5890a9be9b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:41.831648 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 906/1837] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:55:41.866119 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c158a-ff3a-4915-91d1-f30a2b233baf admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:41.866942 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fc7c158a-ff3a-4915-91d1-f30a2b233baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:41.894494 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7d607-b4c6-449b-8861-5890a9be9b12 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:41.896046 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-43a7d607-b4c6-449b-8861-5890a9be9b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:41.907912 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7d607-b4c6-449b-8861-5890a9be9b12 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:41.912691 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373331ce-cff8-416c-a846-b67c5f389b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:41.913575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373331ce-cff8-416c-a846-b67c5f389b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:41.913857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373331ce-cff8-416c-a846-b67c5f389b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:41.914129 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373331ce-cff8-416c-a846-b67c5f389b93 admin admin] PATH_INFO: `/v3/projects/4e79677801644c7a9eb407ba67f17904` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:41.915360 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373331ce-cff8-416c-a846-b67c5f389b93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e79677801644c7a9eb407ba67f17904)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:41.918025 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373331ce-cff8-416c-a846-b67c5f389b93 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:41.949253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c158a-ff3a-4915-91d1-f30a2b233baf admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:41.953926 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777ccff-a67d-494b-a297-731107daf4b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:41.954599 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777ccff-a67d-494b-a297-731107daf4b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:41.955933 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777ccff-a67d-494b-a297-731107daf4b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:41.956224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777ccff-a67d-494b-a297-731107daf4b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:41.978877 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777ccff-a67d-494b-a297-731107daf4b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:41.978877 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777ccff-a67d-494b-a297-731107daf4b7 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:41.990005 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-373331ce-cff8-416c-a846-b67c5f389b93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e79677801644c7a9eb407ba67f17904', 'request_id': 'req-373331ce-cff8-416c-a846-b67c5f389b93'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:41.998075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-373331ce-cff8-416c-a846-b67c5f389b93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e79677801644c7a9eb407ba67f17904', 'request_id': 'req-373331ce-cff8-416c-a846-b67c5f389b93'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:42.001601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 932/1838] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:42.011358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-373331ce-cff8-416c-a846-b67c5f389b93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e79677801644c7a9eb407ba67f17904', 'request_id': 'req-373331ce-cff8-416c-a846-b67c5f389b93'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:42.021833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-373331ce-cff8-416c-a846-b67c5f389b93 admin admin] The token cache is being invalidate because project 4e79677801644c7a9eb407ba67f17904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:55:42.022237 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-373331ce-cff8-416c-a846-b67c5f389b93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:42.023054 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-373331ce-cff8-416c-a846-b67c5f389b93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:42.025001 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 907/1839] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:55:41 2022] DELETE /identity/v3/projects/4e79677801644c7a9eb407ba67f17904 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:55:42.029921 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464efc9d-ec1d-4ae0-8e50-2fdc9448f25e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:42.030213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464efc9d-ec1d-4ae0-8e50-2fdc9448f25e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:42.030492 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464efc9d-ec1d-4ae0-8e50-2fdc9448f25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:42.049246 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-464efc9d-ec1d-4ae0-8e50-2fdc9448f25e None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:42.050479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-464efc9d-ec1d-4ae0-8e50-2fdc9448f25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:42.120597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 933/1840] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:42.128310 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea4e77-a835-4b37-a811-5e1ae6f97e03 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:42.128608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea4e77-a835-4b37-a811-5e1ae6f97e03 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:42.128879 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea4e77-a835-4b37-a811-5e1ae6f97e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:42.157140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f3ea4e77-a835-4b37-a811-5e1ae6f97e03 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:42.158476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f3ea4e77-a835-4b37-a811-5e1ae6f97e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:42.170998 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 908/1841] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:42.173103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464efc9d-ec1d-4ae0-8e50-2fdc9448f25e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:42.184069 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464efc9d-ec1d-4ae0-8e50-2fdc9448f25e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:42.190180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34d21b-5f2f-4dc2-a053-d6388409e25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:42.190851 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34d21b-5f2f-4dc2-a053-d6388409e25c admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:42.191164 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34d21b-5f2f-4dc2-a053-d6388409e25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:42.191455 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34d21b-5f2f-4dc2-a053-d6388409e25c admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:42.194112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34d21b-5f2f-4dc2-a053-d6388409e25c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:55:42.194112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34d21b-5f2f-4dc2-a053-d6388409e25c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:42.195804 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34d21b-5f2f-4dc2-a053-d6388409e25c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:42.209254 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 934/1842] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:55:42.213601 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea4e77-a835-4b37-a811-5e1ae6f97e03 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:42.223325 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea4e77-a835-4b37-a811-5e1ae6f97e03 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:42.228280 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470a250-73df-4714-9394-fad96125ecc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:42.228976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470a250-73df-4714-9394-fad96125ecc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:42.229257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470a250-73df-4714-9394-fad96125ecc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:42.229529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470a250-73df-4714-9394-fad96125ecc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:42.230232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470a250-73df-4714-9394-fad96125ecc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:42.233167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470a250-73df-4714-9394-fad96125ecc7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:42.268399 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 909/1843] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:42 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:42.272021 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34d21b-5f2f-4dc2-a053-d6388409e25c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:42.284145 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34d21b-5f2f-4dc2-a053-d6388409e25c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:42.348443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb872d-46f7-4e70-be33-0ec8de6f5f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:42.349128 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb872d-46f7-4e70-be33-0ec8de6f5f8e admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:42.349412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb872d-46f7-4e70-be33-0ec8de6f5f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:42.349690 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb872d-46f7-4e70-be33-0ec8de6f5f8e admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:42.350387 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb872d-46f7-4e70-be33-0ec8de6f5f8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:42.353874 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb872d-46f7-4e70-be33-0ec8de6f5f8e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:42.386381 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 935/1844] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:42 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:42.387725 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470a250-73df-4714-9394-fad96125ecc7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:42.399219 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470a250-73df-4714-9394-fad96125ecc7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:42.404899 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506dcf41-2e7b-4c7e-88b3-909702e0799d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:42.405726 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dcf41-2e7b-4c7e-88b3-909702e0799d admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:42.406012 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dcf41-2e7b-4c7e-88b3-909702e0799d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:42.406290 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dcf41-2e7b-4c7e-88b3-909702e0799d admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:42.407068 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506dcf41-2e7b-4c7e-88b3-909702e0799d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:42.408726 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506dcf41-2e7b-4c7e-88b3-909702e0799d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:42.424073 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 910/1845] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:42.425325 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb872d-46f7-4e70-be33-0ec8de6f5f8e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:42.436477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb872d-46f7-4e70-be33-0ec8de6f5f8e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:42.442293 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a766b1-8e2b-4f63-9675-c23170c6a2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:42.443819 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a766b1-8e2b-4f63-9675-c23170c6a2bf admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:42.444311 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a766b1-8e2b-4f63-9675-c23170c6a2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:42.444785 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a766b1-8e2b-4f63-9675-c23170c6a2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:42.445760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a766b1-8e2b-4f63-9675-c23170c6a2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:42.448437 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a766b1-8e2b-4f63-9675-c23170c6a2bf admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:42.461644 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 936/1846] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:42.465860 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506dcf41-2e7b-4c7e-88b3-909702e0799d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:42.477554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506dcf41-2e7b-4c7e-88b3-909702e0799d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:42.483185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791e97d-22d5-44c8-9e84-73265a4f75a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:42.484085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791e97d-22d5-44c8-9e84-73265a4f75a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:42.484361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791e97d-22d5-44c8-9e84-73265a4f75a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:42.485107 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791e97d-22d5-44c8-9e84-73265a4f75a1 admin admin] PATH_INFO: `/v3/projects/ce4d0d764bd34a388c3087b3d47d185d/users/62727a427df44e8c9369129e5294beff/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:42.501864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791e97d-22d5-44c8-9e84-73265a4f75a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4d0d764bd34a388c3087b3d47d185d, user_id=62727a427df44e8c9369129e5294beff, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:42.504572 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791e97d-22d5-44c8-9e84-73265a4f75a1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:42.520789 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 911/1847] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:42 2022] PUT /identity/v3/projects/ce4d0d764bd34a388c3087b3d47d185d/users/62727a427df44e8c9369129e5294beff/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:55:42.531182 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaaab53-5719-4c09-86fe-812a370106b4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:42.531904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaaab53-5719-4c09-86fe-812a370106b4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:42.532255 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaaab53-5719-4c09-86fe-812a370106b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:42.571443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-eaaaab53-5719-4c09-86fe-812a370106b4 None None] MFA Rules not processed for user `62727a427df44e8c9369129e5294beff`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:42.572732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-eaaaab53-5719-4c09-86fe-812a370106b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:42.659424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 937/1848] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:42.663774 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791e97d-22d5-44c8-9e84-73265a4f75a1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:42.737388 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791e97d-22d5-44c8-9e84-73265a4f75a1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:42.742057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b899a-4055-4e40-bc54-ddfbd9b321b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:42.742721 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b899a-4055-4e40-bc54-ddfbd9b321b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:42.743022 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b899a-4055-4e40-bc54-ddfbd9b321b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:42.743298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b899a-4055-4e40-bc54-ddfbd9b321b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:42.744281 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b899a-4055-4e40-bc54-ddfbd9b321b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:42.746195 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b899a-4055-4e40-bc54-ddfbd9b321b2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:42.788357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 912/1849] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:42 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:55:42.792071 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaaab53-5719-4c09-86fe-812a370106b4 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:42.804544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaaab53-5719-4c09-86fe-812a370106b4 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:42.845408 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b899a-4055-4e40-bc54-ddfbd9b321b2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:42.856263 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-db5b899a-4055-4e40-bc54-ddfbd9b321b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:42.883585 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce72ca9-51e0-4d4a-bb64-e0bd24cbf501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:42.884352 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce72ca9-51e0-4d4a-bb64-e0bd24cbf501 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:42.884734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce72ca9-51e0-4d4a-bb64-e0bd24cbf501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:42.886020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce72ca9-51e0-4d4a-bb64-e0bd24cbf501 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:42.886131 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce72ca9-51e0-4d4a-bb64-e0bd24cbf501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:42.888935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce72ca9-51e0-4d4a-bb64-e0bd24cbf501 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:42.929750 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 938/1850] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:42 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:42.931385 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce72ca9-51e0-4d4a-bb64-e0bd24cbf501 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:42.961303 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce72ca9-51e0-4d4a-bb64-e0bd24cbf501 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:42.988711 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00712723-a59e-43bf-8e5b-f385b9710633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:42.998662 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00712723-a59e-43bf-8e5b-f385b9710633 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:42.999017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00712723-a59e-43bf-8e5b-f385b9710633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:42.999317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00712723-a59e-43bf-8e5b-f385b9710633 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:43.003234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00712723-a59e-43bf-8e5b-f385b9710633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:43.010861 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00712723-a59e-43bf-8e5b-f385b9710633 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:43.038861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b899a-4055-4e40-bc54-ddfbd9b321b2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:43.044509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d573d5a-a2a8-4159-b4c3-9c5562aa2270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:43.045357 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 939/1851] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:55:43.047085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d573d5a-a2a8-4159-b4c3-9c5562aa2270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:43.048359 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d573d5a-a2a8-4159-b4c3-9c5562aa2270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:43.049514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d573d5a-a2a8-4159-b4c3-9c5562aa2270 admin admin] PATH_INFO: `/v3/projects/560e4266533d433fbda39105299cfe48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:43.051645 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00712723-a59e-43bf-8e5b-f385b9710633 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:43.052596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d573d5a-a2a8-4159-b4c3-9c5562aa2270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=560e4266533d433fbda39105299cfe48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:43.054536 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d573d5a-a2a8-4159-b4c3-9c5562aa2270 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:43.078414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00712723-a59e-43bf-8e5b-f385b9710633 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:43.096620 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f223063-697e-490c-8836-bd56c0fdc9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:43.099427 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f223063-697e-490c-8836-bd56c0fdc9e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:43.099811 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f223063-697e-490c-8836-bd56c0fdc9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:43.102416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f223063-697e-490c-8836-bd56c0fdc9e9 admin admin] PATH_INFO: `/v3/projects/f028bf78970e4dfb93839111a56eee1d/users/3c85d32560ad43018a8bc70663cbf9be/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:43.129012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f223063-697e-490c-8836-bd56c0fdc9e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f028bf78970e4dfb93839111a56eee1d, user_id=3c85d32560ad43018a8bc70663cbf9be, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:43.133279 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f223063-697e-490c-8836-bd56c0fdc9e9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:43.166605 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 940/1852] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:43 2022] PUT /identity/v3/projects/f028bf78970e4dfb93839111a56eee1d/users/3c85d32560ad43018a8bc70663cbf9be/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:43.171426 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f223063-697e-490c-8836-bd56c0fdc9e9 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:43.190885 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3d573d5a-a2a8-4159-b4c3-9c5562aa2270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560e4266533d433fbda39105299cfe48', 'request_id': 'req-3d573d5a-a2a8-4159-b4c3-9c5562aa2270'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:43.200284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3d573d5a-a2a8-4159-b4c3-9c5562aa2270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560e4266533d433fbda39105299cfe48', 'request_id': 'req-3d573d5a-a2a8-4159-b4c3-9c5562aa2270'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:43.212894 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3d573d5a-a2a8-4159-b4c3-9c5562aa2270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560e4266533d433fbda39105299cfe48', 'request_id': 'req-3d573d5a-a2a8-4159-b4c3-9c5562aa2270'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:43.244730 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3d573d5a-a2a8-4159-b4c3-9c5562aa2270 admin admin] The token cache is being invalidate because project 560e4266533d433fbda39105299cfe48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:55:43.245021 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3d573d5a-a2a8-4159-b4c3-9c5562aa2270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:43.255525 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3d573d5a-a2a8-4159-b4c3-9c5562aa2270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:43.260376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 913/1853] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:55:42 2022] DELETE /identity/v3/projects/560e4266533d433fbda39105299cfe48 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:43.264230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d573d5a-a2a8-4159-b4c3-9c5562aa2270 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:43.268520 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3d573d5a-a2a8-4159-b4c3-9c5562aa2270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:43.285610 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f223063-697e-490c-8836-bd56c0fdc9e9 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:43.295334 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158042e-594d-4e9a-b4ef-356bd4761175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:43.296117 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158042e-594d-4e9a-b4ef-356bd4761175 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:43.296395 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158042e-594d-4e9a-b4ef-356bd4761175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:43.296671 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158042e-594d-4e9a-b4ef-356bd4761175 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:43.297514 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158042e-594d-4e9a-b4ef-356bd4761175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:43.299761 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158042e-594d-4e9a-b4ef-356bd4761175 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:43.315184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 941/1854] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:43.319174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158042e-594d-4e9a-b4ef-356bd4761175 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:43.321697 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5158042e-594d-4e9a-b4ef-356bd4761175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:43.337443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158042e-594d-4e9a-b4ef-356bd4761175 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:43.343572 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d825ef-0e1e-48c2-b542-d752b5bdb6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:43.347314 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d825ef-0e1e-48c2-b542-d752b5bdb6a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:43.347705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d825ef-0e1e-48c2-b542-d752b5bdb6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:43.348866 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d825ef-0e1e-48c2-b542-d752b5bdb6a9 admin admin] PATH_INFO: `/v3/projects/f028bf78970e4dfb93839111a56eee1d/users/3c85d32560ad43018a8bc70663cbf9be/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:43.353999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d825ef-0e1e-48c2-b542-d752b5bdb6a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f028bf78970e4dfb93839111a56eee1d, user_id=3c85d32560ad43018a8bc70663cbf9be, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:43.357683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d825ef-0e1e-48c2-b542-d752b5bdb6a9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:43.373355 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 942/1855] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:43 2022] PUT /identity/v3/projects/f028bf78970e4dfb93839111a56eee1d/users/3c85d32560ad43018a8bc70663cbf9be/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:55:43.385950 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfb77d-fd71-4873-b40a-b1cb353f7f9b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:43.386312 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfb77d-fd71-4873-b40a-b1cb353f7f9b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:43.386808 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfb77d-fd71-4873-b40a-b1cb353f7f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:43.418768 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2dbfb77d-fd71-4873-b40a-b1cb353f7f9b None None] MFA Rules not processed for user `3c85d32560ad43018a8bc70663cbf9be`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:43.420551 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2dbfb77d-fd71-4873-b40a-b1cb353f7f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:43.435606 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d573d5a-a2a8-4159-b4c3-9c5562aa2270 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:43.535525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 943/1856] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:43.561333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfb77d-fd71-4873-b40a-b1cb353f7f9b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:43.564008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2dbfb77d-fd71-4873-b40a-b1cb353f7f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:43.572921 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0100b1-6c83-4892-81c8-57d607345b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:43.574234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0100b1-6c83-4892-81c8-57d607345b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:43.574682 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0100b1-6c83-4892-81c8-57d607345b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:43.575197 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0100b1-6c83-4892-81c8-57d607345b36 admin admin] PATH_INFO: `/v3/users/44aca6b8a84045b590f71348628d4857` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:43.576727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0100b1-6c83-4892-81c8-57d607345b36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44aca6b8a84045b590f71348628d4857)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:43.579317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0100b1-6c83-4892-81c8-57d607345b36 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:43.651159 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4c0100b1-6c83-4892-81c8-57d607345b36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44aca6b8a84045b590f71348628d4857'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:43.655625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfb77d-fd71-4873-b40a-b1cb353f7f9b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:43.660757 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eff230-01bd-4c5c-9fc2-2b744b678885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:43.661472 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eff230-01bd-4c5c-9fc2-2b744b678885 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:43.662224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eff230-01bd-4c5c-9fc2-2b744b678885 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:43.662224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eff230-01bd-4c5c-9fc2-2b744b678885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:43.664103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-78eff230-01bd-4c5c-9fc2-2b744b678885 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:43.668270 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4c0100b1-6c83-4892-81c8-57d607345b36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44aca6b8a84045b590f71348628d4857'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:43.669279 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4c0100b1-6c83-4892-81c8-57d607345b36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44aca6b8a84045b590f71348628d4857'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:43.670173 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4c0100b1-6c83-4892-81c8-57d607345b36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44aca6b8a84045b590f71348628d4857'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:43.683684 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4c0100b1-6c83-4892-81c8-57d607345b36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44aca6b8a84045b590f71348628d4857'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:43.700450 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 914/1857] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:55:43 2022] DELETE /identity/v3/users/44aca6b8a84045b590f71348628d4857 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:55:43.757392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eff230-01bd-4c5c-9fc2-2b744b678885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:43.759970 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eff230-01bd-4c5c-9fc2-2b744b678885 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:43.775925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 944/1858] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:55:44.122019 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0100b1-6c83-4892-81c8-57d607345b36 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:44.126111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4c0100b1-6c83-4892-81c8-57d607345b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:44.323016 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0100b1-6c83-4892-81c8-57d607345b36 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:44.340450 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80a90a-4885-4e30-988b-d8c895b888ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:44.340973 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80a90a-4885-4e30-988b-d8c895b888ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:44.341404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80a90a-4885-4e30-988b-d8c895b888ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:44.341717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80a90a-4885-4e30-988b-d8c895b888ad admin admin] PATH_INFO: `/v3/projects/f289ca3962f949cea23ddd58c1f0dfd8` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:44.343179 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80a90a-4885-4e30-988b-d8c895b888ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=f289ca3962f949cea23ddd58c1f0dfd8)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:44.345338 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80a90a-4885-4e30-988b-d8c895b888ad admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:44.401124 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9e80a90a-4885-4e30-988b-d8c895b888ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f289ca3962f949cea23ddd58c1f0dfd8', 'request_id': 'req-9e80a90a-4885-4e30-988b-d8c895b888ad'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:44.410210 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9e80a90a-4885-4e30-988b-d8c895b888ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f289ca3962f949cea23ddd58c1f0dfd8', 'request_id': 'req-9e80a90a-4885-4e30-988b-d8c895b888ad'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:44.422306 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9e80a90a-4885-4e30-988b-d8c895b888ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f289ca3962f949cea23ddd58c1f0dfd8', 'request_id': 'req-9e80a90a-4885-4e30-988b-d8c895b888ad'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:44.440943 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9e80a90a-4885-4e30-988b-d8c895b888ad admin admin] The token cache is being invalidate because project f289ca3962f949cea23ddd58c1f0dfd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:55:44.441520 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9e80a90a-4885-4e30-988b-d8c895b888ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:44.442596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9e80a90a-4885-4e30-988b-d8c895b888ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:44.444533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 915/1859] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:55:44 2022] DELETE /identity/v3/projects/f289ca3962f949cea23ddd58c1f0dfd8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:44.449466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1512b79-fdce-46db-bd22-c222a80c98b8 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:44.449916 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1512b79-fdce-46db-bd22-c222a80c98b8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:44.450089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1512b79-fdce-46db-bd22-c222a80c98b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:44.470852 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a1512b79-fdce-46db-bd22-c222a80c98b8 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:44.472145 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a1512b79-fdce-46db-bd22-c222a80c98b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:44.547253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 945/1860] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:44.553077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a0763-d25b-48e7-8482-ed4c6c9df192 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:44.553368 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a0763-d25b-48e7-8482-ed4c6c9df192 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:44.553641 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a0763-d25b-48e7-8482-ed4c6c9df192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:44.572679 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8f9a0763-d25b-48e7-8482-ed4c6c9df192 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:44.573905 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8f9a0763-d25b-48e7-8482-ed4c6c9df192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:44.585395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 916/1861] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:55:44.587287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1512b79-fdce-46db-bd22-c222a80c98b8 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:44.597439 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1512b79-fdce-46db-bd22-c222a80c98b8 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:44.601993 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3170f-d396-4df9-9ede-b4a2b75a0b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:44.602666 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3170f-d396-4df9-9ede-b4a2b75a0b6b admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:44.602940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3170f-d396-4df9-9ede-b4a2b75a0b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:44.603248 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3170f-d396-4df9-9ede-b4a2b75a0b6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:44.604179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3170f-d396-4df9-9ede-b4a2b75a0b6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:55:44.604567 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3170f-d396-4df9-9ede-b4a2b75a0b6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:44.606394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3170f-d396-4df9-9ede-b4a2b75a0b6b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:44.619933 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 946/1862] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:55:44.624744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a0763-d25b-48e7-8482-ed4c6c9df192 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:44.635109 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a0763-d25b-48e7-8482-ed4c6c9df192 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:44.641130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f01fb-5748-4cc9-a93d-8d51e935cace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:44.641940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f01fb-5748-4cc9-a93d-8d51e935cace admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:44.642223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f01fb-5748-4cc9-a93d-8d51e935cace admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:44.642497 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f01fb-5748-4cc9-a93d-8d51e935cace admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:44.643266 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f01fb-5748-4cc9-a93d-8d51e935cace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:44.645205 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f01fb-5748-4cc9-a93d-8d51e935cace admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:44.675004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 917/1863] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:44 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:44.678546 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3170f-d396-4df9-9ede-b4a2b75a0b6b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:44.688840 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3170f-d396-4df9-9ede-b4a2b75a0b6b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:44.741989 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c16134-05fd-46b5-a9c8-d0014178ad37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:44.742667 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c16134-05fd-46b5-a9c8-d0014178ad37 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:44.742949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c16134-05fd-46b5-a9c8-d0014178ad37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:44.743357 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c16134-05fd-46b5-a9c8-d0014178ad37 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:44.743996 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c16134-05fd-46b5-a9c8-d0014178ad37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:44.745910 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c16134-05fd-46b5-a9c8-d0014178ad37 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:44.766713 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 947/1864] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:44 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:44.770848 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f01fb-5748-4cc9-a93d-8d51e935cace admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:44.781002 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f01fb-5748-4cc9-a93d-8d51e935cace admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:44.786300 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf266a-137a-4de8-9978-434f3eb6898b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:44.786978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf266a-137a-4de8-9978-434f3eb6898b admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:44.787315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf266a-137a-4de8-9978-434f3eb6898b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:44.787540 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf266a-137a-4de8-9978-434f3eb6898b admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:44.788266 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf266a-137a-4de8-9978-434f3eb6898b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:44.789846 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf266a-137a-4de8-9978-434f3eb6898b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:44.803692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 918/1865] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:44.804903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c16134-05fd-46b5-a9c8-d0014178ad37 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:44.815482 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c16134-05fd-46b5-a9c8-d0014178ad37 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:44.820721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadb9fb-a07b-4620-9d82-7d11c58e96b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:44.821398 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadb9fb-a07b-4620-9d82-7d11c58e96b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:44.821681 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadb9fb-a07b-4620-9d82-7d11c58e96b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:44.821953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadb9fb-a07b-4620-9d82-7d11c58e96b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:44.822678 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadb9fb-a07b-4620-9d82-7d11c58e96b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:44.824320 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadb9fb-a07b-4620-9d82-7d11c58e96b9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:44.834622 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 948/1866] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:44.838662 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf266a-137a-4de8-9978-434f3eb6898b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:44.849621 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf266a-137a-4de8-9978-434f3eb6898b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:44.855149 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f227020-fa3b-4bec-85b2-3c04f87b4776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:44.856040 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f227020-fa3b-4bec-85b2-3c04f87b4776 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:44.856315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f227020-fa3b-4bec-85b2-3c04f87b4776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:44.856584 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f227020-fa3b-4bec-85b2-3c04f87b4776 admin admin] PATH_INFO: `/v3/projects/a12144f2cd684335a206fbe652dca6f6/users/0597058707c546feb0e487682af59e69/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:44.872275 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f227020-fa3b-4bec-85b2-3c04f87b4776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a12144f2cd684335a206fbe652dca6f6, user_id=0597058707c546feb0e487682af59e69, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:44.874915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f227020-fa3b-4bec-85b2-3c04f87b4776 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:44.891674 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 919/1867] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:44 2022] PUT /identity/v3/projects/a12144f2cd684335a206fbe652dca6f6/users/0597058707c546feb0e487682af59e69/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:44.905641 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92eb7e-369c-47cd-a3a2-00a8d2440542 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:44.905931 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92eb7e-369c-47cd-a3a2-00a8d2440542 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:44.906208 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92eb7e-369c-47cd-a3a2-00a8d2440542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:44.936856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7e92eb7e-369c-47cd-a3a2-00a8d2440542 None None] MFA Rules not processed for user `0597058707c546feb0e487682af59e69`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:44.938255 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7e92eb7e-369c-47cd-a3a2-00a8d2440542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:45.007286 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 949/1868] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:45.011953 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f227020-fa3b-4bec-85b2-3c04f87b4776 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:45.077559 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f227020-fa3b-4bec-85b2-3c04f87b4776 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:45.083169 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89adfe-d75e-42f9-8ab0-07664ed3ff76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:45.083833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89adfe-d75e-42f9-8ab0-07664ed3ff76 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:45.084115 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89adfe-d75e-42f9-8ab0-07664ed3ff76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:45.084397 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89adfe-d75e-42f9-8ab0-07664ed3ff76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:45.085078 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89adfe-d75e-42f9-8ab0-07664ed3ff76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:45.086998 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89adfe-d75e-42f9-8ab0-07664ed3ff76 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:45.115035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 920/1869] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:45 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:45.119414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92eb7e-369c-47cd-a3a2-00a8d2440542 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:45.130827 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92eb7e-369c-47cd-a3a2-00a8d2440542 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:45.191496 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558de836-01e2-4784-b826-bd948814a950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:45.192170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558de836-01e2-4784-b826-bd948814a950 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:45.192451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558de836-01e2-4784-b826-bd948814a950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:45.192728 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558de836-01e2-4784-b826-bd948814a950 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:45.193421 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558de836-01e2-4784-b826-bd948814a950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:45.195385 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558de836-01e2-4784-b826-bd948814a950 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:45.214927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 950/1870] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:45 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:55:45.219757 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89adfe-d75e-42f9-8ab0-07664ed3ff76 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:45.230398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89adfe-d75e-42f9-8ab0-07664ed3ff76 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:45.235428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69184e58-8ca6-44da-b4ee-67b3cef6758b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:45.236091 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69184e58-8ca6-44da-b4ee-67b3cef6758b admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:45.236374 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69184e58-8ca6-44da-b4ee-67b3cef6758b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:45.236645 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69184e58-8ca6-44da-b4ee-67b3cef6758b admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:45.237336 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69184e58-8ca6-44da-b4ee-67b3cef6758b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:45.238930 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69184e58-8ca6-44da-b4ee-67b3cef6758b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:45.253330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 921/1871] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:45.257837 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558de836-01e2-4784-b826-bd948814a950 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:45.268860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558de836-01e2-4784-b826-bd948814a950 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:45.274710 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf8591-1217-4d15-a38a-730af13ace94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:45.275643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf8591-1217-4d15-a38a-730af13ace94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:45.275920 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf8591-1217-4d15-a38a-730af13ace94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:45.276191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf8591-1217-4d15-a38a-730af13ace94 admin admin] PATH_INFO: `/v3/projects/1f0a6c20466f4cccba510a626f9708bb/users/29acd49d632c4a4797203cb1ccced65c/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:45.292317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf8591-1217-4d15-a38a-730af13ace94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0a6c20466f4cccba510a626f9708bb, user_id=29acd49d632c4a4797203cb1ccced65c, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:45.295021 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf8591-1217-4d15-a38a-730af13ace94 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:45.308560 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 951/1872] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:45 2022] PUT /identity/v3/projects/1f0a6c20466f4cccba510a626f9708bb/users/29acd49d632c4a4797203cb1ccced65c/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:45.312710 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69184e58-8ca6-44da-b4ee-67b3cef6758b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:45.322549 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69184e58-8ca6-44da-b4ee-67b3cef6758b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:45.386840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a4113-be1a-4715-a20b-3fa178cbc917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:45.387548 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a4113-be1a-4715-a20b-3fa178cbc917 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:45.387828 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a4113-be1a-4715-a20b-3fa178cbc917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:45.388103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a4113-be1a-4715-a20b-3fa178cbc917 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:45.388883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a4113-be1a-4715-a20b-3fa178cbc917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:45.390480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a4113-be1a-4715-a20b-3fa178cbc917 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:45.400553 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 922/1873] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:45.404818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf8591-1217-4d15-a38a-730af13ace94 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:45.414927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf8591-1217-4d15-a38a-730af13ace94 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:45.420057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e02d8-e1bc-44a1-9309-00df1aeaa060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:45.420961 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e02d8-e1bc-44a1-9309-00df1aeaa060 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:45.421246 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e02d8-e1bc-44a1-9309-00df1aeaa060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:45.421577 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e02d8-e1bc-44a1-9309-00df1aeaa060 admin admin] PATH_INFO: `/v3/projects/1f0a6c20466f4cccba510a626f9708bb/users/29acd49d632c4a4797203cb1ccced65c/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:45.423735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e02d8-e1bc-44a1-9309-00df1aeaa060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0a6c20466f4cccba510a626f9708bb, user_id=29acd49d632c4a4797203cb1ccced65c, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:45.426490 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e02d8-e1bc-44a1-9309-00df1aeaa060 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:45.437287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 952/1874] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:45 2022] PUT /identity/v3/projects/1f0a6c20466f4cccba510a626f9708bb/users/29acd49d632c4a4797203cb1ccced65c/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:45.447354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f27477-3f94-4a76-a686-3f9242be9aa1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:45.447644 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f27477-3f94-4a76-a686-3f9242be9aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:45.447918 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f27477-3f94-4a76-a686-3f9242be9aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:45.473608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-00f27477-3f94-4a76-a686-3f9242be9aa1 None None] MFA Rules not processed for user `29acd49d632c4a4797203cb1ccced65c`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:45.474847 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-00f27477-3f94-4a76-a686-3f9242be9aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:45.544118 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 923/1875] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:45.555114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e02d8-e1bc-44a1-9309-00df1aeaa060 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:45.557341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fd7e02d8-e1bc-44a1-9309-00df1aeaa060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:45.614524 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e02d8-e1bc-44a1-9309-00df1aeaa060 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:45.618183 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf49764-5bdd-4f5f-9d75-29b5818a7817 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:45.618841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf49764-5bdd-4f5f-9d75-29b5818a7817 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:45.619152 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf49764-5bdd-4f5f-9d75-29b5818a7817 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:45.619431 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf49764-5bdd-4f5f-9d75-29b5818a7817 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:45.676514 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf49764-5bdd-4f5f-9d75-29b5818a7817 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:45.677989 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf49764-5bdd-4f5f-9d75-29b5818a7817 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:45.687328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 953/1876] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:56.085768 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f27477-3f94-4a76-a686-3f9242be9aa1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:56.087364 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-00f27477-3f94-4a76-a686-3f9242be9aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:56.173747 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f27477-3f94-4a76-a686-3f9242be9aa1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:56.178866 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422fbbb-edb1-4cea-9170-f638f022eb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:56.179789 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422fbbb-edb1-4cea-9170-f638f022eb5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:56.180075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422fbbb-edb1-4cea-9170-f638f022eb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:56.180351 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422fbbb-edb1-4cea-9170-f638f022eb5c admin admin] PATH_INFO: `/v3/users/62727a427df44e8c9369129e5294beff` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:56.183668 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422fbbb-edb1-4cea-9170-f638f022eb5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=62727a427df44e8c9369129e5294beff)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:56.186910 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422fbbb-edb1-4cea-9170-f638f022eb5c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:56.240698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4422fbbb-edb1-4cea-9170-f638f022eb5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62727a427df44e8c9369129e5294beff'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:56.287247 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4422fbbb-edb1-4cea-9170-f638f022eb5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62727a427df44e8c9369129e5294beff'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:56.288066 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4422fbbb-edb1-4cea-9170-f638f022eb5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62727a427df44e8c9369129e5294beff'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:56.288851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4422fbbb-edb1-4cea-9170-f638f022eb5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62727a427df44e8c9369129e5294beff'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:56.298307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4422fbbb-edb1-4cea-9170-f638f022eb5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62727a427df44e8c9369129e5294beff'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:56.321300 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 924/1877] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:55:56 2022] DELETE /identity/v3/users/62727a427df44e8c9369129e5294beff => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:56.325962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc211ab-aae7-48bd-a87e-9a7232e45a5c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:56.326899 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc211ab-aae7-48bd-a87e-9a7232e45a5c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:56.327432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc211ab-aae7-48bd-a87e-9a7232e45a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:56.347403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-cbc211ab-aae7-48bd-a87e-9a7232e45a5c None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:56.348726 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cbc211ab-aae7-48bd-a87e-9a7232e45a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:56.410228 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 954/1878] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:56.420333 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422fbbb-edb1-4cea-9170-f638f022eb5c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:56.421800 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4422fbbb-edb1-4cea-9170-f638f022eb5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:56.491201 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422fbbb-edb1-4cea-9170-f638f022eb5c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:56.495305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81542bee-5d20-4baa-85be-eec76cc0839d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:56.496162 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81542bee-5d20-4baa-85be-eec76cc0839d service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:56.496458 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81542bee-5d20-4baa-85be-eec76cc0839d service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:56.496727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81542bee-5d20-4baa-85be-eec76cc0839d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:56.507082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81542bee-5d20-4baa-85be-eec76cc0839d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:56.508552 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81542bee-5d20-4baa-85be-eec76cc0839d service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:56.527143 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 925/1879] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:56.737389 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de407d-0655-45ab-b8c7-1fdc10cdf8ca None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:56.738215 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de407d-0655-45ab-b8c7-1fdc10cdf8ca None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:56.739356 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de407d-0655-45ab-b8c7-1fdc10cdf8ca None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:56.740815 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 955/1880] 10.222.0.77 () {54 vars in 921 bytes} [Wed May 11 06:55:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:55:56.758140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7c925-adfc-4606-8950-0e22956d9ef7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:56.758379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7c925-adfc-4606-8950-0e22956d9ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:56.758676 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7c925-adfc-4606-8950-0e22956d9ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:56.783908 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-19d7c925-adfc-4606-8950-0e22956d9ef7 None None] MFA Rules not processed for user `edf9d57de89a4701ba1a5b079d0ad348`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:56.785887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-19d7c925-adfc-4606-8950-0e22956d9ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:56.913561 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de407d-0655-45ab-b8c7-1fdc10cdf8ca None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:56.914479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-16de407d-0655-45ab-b8c7-1fdc10cdf8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:56.923947 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 926/1881] 10.222.0.77 () {58 vars in 1018 bytes} [Wed May 11 06:55:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:56.924988 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7c925-adfc-4606-8950-0e22956d9ef7 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:56.927332 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-19d7c925-adfc-4606-8950-0e22956d9ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:56.936231 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de407d-0655-45ab-b8c7-1fdc10cdf8ca None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:56.942235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a8b34-75e7-46cc-9e1d-2ce3b16c032f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:56.947131 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7c925-adfc-4606-8950-0e22956d9ef7 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:56.959091 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e5c7b-f034-4546-9cc7-e69c24faeb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:56.961770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e5c7b-f034-4546-9cc7-e69c24faeb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:56.963508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a8b34-75e7-46cc-9e1d-2ce3b16c032f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:56.968819 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a8b34-75e7-46cc-9e1d-2ce3b16c032f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:56.969305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a8b34-75e7-46cc-9e1d-2ce3b16c032f admin admin] PATH_INFO: `/v3/users/b9366f2050684c09a6be07ee686a736a` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:56.969596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e5c7b-f034-4546-9cc7-e69c24faeb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:56.970924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e5c7b-f034-4546-9cc7-e69c24faeb88 admin admin] PATH_INFO: `/v3/projects/ce4d0d764bd34a388c3087b3d47d185d` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:56.972541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a8b34-75e7-46cc-9e1d-2ce3b16c032f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9366f2050684c09a6be07ee686a736a)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:56.973582 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e5c7b-f034-4546-9cc7-e69c24faeb88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce4d0d764bd34a388c3087b3d47d185d)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:56.974509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a8b34-75e7-46cc-9e1d-2ce3b16c032f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:56.976380 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e5c7b-f034-4546-9cc7-e69c24faeb88 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:57.093830 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fb4a8b34-75e7-46cc-9e1d-2ce3b16c032f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9366f2050684c09a6be07ee686a736a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:57.098208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8b3e5c7b-f034-4546-9cc7-e69c24faeb88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce4d0d764bd34a388c3087b3d47d185d', 'request_id': 'req-8b3e5c7b-f034-4546-9cc7-e69c24faeb88'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:57.107204 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8b3e5c7b-f034-4546-9cc7-e69c24faeb88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce4d0d764bd34a388c3087b3d47d185d', 'request_id': 'req-8b3e5c7b-f034-4546-9cc7-e69c24faeb88'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:57.115018 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fb4a8b34-75e7-46cc-9e1d-2ce3b16c032f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9366f2050684c09a6be07ee686a736a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:57.116839 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fb4a8b34-75e7-46cc-9e1d-2ce3b16c032f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9366f2050684c09a6be07ee686a736a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:57.117514 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fb4a8b34-75e7-46cc-9e1d-2ce3b16c032f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9366f2050684c09a6be07ee686a736a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:57.119538 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8b3e5c7b-f034-4546-9cc7-e69c24faeb88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce4d0d764bd34a388c3087b3d47d185d', 'request_id': 'req-8b3e5c7b-f034-4546-9cc7-e69c24faeb88'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:57.135771 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fb4a8b34-75e7-46cc-9e1d-2ce3b16c032f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9366f2050684c09a6be07ee686a736a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:57.145719 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8b3e5c7b-f034-4546-9cc7-e69c24faeb88 admin admin] The token cache is being invalidate because project ce4d0d764bd34a388c3087b3d47d185d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:55:57.145719 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8b3e5c7b-f034-4546-9cc7-e69c24faeb88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:57.145719 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8b3e5c7b-f034-4546-9cc7-e69c24faeb88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:57.146999 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 927/1882] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:55:56 2022] DELETE /identity/v3/projects/ce4d0d764bd34a388c3087b3d47d185d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:57.147613 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e5c7b-f034-4546-9cc7-e69c24faeb88 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:57.149040 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8b3e5c7b-f034-4546-9cc7-e69c24faeb88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:57.154621 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 956/1883] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:55:56 2022] DELETE /identity/v3/users/b9366f2050684c09a6be07ee686a736a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:57.155558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a8b34-75e7-46cc-9e1d-2ce3b16c032f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:57.156976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fb4a8b34-75e7-46cc-9e1d-2ce3b16c032f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:57.234527 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e5c7b-f034-4546-9cc7-e69c24faeb88 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:57.235194 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a8b34-75e7-46cc-9e1d-2ce3b16c032f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:57.240592 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee56620-e96a-4218-b895-18dfa8d0e486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:57.241671 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee56620-e96a-4218-b895-18dfa8d0e486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:57.241956 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee56620-e96a-4218-b895-18dfa8d0e486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:57.242231 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee56620-e96a-4218-b895-18dfa8d0e486 admin admin] PATH_INFO: `/v3/users/3c85d32560ad43018a8bc70663cbf9be` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:57.243492 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee56620-e96a-4218-b895-18dfa8d0e486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c85d32560ad43018a8bc70663cbf9be)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:57.245429 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee56620-e96a-4218-b895-18dfa8d0e486 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:57.296895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cee56620-e96a-4218-b895-18dfa8d0e486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c85d32560ad43018a8bc70663cbf9be'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:57.305183 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4ffa0-dbb2-4025-9a4a-53d349abb193 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:57.306173 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4ffa0-dbb2-4025-9a4a-53d349abb193 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:57.306458 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4ffa0-dbb2-4025-9a4a-53d349abb193 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:57.306730 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4ffa0-dbb2-4025-9a4a-53d349abb193 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:57.308568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2ed4ffa0-dbb2-4025-9a4a-53d349abb193 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:57.310129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cee56620-e96a-4218-b895-18dfa8d0e486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c85d32560ad43018a8bc70663cbf9be'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:57.311101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cee56620-e96a-4218-b895-18dfa8d0e486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c85d32560ad43018a8bc70663cbf9be'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:57.311765 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cee56620-e96a-4218-b895-18dfa8d0e486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c85d32560ad43018a8bc70663cbf9be'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:57.322276 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cee56620-e96a-4218-b895-18dfa8d0e486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c85d32560ad43018a8bc70663cbf9be'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:57.324093 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4ffa0-dbb2-4025-9a4a-53d349abb193 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:57.325700 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4ffa0-dbb2-4025-9a4a-53d349abb193 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:57.339161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 957/1884] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:55:57 2022] DELETE /identity/v3/users/3c85d32560ad43018a8bc70663cbf9be => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:57.339161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b4ecd-8026-475f-bb67-3b727efe2f1c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:57.339161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b4ecd-8026-475f-bb67-3b727efe2f1c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:57.339161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b4ecd-8026-475f-bb67-3b727efe2f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:57.340243 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 928/1885] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:57.412515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d04b4ecd-8026-475f-bb67-3b727efe2f1c None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:57.414245 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d04b4ecd-8026-475f-bb67-3b727efe2f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:57.503985 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 958/1886] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:57.518467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4ffa0-dbb2-4025-9a4a-53d349abb193 service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:57.520490 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2ed4ffa0-dbb2-4025-9a4a-53d349abb193 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:57.590414 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4ffa0-dbb2-4025-9a4a-53d349abb193 service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:57.641233 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241db7f-3438-4795-a0b3-b4ca7bdc0209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:57.641908 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241db7f-3438-4795-a0b3-b4ca7bdc0209 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:57.642183 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241db7f-3438-4795-a0b3-b4ca7bdc0209 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:57.642449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241db7f-3438-4795-a0b3-b4ca7bdc0209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:57.651444 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241db7f-3438-4795-a0b3-b4ca7bdc0209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:57.652884 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241db7f-3438-4795-a0b3-b4ca7bdc0209 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:57.663940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 929/1887] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:55:57.691131 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b4ecd-8026-475f-bb67-3b727efe2f1c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:57.692673 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d04b4ecd-8026-475f-bb67-3b727efe2f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:57.710597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b4ecd-8026-475f-bb67-3b727efe2f1c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:57.723998 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839601aa-96f0-4a93-b8c4-0292e5230a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:57.724906 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839601aa-96f0-4a93-b8c4-0292e5230a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:57.725182 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839601aa-96f0-4a93-b8c4-0292e5230a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:57.725448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839601aa-96f0-4a93-b8c4-0292e5230a60 admin admin] PATH_INFO: `/v3/projects/f028bf78970e4dfb93839111a56eee1d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:57.727290 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839601aa-96f0-4a93-b8c4-0292e5230a60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f028bf78970e4dfb93839111a56eee1d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:57.729227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839601aa-96f0-4a93-b8c4-0292e5230a60 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:57.785868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-839601aa-96f0-4a93-b8c4-0292e5230a60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f028bf78970e4dfb93839111a56eee1d', 'request_id': 'req-839601aa-96f0-4a93-b8c4-0292e5230a60'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:57.793009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-839601aa-96f0-4a93-b8c4-0292e5230a60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f028bf78970e4dfb93839111a56eee1d', 'request_id': 'req-839601aa-96f0-4a93-b8c4-0292e5230a60'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:57.802853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-839601aa-96f0-4a93-b8c4-0292e5230a60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f028bf78970e4dfb93839111a56eee1d', 'request_id': 'req-839601aa-96f0-4a93-b8c4-0292e5230a60'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:57.815903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-839601aa-96f0-4a93-b8c4-0292e5230a60 admin admin] The token cache is being invalidate because project f028bf78970e4dfb93839111a56eee1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:55:57.816195 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-839601aa-96f0-4a93-b8c4-0292e5230a60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:57.816854 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-839601aa-96f0-4a93-b8c4-0292e5230a60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:57.821853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 959/1888] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:55:57 2022] DELETE /identity/v3/projects/f028bf78970e4dfb93839111a56eee1d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:57.823644 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a785e-17ff-4e30-93da-9ad54f6efd0f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:57.823977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a785e-17ff-4e30-93da-9ad54f6efd0f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:57.824260 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a785e-17ff-4e30-93da-9ad54f6efd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:57.848229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-145a785e-17ff-4e30-93da-9ad54f6efd0f None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:57.849714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-145a785e-17ff-4e30-93da-9ad54f6efd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:57.911335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 930/1889] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:57.919079 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dee1a8-8894-4256-a2c8-e75e452f2164 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:57.919371 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dee1a8-8894-4256-a2c8-e75e452f2164 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:57.919651 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dee1a8-8894-4256-a2c8-e75e452f2164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:57.940371 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-83dee1a8-8894-4256-a2c8-e75e452f2164 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:57.941726 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-83dee1a8-8894-4256-a2c8-e75e452f2164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:57.950223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 960/1890] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:57.954621 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a785e-17ff-4e30-93da-9ad54f6efd0f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:57.966102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a785e-17ff-4e30-93da-9ad54f6efd0f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:57.971075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3b6f3-b681-4cd7-890c-ec36df7d2be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:57.971744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3b6f3-b681-4cd7-890c-ec36df7d2be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:57.972022 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3b6f3-b681-4cd7-890c-ec36df7d2be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:57.972292 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3b6f3-b681-4cd7-890c-ec36df7d2be4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:57.973024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3b6f3-b681-4cd7-890c-ec36df7d2be4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:55:57.973326 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3b6f3-b681-4cd7-890c-ec36df7d2be4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:57.974917 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3b6f3-b681-4cd7-890c-ec36df7d2be4 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:57.978310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dee1a8-8894-4256-a2c8-e75e452f2164 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:57.979750 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-83dee1a8-8894-4256-a2c8-e75e452f2164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:57.991845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dee1a8-8894-4256-a2c8-e75e452f2164 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:57.992783 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 931/1891] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:55:57.998084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3b6f3-b681-4cd7-890c-ec36df7d2be4 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:58.001371 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ac698-528a-4e4c-ae17-307fa57614a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:58.002323 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ac698-528a-4e4c-ae17-307fa57614a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:58.002662 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ac698-528a-4e4c-ae17-307fa57614a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:58.003163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ac698-528a-4e4c-ae17-307fa57614a0 admin admin] PATH_INFO: `/v3/projects/f316efdcbca749b1a4418fbaa3d76830` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:58.004402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ac698-528a-4e4c-ae17-307fa57614a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f316efdcbca749b1a4418fbaa3d76830)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:58.006998 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ac698-528a-4e4c-ae17-307fa57614a0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:58.009149 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3b6f3-b681-4cd7-890c-ec36df7d2be4 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:58.014013 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf61ef-5bd1-4dc8-8f9d-ec7cc7aefe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:58.014684 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf61ef-5bd1-4dc8-8f9d-ec7cc7aefe1d admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:58.015003 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf61ef-5bd1-4dc8-8f9d-ec7cc7aefe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:58.015300 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf61ef-5bd1-4dc8-8f9d-ec7cc7aefe1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:58.015992 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf61ef-5bd1-4dc8-8f9d-ec7cc7aefe1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:58.017880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf61ef-5bd1-4dc8-8f9d-ec7cc7aefe1d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:58.044851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 932/1892] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:57 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:58.049110 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf61ef-5bd1-4dc8-8f9d-ec7cc7aefe1d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:58.057920 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9a5ac698-528a-4e4c-ae17-307fa57614a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f316efdcbca749b1a4418fbaa3d76830', 'request_id': 'req-9a5ac698-528a-4e4c-ae17-307fa57614a0'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:58.064324 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9a5ac698-528a-4e4c-ae17-307fa57614a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f316efdcbca749b1a4418fbaa3d76830', 'request_id': 'req-9a5ac698-528a-4e4c-ae17-307fa57614a0'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:58.073892 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9a5ac698-528a-4e4c-ae17-307fa57614a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f316efdcbca749b1a4418fbaa3d76830', 'request_id': 'req-9a5ac698-528a-4e4c-ae17-307fa57614a0'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:58.084960 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9a5ac698-528a-4e4c-ae17-307fa57614a0 admin admin] The token cache is being invalidate because project f316efdcbca749b1a4418fbaa3d76830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:55:58.085253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9a5ac698-528a-4e4c-ae17-307fa57614a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:58.085916 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9a5ac698-528a-4e4c-ae17-307fa57614a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:58.087890 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 961/1893] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:55:57 2022] DELETE /identity/v3/projects/f316efdcbca749b1a4418fbaa3d76830 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:55:58.091403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ac698-528a-4e4c-ae17-307fa57614a0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:58.092772 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9a5ac698-528a-4e4c-ae17-307fa57614a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:58.126358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf61ef-5bd1-4dc8-8f9d-ec7cc7aefe1d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:58.132965 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408a9e6-c6bf-431a-ad95-caaf27314095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:58.134437 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408a9e6-c6bf-431a-ad95-caaf27314095 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:58.134722 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408a9e6-c6bf-431a-ad95-caaf27314095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:58.135023 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408a9e6-c6bf-431a-ad95-caaf27314095 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:58.135730 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408a9e6-c6bf-431a-ad95-caaf27314095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:58.137815 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408a9e6-c6bf-431a-ad95-caaf27314095 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:58.173734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 933/1894] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:58 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:55:58.177030 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408a9e6-c6bf-431a-ad95-caaf27314095 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:58.179427 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ac698-528a-4e4c-ae17-307fa57614a0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:58.179554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f408a9e6-c6bf-431a-ad95-caaf27314095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:58.190493 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba22c5f-fedf-4f95-b8db-41baf692d365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:58.191452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba22c5f-fedf-4f95-b8db-41baf692d365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:58.191737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba22c5f-fedf-4f95-b8db-41baf692d365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:58.192008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba22c5f-fedf-4f95-b8db-41baf692d365 admin admin] PATH_INFO: `/v3/users/5fc5ac1c569d4a5ea442cfaf5a865116` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:58.193246 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba22c5f-fedf-4f95-b8db-41baf692d365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fc5ac1c569d4a5ea442cfaf5a865116)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:58.193674 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408a9e6-c6bf-431a-ad95-caaf27314095 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:58.195393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba22c5f-fedf-4f95-b8db-41baf692d365 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:58.201537 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb871eb-332e-4e59-8b24-39da06565fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:58.201756 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb871eb-332e-4e59-8b24-39da06565fdb admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:58.201874 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb871eb-332e-4e59-8b24-39da06565fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:58.202220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb871eb-332e-4e59-8b24-39da06565fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:58.204454 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb871eb-332e-4e59-8b24-39da06565fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:58.218306 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb871eb-332e-4e59-8b24-39da06565fdb admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:58.230091 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 934/1895] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:55:58.235023 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb871eb-332e-4e59-8b24-39da06565fdb admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:58.249235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb871eb-332e-4e59-8b24-39da06565fdb admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:58.254379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cb71a-f886-47c6-a632-91ae8676260d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:58.255181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cb71a-f886-47c6-a632-91ae8676260d admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:58.255529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cb71a-f886-47c6-a632-91ae8676260d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:58.255888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cb71a-f886-47c6-a632-91ae8676260d admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:58.256651 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cb71a-f886-47c6-a632-91ae8676260d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:58.258314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cb71a-f886-47c6-a632-91ae8676260d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:58.272445 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 935/1896] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:55:58.277978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cb71a-f886-47c6-a632-91ae8676260d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:58.313677 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cb71a-f886-47c6-a632-91ae8676260d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:58.319251 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7ba22c5f-fedf-4f95-b8db-41baf692d365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fc5ac1c569d4a5ea442cfaf5a865116'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:58.319388 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ffea5-20ff-4a4e-a4cd-70f29498cac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:58.320410 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ffea5-20ff-4a4e-a4cd-70f29498cac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:58.320817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ffea5-20ff-4a4e-a4cd-70f29498cac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:58.321182 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ffea5-20ff-4a4e-a4cd-70f29498cac0 admin admin] PATH_INFO: `/v3/projects/49e4d308e8154fe3a75bf8e2c6d15e19/users/1c163ef83b1a4ceea41f9e5b83cc222d/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:58.338505 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ffea5-20ff-4a4e-a4cd-70f29498cac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e4d308e8154fe3a75bf8e2c6d15e19, user_id=1c163ef83b1a4ceea41f9e5b83cc222d, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:58.342208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ffea5-20ff-4a4e-a4cd-70f29498cac0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:58.347478 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7ba22c5f-fedf-4f95-b8db-41baf692d365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fc5ac1c569d4a5ea442cfaf5a865116'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:58.348282 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7ba22c5f-fedf-4f95-b8db-41baf692d365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fc5ac1c569d4a5ea442cfaf5a865116'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:58.349613 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7ba22c5f-fedf-4f95-b8db-41baf692d365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fc5ac1c569d4a5ea442cfaf5a865116'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:58.360903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7ba22c5f-fedf-4f95-b8db-41baf692d365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fc5ac1c569d4a5ea442cfaf5a865116'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:58.362403 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 936/1897] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:58 2022] PUT /identity/v3/projects/49e4d308e8154fe3a75bf8e2c6d15e19/users/1c163ef83b1a4ceea41f9e5b83cc222d/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:58.367780 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9f55e-b501-4f59-ae14-b625fb349cbf None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:58.368402 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9f55e-b501-4f59-ae14-b625fb349cbf None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:58.368803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9f55e-b501-4f59-ae14-b625fb349cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:58.387760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 962/1898] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:55:58 2022] DELETE /identity/v3/users/5fc5ac1c569d4a5ea442cfaf5a865116 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:58.394361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-57a9f55e-b501-4f59-ae14-b625fb349cbf None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:58.395809 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-57a9f55e-b501-4f59-ae14-b625fb349cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:58.477589 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 937/1899] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:58.489707 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba22c5f-fedf-4f95-b8db-41baf692d365 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:58.491944 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7ba22c5f-fedf-4f95-b8db-41baf692d365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:58.648852 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba22c5f-fedf-4f95-b8db-41baf692d365 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:58.659348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31d38a-bee6-4ced-84e4-710c4638c992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:58.659927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31d38a-bee6-4ced-84e4-710c4638c992 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:58.660214 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31d38a-bee6-4ced-84e4-710c4638c992 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:58.660498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31d38a-bee6-4ced-84e4-710c4638c992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:58.679955 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31d38a-bee6-4ced-84e4-710c4638c992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:58.681737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31d38a-bee6-4ced-84e4-710c4638c992 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:58.687013 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9f55e-b501-4f59-ae14-b625fb349cbf None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:58.689514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-57a9f55e-b501-4f59-ae14-b625fb349cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:58.705243 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 963/1900] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:58.765407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9f55e-b501-4f59-ae14-b625fb349cbf None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:58.769509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7b19e-89c4-41e9-ae98-9265e9ce682b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:58.770246 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7b19e-89c4-41e9-ae98-9265e9ce682b service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:58.770634 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7b19e-89c4-41e9-ae98-9265e9ce682b service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:58.770997 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7b19e-89c4-41e9-ae98-9265e9ce682b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:58.772957 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-dbd7b19e-89c4-41e9-ae98-9265e9ce682b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:58.844650 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7b19e-89c4-41e9-ae98-9265e9ce682b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:58.846329 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7b19e-89c4-41e9-ae98-9265e9ce682b service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:58.858201 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 938/1901] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:55:58.867712 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31d38a-bee6-4ced-84e4-710c4638c992 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:58.869947 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0e31d38a-bee6-4ced-84e4-710c4638c992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:58.884884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31d38a-bee6-4ced-84e4-710c4638c992 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:58.891963 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff323bdd-1ddb-4fb9-9b6a-c10e03231810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:58.892906 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff323bdd-1ddb-4fb9-9b6a-c10e03231810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:58.893193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff323bdd-1ddb-4fb9-9b6a-c10e03231810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:58.893469 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff323bdd-1ddb-4fb9-9b6a-c10e03231810 admin admin] PATH_INFO: `/v3/projects/15167e10d5784a2cbe2f15465f8b4d9a` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:58.894753 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff323bdd-1ddb-4fb9-9b6a-c10e03231810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15167e10d5784a2cbe2f15465f8b4d9a)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:58.897695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff323bdd-1ddb-4fb9-9b6a-c10e03231810 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:58.951080 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ff323bdd-1ddb-4fb9-9b6a-c10e03231810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15167e10d5784a2cbe2f15465f8b4d9a', 'request_id': 'req-ff323bdd-1ddb-4fb9-9b6a-c10e03231810'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:58.958274 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ff323bdd-1ddb-4fb9-9b6a-c10e03231810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15167e10d5784a2cbe2f15465f8b4d9a', 'request_id': 'req-ff323bdd-1ddb-4fb9-9b6a-c10e03231810'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:58.967980 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ff323bdd-1ddb-4fb9-9b6a-c10e03231810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15167e10d5784a2cbe2f15465f8b4d9a', 'request_id': 'req-ff323bdd-1ddb-4fb9-9b6a-c10e03231810'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:58.981926 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ff323bdd-1ddb-4fb9-9b6a-c10e03231810 admin admin] The token cache is being invalidate because project 15167e10d5784a2cbe2f15465f8b4d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:55:58.982285 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ff323bdd-1ddb-4fb9-9b6a-c10e03231810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:58.982927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ff323bdd-1ddb-4fb9-9b6a-c10e03231810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:58.984529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 964/1902] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:55:58 2022] DELETE /identity/v3/projects/15167e10d5784a2cbe2f15465f8b4d9a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:58.989529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160abe10-fb62-40c9-a7f9-90c6d8dfa46e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:58.990533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160abe10-fb62-40c9-a7f9-90c6d8dfa46e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:58.990830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160abe10-fb62-40c9-a7f9-90c6d8dfa46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:59.014493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-160abe10-fb62-40c9-a7f9-90c6d8dfa46e None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:59.015784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-160abe10-fb62-40c9-a7f9-90c6d8dfa46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:59.090183 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 939/1903] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:55:59.098343 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b6881-c4db-4bdb-988c-96c2ae2cd4bd None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:59.098670 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b6881-c4db-4bdb-988c-96c2ae2cd4bd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:59.099106 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b6881-c4db-4bdb-988c-96c2ae2cd4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:59.132187 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-765b6881-c4db-4bdb-988c-96c2ae2cd4bd None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:59.133841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-765b6881-c4db-4bdb-988c-96c2ae2cd4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:59.146814 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 965/1904] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:55:59.148231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160abe10-fb62-40c9-a7f9-90c6d8dfa46e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:59.163286 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160abe10-fb62-40c9-a7f9-90c6d8dfa46e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:59.169183 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a420d-cdfb-4534-857f-e91ff123d49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:59.170250 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a420d-cdfb-4534-857f-e91ff123d49e admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:59.170651 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a420d-cdfb-4534-857f-e91ff123d49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:59.172846 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a420d-cdfb-4534-857f-e91ff123d49e admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:59.172846 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a420d-cdfb-4534-857f-e91ff123d49e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:55:59.172846 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a420d-cdfb-4534-857f-e91ff123d49e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:59.174347 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a420d-cdfb-4534-857f-e91ff123d49e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:59.193047 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 940/1905] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:55:59.195111 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b6881-c4db-4bdb-988c-96c2ae2cd4bd None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:59.217805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b6881-c4db-4bdb-988c-96c2ae2cd4bd None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:59.233704 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be7df5-28da-42ee-a408-b494d8b85faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:59.235000 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be7df5-28da-42ee-a408-b494d8b85faa admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:59.235000 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be7df5-28da-42ee-a408-b494d8b85faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:59.235000 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be7df5-28da-42ee-a408-b494d8b85faa admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:59.237027 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be7df5-28da-42ee-a408-b494d8b85faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:59.237567 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be7df5-28da-42ee-a408-b494d8b85faa admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:59.289409 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 966/1906] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:59 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:59.292739 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a420d-cdfb-4534-857f-e91ff123d49e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:59.315753 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a420d-cdfb-4534-857f-e91ff123d49e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:59.397996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b21a17-7810-4c95-9bac-34706f85b930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:59.398246 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b21a17-7810-4c95-9bac-34706f85b930 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:59.398497 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b21a17-7810-4c95-9bac-34706f85b930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:59.398707 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b21a17-7810-4c95-9bac-34706f85b930 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:59.399932 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b21a17-7810-4c95-9bac-34706f85b930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:59.402636 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b21a17-7810-4c95-9bac-34706f85b930 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:59.432294 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 941/1907] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:59 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:59.433667 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be7df5-28da-42ee-a408-b494d8b85faa admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:59.447064 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be7df5-28da-42ee-a408-b494d8b85faa admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:59.451980 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a514e1-c4ab-483c-a781-073f07b8d152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:59.452715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a514e1-c4ab-483c-a781-073f07b8d152 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:59.453005 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a514e1-c4ab-483c-a781-073f07b8d152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:59.453283 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a514e1-c4ab-483c-a781-073f07b8d152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:59.454166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a514e1-c4ab-483c-a781-073f07b8d152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:59.455813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a514e1-c4ab-483c-a781-073f07b8d152 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:59.467834 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 967/1908] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:59.472420 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b21a17-7810-4c95-9bac-34706f85b930 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:59.485092 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b21a17-7810-4c95-9bac-34706f85b930 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:59.490274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc4a00-5dda-461d-b6f8-68992bddb248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:59.491092 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc4a00-5dda-461d-b6f8-68992bddb248 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:59.491476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc4a00-5dda-461d-b6f8-68992bddb248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:59.491947 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc4a00-5dda-461d-b6f8-68992bddb248 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:59.493232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc4a00-5dda-461d-b6f8-68992bddb248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:59.494997 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc4a00-5dda-461d-b6f8-68992bddb248 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:59.505682 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 942/1909] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:55:59.512095 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a514e1-c4ab-483c-a781-073f07b8d152 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:59.523977 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a514e1-c4ab-483c-a781-073f07b8d152 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:59.530905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74421a1-b51f-4a98-8af5-e24a594345f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:59.532759 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74421a1-b51f-4a98-8af5-e24a594345f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:59.533194 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74421a1-b51f-4a98-8af5-e24a594345f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:59.533877 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74421a1-b51f-4a98-8af5-e24a594345f4 admin admin] PATH_INFO: `/v3/projects/bbb385037ceb45f6a42334190ad765a1/users/97aea01b950541e98752dbe9801755f1/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:59.549974 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74421a1-b51f-4a98-8af5-e24a594345f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb385037ceb45f6a42334190ad765a1, user_id=97aea01b950541e98752dbe9801755f1, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:59.553587 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74421a1-b51f-4a98-8af5-e24a594345f4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:59.572971 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 968/1910] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:55:59 2022] PUT /identity/v3/projects/bbb385037ceb45f6a42334190ad765a1/users/97aea01b950541e98752dbe9801755f1/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:55:59.589473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1511c-4087-43a7-a757-28bfb008ea20 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:59.589802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1511c-4087-43a7-a757-28bfb008ea20 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:59.590036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1511c-4087-43a7-a757-28bfb008ea20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:59.635421 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2ff1511c-4087-43a7-a757-28bfb008ea20 None None] MFA Rules not processed for user `97aea01b950541e98752dbe9801755f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:59.636834 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2ff1511c-4087-43a7-a757-28bfb008ea20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:59.672531 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3628f-0d4b-40f3-a6c9-6157b64849fb None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:59.673087 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3628f-0d4b-40f3-a6c9-6157b64849fb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:59.673776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3628f-0d4b-40f3-a6c9-6157b64849fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:59.703876 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6ae3628f-0d4b-40f3-a6c9-6157b64849fb None None] MFA Rules not processed for user `1c163ef83b1a4ceea41f9e5b83cc222d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:55:59.705217 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6ae3628f-0d4b-40f3-a6c9-6157b64849fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:59.711962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 943/1911] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:59.713221 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1511c-4087-43a7-a757-28bfb008ea20 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:59.781015 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 969/1912] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:55:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:55:59.793425 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3628f-0d4b-40f3-a6c9-6157b64849fb None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:59.795316 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6ae3628f-0d4b-40f3-a6c9-6157b64849fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:59.796362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1511c-4087-43a7-a757-28bfb008ea20 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:59.801754 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece9da8-89e2-4286-a00e-bf80037539f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:59.803066 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece9da8-89e2-4286-a00e-bf80037539f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:59.803353 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece9da8-89e2-4286-a00e-bf80037539f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:59.803725 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece9da8-89e2-4286-a00e-bf80037539f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:59.804627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece9da8-89e2-4286-a00e-bf80037539f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:59.807245 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece9da8-89e2-4286-a00e-bf80037539f2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:59.847429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 944/1913] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:55:59 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:59.848358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece9da8-89e2-4286-a00e-bf80037539f2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:59.871960 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3628f-0d4b-40f3-a6c9-6157b64849fb None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:59.936731 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece9da8-89e2-4286-a00e-bf80037539f2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:59.944317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876d697-e14c-455f-b7ed-e4a6e8eef647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:59.945515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876d697-e14c-455f-b7ed-e4a6e8eef647 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:59.946234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876d697-e14c-455f-b7ed-e4a6e8eef647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:59.946773 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876d697-e14c-455f-b7ed-e4a6e8eef647 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:59.947676 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876d697-e14c-455f-b7ed-e4a6e8eef647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:59.950572 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876d697-e14c-455f-b7ed-e4a6e8eef647 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:59.958467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcde95a-ce42-4472-ae00-7c07bb78b5a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:59.960154 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcde95a-ce42-4472-ae00-7c07bb78b5a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:59.960607 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcde95a-ce42-4472-ae00-7c07bb78b5a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:59.961020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcde95a-ce42-4472-ae00-7c07bb78b5a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:59.979715 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 945/1914] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:55:59 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:55:59.984252 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876d697-e14c-455f-b7ed-e4a6e8eef647 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:59.997171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876d697-e14c-455f-b7ed-e4a6e8eef647 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:00.007852 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770b3fa-010d-4821-a78c-f83925e2c36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:00.008777 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770b3fa-010d-4821-a78c-f83925e2c36a admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:00.009057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770b3fa-010d-4821-a78c-f83925e2c36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:00.009488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770b3fa-010d-4821-a78c-f83925e2c36a admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:00.011085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770b3fa-010d-4821-a78c-f83925e2c36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:00.013548 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770b3fa-010d-4821-a78c-f83925e2c36a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:00.034743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 946/1915] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:56:00.039317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770b3fa-010d-4821-a78c-f83925e2c36a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:00.046717 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcde95a-ce42-4472-ae00-7c07bb78b5a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:00.052704 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcde95a-ce42-4472-ae00-7c07bb78b5a4 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:00.053450 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770b3fa-010d-4821-a78c-f83925e2c36a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:00.060253 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceed991-96df-4f2b-a06e-68f42d09c5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:00.061038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceed991-96df-4f2b-a06e-68f42d09c5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:00.061313 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceed991-96df-4f2b-a06e-68f42d09c5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:00.061606 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceed991-96df-4f2b-a06e-68f42d09c5b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:00.062306 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceed991-96df-4f2b-a06e-68f42d09c5b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:00.064283 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceed991-96df-4f2b-a06e-68f42d09c5b5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:00.069311 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 970/1916] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:55:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:56:00.080499 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 947/1917] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:56:00.084907 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcde95a-ce42-4472-ae00-7c07bb78b5a4 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:00.104335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcde95a-ce42-4472-ae00-7c07bb78b5a4 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:00.109922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411e4ad-5553-4ba6-9cb9-b050ab2eefdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:00.110830 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411e4ad-5553-4ba6-9cb9-b050ab2eefdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:00.111161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411e4ad-5553-4ba6-9cb9-b050ab2eefdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:00.111438 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411e4ad-5553-4ba6-9cb9-b050ab2eefdc admin admin] PATH_INFO: `/v3/projects/18c3dbd110f74571b141113164f9934e/users/a9e196c8dc574b20ae5b196a8c50bf08/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:00.147507 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411e4ad-5553-4ba6-9cb9-b050ab2eefdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c3dbd110f74571b141113164f9934e, user_id=a9e196c8dc574b20ae5b196a8c50bf08, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:00.158300 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411e4ad-5553-4ba6-9cb9-b050ab2eefdc admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:00.186251 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 971/1918] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:56:00 2022] PUT /identity/v3/projects/18c3dbd110f74571b141113164f9934e/users/a9e196c8dc574b20ae5b196a8c50bf08/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:56:00.196477 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37c37e-f426-4c6e-87c1-f7d56370590c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:00.196897 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37c37e-f426-4c6e-87c1-f7d56370590c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:00.197076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37c37e-f426-4c6e-87c1-f7d56370590c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:00.236350 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-bf37c37e-f426-4c6e-87c1-f7d56370590c None None] MFA Rules not processed for user `a9e196c8dc574b20ae5b196a8c50bf08`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:00.237937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bf37c37e-f426-4c6e-87c1-f7d56370590c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:00.328968 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 948/1919] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:56:00.333079 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411e4ad-5553-4ba6-9cb9-b050ab2eefdc admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:00.417026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411e4ad-5553-4ba6-9cb9-b050ab2eefdc admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:00.422068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2688f9-6275-4276-a28b-7f3844c2fb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:00.422659 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2688f9-6275-4276-a28b-7f3844c2fb3a admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:00.422968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2688f9-6275-4276-a28b-7f3844c2fb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:00.423255 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2688f9-6275-4276-a28b-7f3844c2fb3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:00.423954 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2688f9-6275-4276-a28b-7f3844c2fb3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:00.426141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2688f9-6275-4276-a28b-7f3844c2fb3a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:00.462643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 972/1920] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:56:00 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:56:00.463407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37c37e-f426-4c6e-87c1-f7d56370590c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:00.474209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37c37e-f426-4c6e-87c1-f7d56370590c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:00.541204 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d37287-f36e-4419-a1db-b3477862b70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:00.542194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d37287-f36e-4419-a1db-b3477862b70e admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:00.542539 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d37287-f36e-4419-a1db-b3477862b70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:00.542886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d37287-f36e-4419-a1db-b3477862b70e admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:00.543706 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d37287-f36e-4419-a1db-b3477862b70e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:00.546014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d37287-f36e-4419-a1db-b3477862b70e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:00.571345 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 949/1921] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:56:00 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:56:00.575133 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2688f9-6275-4276-a28b-7f3844c2fb3a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:00.598764 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2688f9-6275-4276-a28b-7f3844c2fb3a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:00.607745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc255bf-f514-4cc8-8f09-bf6e7db8029e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:00.611084 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc255bf-f514-4cc8-8f09-bf6e7db8029e admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:00.611377 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc255bf-f514-4cc8-8f09-bf6e7db8029e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:00.611661 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc255bf-f514-4cc8-8f09-bf6e7db8029e admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:00.612422 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc255bf-f514-4cc8-8f09-bf6e7db8029e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:00.614746 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc255bf-f514-4cc8-8f09-bf6e7db8029e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:00.628483 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 973/1922] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:56:00.632378 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d37287-f36e-4419-a1db-b3477862b70e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:00.645065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d37287-f36e-4419-a1db-b3477862b70e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:00.652343 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fc04c-03c1-4872-bcdd-bc0fec05ae7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:00.653594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fc04c-03c1-4872-bcdd-bc0fec05ae7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:00.654136 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fc04c-03c1-4872-bcdd-bc0fec05ae7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:00.654567 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fc04c-03c1-4872-bcdd-bc0fec05ae7f admin admin] PATH_INFO: `/v3/projects/b819f98074a44322bf6c0dca8a3b1c69/users/ace2a39e0f1640cab91d1ad7fc4e6e43/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:00.673369 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fc04c-03c1-4872-bcdd-bc0fec05ae7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b819f98074a44322bf6c0dca8a3b1c69, user_id=ace2a39e0f1640cab91d1ad7fc4e6e43, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:00.676469 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fc04c-03c1-4872-bcdd-bc0fec05ae7f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:00.696397 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 950/1923] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:56:00 2022] PUT /identity/v3/projects/b819f98074a44322bf6c0dca8a3b1c69/users/ace2a39e0f1640cab91d1ad7fc4e6e43/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:56:00.701207 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc255bf-f514-4cc8-8f09-bf6e7db8029e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:00.712001 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc255bf-f514-4cc8-8f09-bf6e7db8029e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:00.806603 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365b9c0-c2c0-41a4-88e3-ca78742d313d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:00.807536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365b9c0-c2c0-41a4-88e3-ca78742d313d admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:00.807961 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365b9c0-c2c0-41a4-88e3-ca78742d313d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:00.808663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365b9c0-c2c0-41a4-88e3-ca78742d313d admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:00.809605 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365b9c0-c2c0-41a4-88e3-ca78742d313d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:00.811623 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365b9c0-c2c0-41a4-88e3-ca78742d313d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:00.824670 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 974/1924] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:56:00.829926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fc04c-03c1-4872-bcdd-bc0fec05ae7f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:00.854164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fc04c-03c1-4872-bcdd-bc0fec05ae7f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:00.856445 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc5c6a-865b-4692-9df6-602e678f2365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:00.857421 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc5c6a-865b-4692-9df6-602e678f2365 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:00.857703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc5c6a-865b-4692-9df6-602e678f2365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:00.857977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc5c6a-865b-4692-9df6-602e678f2365 admin admin] PATH_INFO: `/v3/projects/b819f98074a44322bf6c0dca8a3b1c69/users/ace2a39e0f1640cab91d1ad7fc4e6e43/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:00.860633 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc5c6a-865b-4692-9df6-602e678f2365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b819f98074a44322bf6c0dca8a3b1c69, user_id=ace2a39e0f1640cab91d1ad7fc4e6e43, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:00.863040 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc5c6a-865b-4692-9df6-602e678f2365 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:00.890529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 951/1925] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:56:00 2022] PUT /identity/v3/projects/b819f98074a44322bf6c0dca8a3b1c69/users/ace2a39e0f1640cab91d1ad7fc4e6e43/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:56:00.893929 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50492465-6cca-40c3-a5d3-cef577ed7605 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:00.893929 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50492465-6cca-40c3-a5d3-cef577ed7605 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:00.894352 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50492465-6cca-40c3-a5d3-cef577ed7605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:00.932655 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-50492465-6cca-40c3-a5d3-cef577ed7605 None None] MFA Rules not processed for user `ace2a39e0f1640cab91d1ad7fc4e6e43`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:00.934666 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-50492465-6cca-40c3-a5d3-cef577ed7605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:01.031792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 975/1926] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:56:01.043587 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc5c6a-865b-4692-9df6-602e678f2365 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:01.045745 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5fdc5c6a-865b-4692-9df6-602e678f2365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:01.110061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc5c6a-865b-4692-9df6-602e678f2365 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:01.115805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ea2a9-168a-4a12-bf08-24f4925332d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:01.116512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ea2a9-168a-4a12-bf08-24f4925332d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:01.116793 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ea2a9-168a-4a12-bf08-24f4925332d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:01.117069 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ea2a9-168a-4a12-bf08-24f4925332d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:01.127172 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ea2a9-168a-4a12-bf08-24f4925332d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:01.128624 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ea2a9-168a-4a12-bf08-24f4925332d8 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:01.138399 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 952/1927] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:56:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:56:01.181450 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50492465-6cca-40c3-a5d3-cef577ed7605 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:01.190886 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50492465-6cca-40c3-a5d3-cef577ed7605 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:01.194698 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9dda27-42b1-412e-8d98-4ae84f700c70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:01.195492 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9dda27-42b1-412e-8d98-4ae84f700c70 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:01.195749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9dda27-42b1-412e-8d98-4ae84f700c70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:01.196025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9dda27-42b1-412e-8d98-4ae84f700c70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:01.271059 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9dda27-42b1-412e-8d98-4ae84f700c70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:01.272530 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9dda27-42b1-412e-8d98-4ae84f700c70 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:01.289053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 976/1928] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:56:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:56:02.623370 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20319af6-7138-492a-9d7c-c2a9a43ca994 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:02.623891 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20319af6-7138-492a-9d7c-c2a9a43ca994 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:02.623891 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20319af6-7138-492a-9d7c-c2a9a43ca994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:02.642869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-20319af6-7138-492a-9d7c-c2a9a43ca994 None None] MFA Rules not processed for user `1c163ef83b1a4ceea41f9e5b83cc222d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:02.644161 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-20319af6-7138-492a-9d7c-c2a9a43ca994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:02.712671 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 953/1929] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:56:08.416168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9dda27-42b1-412e-8d98-4ae84f700c70 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:08.418328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0a9dda27-42b1-412e-8d98-4ae84f700c70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:08.503993 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9dda27-42b1-412e-8d98-4ae84f700c70 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:08.510049 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc11ce-0a5a-4a0a-85f5-b31da122dd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:08.511052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc11ce-0a5a-4a0a-85f5-b31da122dd47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:08.511335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc11ce-0a5a-4a0a-85f5-b31da122dd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:08.511638 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc11ce-0a5a-4a0a-85f5-b31da122dd47 admin admin] PATH_INFO: `/v3/users/0597058707c546feb0e487682af59e69` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:08.512850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc11ce-0a5a-4a0a-85f5-b31da122dd47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0597058707c546feb0e487682af59e69)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:08.515778 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc11ce-0a5a-4a0a-85f5-b31da122dd47 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:08.575592 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-71bc11ce-0a5a-4a0a-85f5-b31da122dd47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0597058707c546feb0e487682af59e69'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:08.597307 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-71bc11ce-0a5a-4a0a-85f5-b31da122dd47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0597058707c546feb0e487682af59e69'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:08.598055 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-71bc11ce-0a5a-4a0a-85f5-b31da122dd47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0597058707c546feb0e487682af59e69'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:08.599220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-71bc11ce-0a5a-4a0a-85f5-b31da122dd47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0597058707c546feb0e487682af59e69'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:08.607691 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-71bc11ce-0a5a-4a0a-85f5-b31da122dd47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0597058707c546feb0e487682af59e69'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:08.620564 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 977/1930] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:56:08 2022] DELETE /identity/v3/users/0597058707c546feb0e487682af59e69 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:56:08.625097 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f11b42-3e96-4bb3-862a-5796083c7643 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:08.625604 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f11b42-3e96-4bb3-862a-5796083c7643 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:08.625720 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f11b42-3e96-4bb3-862a-5796083c7643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:08.651994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-56f11b42-3e96-4bb3-862a-5796083c7643 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:08.654033 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-56f11b42-3e96-4bb3-862a-5796083c7643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:08.722787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 954/1931] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:56:08.733373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc11ce-0a5a-4a0a-85f5-b31da122dd47 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:08.734985 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-71bc11ce-0a5a-4a0a-85f5-b31da122dd47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:08.815141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc11ce-0a5a-4a0a-85f5-b31da122dd47 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:08.820411 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b898b61-3d63-4214-b22d-09e0f4224d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:08.821331 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b898b61-3d63-4214-b22d-09e0f4224d7c service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:08.821760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b898b61-3d63-4214-b22d-09e0f4224d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:08.822046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b898b61-3d63-4214-b22d-09e0f4224d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:08.833794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b898b61-3d63-4214-b22d-09e0f4224d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:08.835375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b898b61-3d63-4214-b22d-09e0f4224d7c service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:08.845910 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 978/1932] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:56:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:56:09.333340 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f11b42-3e96-4bb3-862a-5796083c7643 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:09.335387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-56f11b42-3e96-4bb3-862a-5796083c7643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:09.352262 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f11b42-3e96-4bb3-862a-5796083c7643 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:09.357838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df147c-b51f-4378-94e9-d88d845495c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:09.358603 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df147c-b51f-4378-94e9-d88d845495c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:09.358855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df147c-b51f-4378-94e9-d88d845495c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:09.359219 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df147c-b51f-4378-94e9-d88d845495c9 admin admin] PATH_INFO: `/v3/projects/a12144f2cd684335a206fbe652dca6f6` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:09.360432 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df147c-b51f-4378-94e9-d88d845495c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a12144f2cd684335a206fbe652dca6f6)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:09.362296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df147c-b51f-4378-94e9-d88d845495c9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:09.411238 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43df147c-b51f-4378-94e9-d88d845495c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a12144f2cd684335a206fbe652dca6f6', 'request_id': 'req-43df147c-b51f-4378-94e9-d88d845495c9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:09.417533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43df147c-b51f-4378-94e9-d88d845495c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a12144f2cd684335a206fbe652dca6f6', 'request_id': 'req-43df147c-b51f-4378-94e9-d88d845495c9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:09.426730 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43df147c-b51f-4378-94e9-d88d845495c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a12144f2cd684335a206fbe652dca6f6', 'request_id': 'req-43df147c-b51f-4378-94e9-d88d845495c9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:09.436916 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43df147c-b51f-4378-94e9-d88d845495c9 admin admin] The token cache is being invalidate because project a12144f2cd684335a206fbe652dca6f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:56:09.437359 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43df147c-b51f-4378-94e9-d88d845495c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:09.437877 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43df147c-b51f-4378-94e9-d88d845495c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:09.439462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 955/1933] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:56:09 2022] DELETE /identity/v3/projects/a12144f2cd684335a206fbe652dca6f6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:56:09.443627 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b898b61-3d63-4214-b22d-09e0f4224d7c service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:09.453723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b898b61-3d63-4214-b22d-09e0f4224d7c service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:09.534032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2bf74-ef4b-4a31-9b44-70303aaaea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:09.535115 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2bf74-ef4b-4a31-9b44-70303aaaea84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:09.535519 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2bf74-ef4b-4a31-9b44-70303aaaea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:09.535863 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2bf74-ef4b-4a31-9b44-70303aaaea84 admin admin] PATH_INFO: `/v3/users/29acd49d632c4a4797203cb1ccced65c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:09.537399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2bf74-ef4b-4a31-9b44-70303aaaea84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29acd49d632c4a4797203cb1ccced65c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:09.539420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2bf74-ef4b-4a31-9b44-70303aaaea84 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:09.595179 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df147c-b51f-4378-94e9-d88d845495c9 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:09.596767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-43df147c-b51f-4378-94e9-d88d845495c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:09.597741 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-15a2bf74-ef4b-4a31-9b44-70303aaaea84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29acd49d632c4a4797203cb1ccced65c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:09.612264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-15a2bf74-ef4b-4a31-9b44-70303aaaea84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29acd49d632c4a4797203cb1ccced65c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:09.613213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-15a2bf74-ef4b-4a31-9b44-70303aaaea84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29acd49d632c4a4797203cb1ccced65c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:09.614030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-15a2bf74-ef4b-4a31-9b44-70303aaaea84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29acd49d632c4a4797203cb1ccced65c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:09.616113 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df147c-b51f-4378-94e9-d88d845495c9 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:09.622137 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dc25a-21ba-4bc9-91d3-251e7258e850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:09.624303 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-15a2bf74-ef4b-4a31-9b44-70303aaaea84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29acd49d632c4a4797203cb1ccced65c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:09.625574 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dc25a-21ba-4bc9-91d3-251e7258e850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:09.626371 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dc25a-21ba-4bc9-91d3-251e7258e850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:09.626818 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dc25a-21ba-4bc9-91d3-251e7258e850 admin admin] PATH_INFO: `/v3/users/97aea01b950541e98752dbe9801755f1` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:09.628756 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674dc25a-21ba-4bc9-91d3-251e7258e850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97aea01b950541e98752dbe9801755f1)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:09.631143 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674dc25a-21ba-4bc9-91d3-251e7258e850 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:09.637553 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 979/1934] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:56:09 2022] DELETE /identity/v3/users/29acd49d632c4a4797203cb1ccced65c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:56:09.716615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-674dc25a-21ba-4bc9-91d3-251e7258e850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97aea01b950541e98752dbe9801755f1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:09.748087 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-674dc25a-21ba-4bc9-91d3-251e7258e850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97aea01b950541e98752dbe9801755f1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:09.749269 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-674dc25a-21ba-4bc9-91d3-251e7258e850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97aea01b950541e98752dbe9801755f1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:09.750305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-674dc25a-21ba-4bc9-91d3-251e7258e850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97aea01b950541e98752dbe9801755f1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:09.762816 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-674dc25a-21ba-4bc9-91d3-251e7258e850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97aea01b950541e98752dbe9801755f1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:09.785029 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 956/1935] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:56:09 2022] DELETE /identity/v3/users/97aea01b950541e98752dbe9801755f1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:56:09.789446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b2334-ff0b-40f9-9922-18d830fb2f53 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:09.789738 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b2334-ff0b-40f9-9922-18d830fb2f53 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:09.790071 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b2334-ff0b-40f9-9922-18d830fb2f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:09.815110 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0e0b2334-ff0b-40f9-9922-18d830fb2f53 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:09.816722 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0e0b2334-ff0b-40f9-9922-18d830fb2f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:09.914161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 980/1936] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:56:09.936112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dc25a-21ba-4bc9-91d3-251e7258e850 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:09.938011 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-674dc25a-21ba-4bc9-91d3-251e7258e850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:10.016501 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dc25a-21ba-4bc9-91d3-251e7258e850 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:10.020620 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b8dcf-a938-4c74-8319-5e8e68e17c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:10.021287 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b8dcf-a938-4c74-8319-5e8e68e17c36 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:10.021613 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b8dcf-a938-4c74-8319-5e8e68e17c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:10.021937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b8dcf-a938-4c74-8319-5e8e68e17c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:10.034775 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b8dcf-a938-4c74-8319-5e8e68e17c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:10.037106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b8dcf-a938-4c74-8319-5e8e68e17c36 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:10.049405 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 957/1937] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:56:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:56:10.068883 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b2334-ff0b-40f9-9922-18d830fb2f53 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:10.070337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0e0b2334-ff0b-40f9-9922-18d830fb2f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:10.085429 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b2334-ff0b-40f9-9922-18d830fb2f53 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:10.097923 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc39ea1-0b9c-4b0f-8936-c2b7830a8ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:10.098921 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc39ea1-0b9c-4b0f-8936-c2b7830a8ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:10.099456 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc39ea1-0b9c-4b0f-8936-c2b7830a8ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:10.099836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc39ea1-0b9c-4b0f-8936-c2b7830a8ff0 admin admin] PATH_INFO: `/v3/users/949668a1b2e440e8853cc7006a9142ff` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:10.101264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc39ea1-0b9c-4b0f-8936-c2b7830a8ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=949668a1b2e440e8853cc7006a9142ff)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:10.103890 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc39ea1-0b9c-4b0f-8936-c2b7830a8ff0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:10.164911 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5cc39ea1-0b9c-4b0f-8936-c2b7830a8ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '949668a1b2e440e8853cc7006a9142ff'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:10.177607 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5cc39ea1-0b9c-4b0f-8936-c2b7830a8ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '949668a1b2e440e8853cc7006a9142ff'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:10.178409 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5cc39ea1-0b9c-4b0f-8936-c2b7830a8ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '949668a1b2e440e8853cc7006a9142ff'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:10.179124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5cc39ea1-0b9c-4b0f-8936-c2b7830a8ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '949668a1b2e440e8853cc7006a9142ff'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:10.188992 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5cc39ea1-0b9c-4b0f-8936-c2b7830a8ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '949668a1b2e440e8853cc7006a9142ff'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:10.203148 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 981/1938] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:56:10 2022] DELETE /identity/v3/users/949668a1b2e440e8853cc7006a9142ff => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:56:10.207553 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c5c85-10ac-4537-bdc6-eb7b7fe98844 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:10.207913 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c5c85-10ac-4537-bdc6-eb7b7fe98844 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:10.208282 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c5c85-10ac-4537-bdc6-eb7b7fe98844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:10.227456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-630c5c85-10ac-4537-bdc6-eb7b7fe98844 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:10.229035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-630c5c85-10ac-4537-bdc6-eb7b7fe98844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:10.304916 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 958/1939] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:56:10.315262 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc39ea1-0b9c-4b0f-8936-c2b7830a8ff0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:10.316766 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5cc39ea1-0b9c-4b0f-8936-c2b7830a8ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:10.408436 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c5c85-10ac-4537-bdc6-eb7b7fe98844 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:10.409835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-630c5c85-10ac-4537-bdc6-eb7b7fe98844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:10.449765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c5c85-10ac-4537-bdc6-eb7b7fe98844 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:10.478134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc39ea1-0b9c-4b0f-8936-c2b7830a8ff0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:10.485424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b4096-edd5-4f7b-9db9-d037e520572f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:10.492109 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b4096-edd5-4f7b-9db9-d037e520572f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:10.493658 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b4096-edd5-4f7b-9db9-d037e520572f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:10.493877 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b4096-edd5-4f7b-9db9-d037e520572f admin admin] PATH_INFO: `/v3/projects/1f0a6c20466f4cccba510a626f9708bb` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:10.496516 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a245bc2-87ee-4966-a162-122be95eb05f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:10.497232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a245bc2-87ee-4966-a162-122be95eb05f service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:10.497426 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a245bc2-87ee-4966-a162-122be95eb05f service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:10.497751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a245bc2-87ee-4966-a162-122be95eb05f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:10.499751 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b4096-edd5-4f7b-9db9-d037e520572f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f0a6c20466f4cccba510a626f9708bb)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:10.501831 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b4096-edd5-4f7b-9db9-d037e520572f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:10.535706 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a245bc2-87ee-4966-a162-122be95eb05f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:10.539313 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a245bc2-87ee-4966-a162-122be95eb05f service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:10.574602 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 982/1940] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:56:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:56:10.604772 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a245bc2-87ee-4966-a162-122be95eb05f service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:10.606330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5a245bc2-87ee-4966-a162-122be95eb05f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:10.621887 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a245bc2-87ee-4966-a162-122be95eb05f service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:10.628063 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c33b4096-edd5-4f7b-9db9-d037e520572f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f0a6c20466f4cccba510a626f9708bb', 'request_id': 'req-c33b4096-edd5-4f7b-9db9-d037e520572f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:10.636059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c33b4096-edd5-4f7b-9db9-d037e520572f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f0a6c20466f4cccba510a626f9708bb', 'request_id': 'req-c33b4096-edd5-4f7b-9db9-d037e520572f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:10.648965 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c33b4096-edd5-4f7b-9db9-d037e520572f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f0a6c20466f4cccba510a626f9708bb', 'request_id': 'req-c33b4096-edd5-4f7b-9db9-d037e520572f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:10.662516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c33b4096-edd5-4f7b-9db9-d037e520572f admin admin] The token cache is being invalidate because project 1f0a6c20466f4cccba510a626f9708bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:56:10.663451 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c33b4096-edd5-4f7b-9db9-d037e520572f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:10.664267 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c33b4096-edd5-4f7b-9db9-d037e520572f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:10.667022 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 959/1941] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:56:10 2022] DELETE /identity/v3/projects/1f0a6c20466f4cccba510a626f9708bb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:56:10.674532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ce039-e169-4ab7-b73f-ce3548fdbbe8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:10.674846 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ce039-e169-4ab7-b73f-ce3548fdbbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:10.675168 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ce039-e169-4ab7-b73f-ce3548fdbbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:10.711325 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-499ce039-e169-4ab7-b73f-ce3548fdbbe8 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:10.712988 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-499ce039-e169-4ab7-b73f-ce3548fdbbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:10.722751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b895e47-fbfe-4ed8-a949-509a527da91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:10.723731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b895e47-fbfe-4ed8-a949-509a527da91e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:10.724560 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b895e47-fbfe-4ed8-a949-509a527da91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:10.725011 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b895e47-fbfe-4ed8-a949-509a527da91e admin admin] PATH_INFO: `/v3/projects/bbb385037ceb45f6a42334190ad765a1` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:10.726477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b895e47-fbfe-4ed8-a949-509a527da91e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb385037ceb45f6a42334190ad765a1)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:10.727760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 960/1942] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:56:10.728723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b895e47-fbfe-4ed8-a949-509a527da91e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:10.737554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb930db6-e52c-4bf1-b60d-bf95ff716d6d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:10.738541 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb930db6-e52c-4bf1-b60d-bf95ff716d6d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:10.739236 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb930db6-e52c-4bf1-b60d-bf95ff716d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:10.763296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-bb930db6-e52c-4bf1-b60d-bf95ff716d6d None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:10.767904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bb930db6-e52c-4bf1-b60d-bf95ff716d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:10.788374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9b895e47-fbfe-4ed8-a949-509a527da91e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb385037ceb45f6a42334190ad765a1', 'request_id': 'req-9b895e47-fbfe-4ed8-a949-509a527da91e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:10.796335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9b895e47-fbfe-4ed8-a949-509a527da91e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb385037ceb45f6a42334190ad765a1', 'request_id': 'req-9b895e47-fbfe-4ed8-a949-509a527da91e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:10.810860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9b895e47-fbfe-4ed8-a949-509a527da91e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb385037ceb45f6a42334190ad765a1', 'request_id': 'req-9b895e47-fbfe-4ed8-a949-509a527da91e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:10.829428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9b895e47-fbfe-4ed8-a949-509a527da91e admin admin] The token cache is being invalidate because project bbb385037ceb45f6a42334190ad765a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:56:10.829725 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9b895e47-fbfe-4ed8-a949-509a527da91e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:10.830624 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9b895e47-fbfe-4ed8-a949-509a527da91e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:10.833674 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 983/1943] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:56:10 2022] DELETE /identity/v3/projects/bbb385037ceb45f6a42334190ad765a1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:56:10.837311 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b895e47-fbfe-4ed8-a949-509a527da91e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:10.839131 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9b895e47-fbfe-4ed8-a949-509a527da91e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:10.860107 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 961/1944] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:56:10.863786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb930db6-e52c-4bf1-b60d-bf95ff716d6d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:10.878244 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb930db6-e52c-4bf1-b60d-bf95ff716d6d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:10.905321 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c441f7f-883f-48c1-a6cf-a8aa46673e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:10.905321 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c441f7f-883f-48c1-a6cf-a8aa46673e1f admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:10.905321 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c441f7f-883f-48c1-a6cf-a8aa46673e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:10.905321 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c441f7f-883f-48c1-a6cf-a8aa46673e1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:10.905836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c441f7f-883f-48c1-a6cf-a8aa46673e1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:56:10.905836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c441f7f-883f-48c1-a6cf-a8aa46673e1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:10.905836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c441f7f-883f-48c1-a6cf-a8aa46673e1f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:10.924434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 962/1945] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:56:10.928214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c441f7f-883f-48c1-a6cf-a8aa46673e1f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:10.955518 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c441f7f-883f-48c1-a6cf-a8aa46673e1f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:10.964138 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb295cfe-fa40-4d2a-a04f-54ad2bcf2cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:10.965747 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb295cfe-fa40-4d2a-a04f-54ad2bcf2cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:10.966147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb295cfe-fa40-4d2a-a04f-54ad2bcf2cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:10.966346 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb295cfe-fa40-4d2a-a04f-54ad2bcf2cb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:10.967102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb295cfe-fa40-4d2a-a04f-54ad2bcf2cb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:10.969169 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb295cfe-fa40-4d2a-a04f-54ad2bcf2cb8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:10.974471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b895e47-fbfe-4ed8-a949-509a527da91e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:10.986205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f433b57-4bdc-4db2-85f9-44590db8e4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:10.987128 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f433b57-4bdc-4db2-85f9-44590db8e4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:10.987442 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f433b57-4bdc-4db2-85f9-44590db8e4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:10.987725 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f433b57-4bdc-4db2-85f9-44590db8e4b8 admin admin] PATH_INFO: `/v3/users/a9e196c8dc574b20ae5b196a8c50bf08` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:10.989192 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f433b57-4bdc-4db2-85f9-44590db8e4b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9e196c8dc574b20ae5b196a8c50bf08)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:10.991428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f433b57-4bdc-4db2-85f9-44590db8e4b8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:11.032166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 963/1946] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:56:10 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:56:11.038240 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb295cfe-fa40-4d2a-a04f-54ad2bcf2cb8 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:11.071303 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0f433b57-4bdc-4db2-85f9-44590db8e4b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9e196c8dc574b20ae5b196a8c50bf08'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:11.101505 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0f433b57-4bdc-4db2-85f9-44590db8e4b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9e196c8dc574b20ae5b196a8c50bf08'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:11.102380 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0f433b57-4bdc-4db2-85f9-44590db8e4b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9e196c8dc574b20ae5b196a8c50bf08'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:11.103743 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0f433b57-4bdc-4db2-85f9-44590db8e4b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9e196c8dc574b20ae5b196a8c50bf08'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:11.125472 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0f433b57-4bdc-4db2-85f9-44590db8e4b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9e196c8dc574b20ae5b196a8c50bf08'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:11.158130 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 984/1947] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:56:10 2022] DELETE /identity/v3/users/a9e196c8dc574b20ae5b196a8c50bf08 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:56:11.158130 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f433b57-4bdc-4db2-85f9-44590db8e4b8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:11.158130 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0f433b57-4bdc-4db2-85f9-44590db8e4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:11.180496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb295cfe-fa40-4d2a-a04f-54ad2bcf2cb8 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:11.239478 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f433b57-4bdc-4db2-85f9-44590db8e4b8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:11.245208 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e7fa3-3101-46fe-a39c-a27d19eea6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:11.246379 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e7fa3-3101-46fe-a39c-a27d19eea6e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:11.246678 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e7fa3-3101-46fe-a39c-a27d19eea6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:11.246950 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e7fa3-3101-46fe-a39c-a27d19eea6e9 admin admin] PATH_INFO: `/v3/projects/bc566f812503445085c9adfb27278276` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:11.248359 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e7fa3-3101-46fe-a39c-a27d19eea6e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc566f812503445085c9adfb27278276)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:11.250886 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e7fa3-3101-46fe-a39c-a27d19eea6e9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:11.261824 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee2d15-6a1e-4136-ba0a-aaed10a4de50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:11.262789 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee2d15-6a1e-4136-ba0a-aaed10a4de50 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:11.263263 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee2d15-6a1e-4136-ba0a-aaed10a4de50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:11.263608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee2d15-6a1e-4136-ba0a-aaed10a4de50 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:11.264392 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee2d15-6a1e-4136-ba0a-aaed10a4de50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:11.266975 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee2d15-6a1e-4136-ba0a-aaed10a4de50 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:11.300185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 964/1948] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:56:11 2022] POST /identity/v3/users => generated 287 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:56:11.304282 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee2d15-6a1e-4136-ba0a-aaed10a4de50 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:11.306791 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-aaee2d15-6a1e-4136-ba0a-aaed10a4de50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:11.314441 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-824e7fa3-3101-46fe-a39c-a27d19eea6e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc566f812503445085c9adfb27278276', 'request_id': 'req-824e7fa3-3101-46fe-a39c-a27d19eea6e9'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:11.320833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee2d15-6a1e-4136-ba0a-aaed10a4de50 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:11.321692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-824e7fa3-3101-46fe-a39c-a27d19eea6e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc566f812503445085c9adfb27278276', 'request_id': 'req-824e7fa3-3101-46fe-a39c-a27d19eea6e9'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:11.343087 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-824e7fa3-3101-46fe-a39c-a27d19eea6e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc566f812503445085c9adfb27278276', 'request_id': 'req-824e7fa3-3101-46fe-a39c-a27d19eea6e9'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:11.354432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-824e7fa3-3101-46fe-a39c-a27d19eea6e9 admin admin] The token cache is being invalidate because project bc566f812503445085c9adfb27278276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:56:11.354934 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-824e7fa3-3101-46fe-a39c-a27d19eea6e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:11.355690 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-824e7fa3-3101-46fe-a39c-a27d19eea6e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:11.360135 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 985/1949] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:56:11 2022] DELETE /identity/v3/projects/bc566f812503445085c9adfb27278276 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:56:11.363922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e7fa3-3101-46fe-a39c-a27d19eea6e9 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:11.365350 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-824e7fa3-3101-46fe-a39c-a27d19eea6e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:11.398173 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee64c0d-3fe0-405d-93aa-b8fbece23faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:11.399152 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee64c0d-3fe0-405d-93aa-b8fbece23faf admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:11.399442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee64c0d-3fe0-405d-93aa-b8fbece23faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:11.399886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee64c0d-3fe0-405d-93aa-b8fbece23faf admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:11.401391 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee64c0d-3fe0-405d-93aa-b8fbece23faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:11.403042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee64c0d-3fe0-405d-93aa-b8fbece23faf admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:11.414681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 965/1950] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:56:11.418256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee64c0d-3fe0-405d-93aa-b8fbece23faf admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:11.420105 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-aee64c0d-3fe0-405d-93aa-b8fbece23faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:11.432365 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee64c0d-3fe0-405d-93aa-b8fbece23faf admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:11.432614 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e7fa3-3101-46fe-a39c-a27d19eea6e9 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:11.437196 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9112be-85b4-4ffa-9b6f-95f40e1cae69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:11.437970 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9112be-85b4-4ffa-9b6f-95f40e1cae69 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:11.438251 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d0672-0ffc-43a0-b5b1-e269fe25431b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:11.438357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9112be-85b4-4ffa-9b6f-95f40e1cae69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:11.438608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9112be-85b4-4ffa-9b6f-95f40e1cae69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:11.439598 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9112be-85b4-4ffa-9b6f-95f40e1cae69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:11.439889 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d0672-0ffc-43a0-b5b1-e269fe25431b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:11.440177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d0672-0ffc-43a0-b5b1-e269fe25431b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:11.440455 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d0672-0ffc-43a0-b5b1-e269fe25431b admin admin] PATH_INFO: `/v3/users/fc332499d33e43a385c1b531716acfd7` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:11.441584 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9112be-85b4-4ffa-9b6f-95f40e1cae69 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:11.442239 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d0672-0ffc-43a0-b5b1-e269fe25431b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc332499d33e43a385c1b531716acfd7)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:11.444190 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d0672-0ffc-43a0-b5b1-e269fe25431b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:11.452015 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 966/1951] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:56:11.455858 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9112be-85b4-4ffa-9b6f-95f40e1cae69 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:11.471862 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9112be-85b4-4ffa-9b6f-95f40e1cae69 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:11.477892 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93edb2e-4e75-4ef7-a986-ac3d1680dffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:11.480596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93edb2e-4e75-4ef7-a986-ac3d1680dffa admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:11.480911 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93edb2e-4e75-4ef7-a986-ac3d1680dffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:11.481189 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93edb2e-4e75-4ef7-a986-ac3d1680dffa admin admin] PATH_INFO: `/v3/projects/7d2634554f9346f5b7aab54082c4f83d/users/00d5a93597244241b5b8e1bb7965f920/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:11.499592 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a18d0672-0ffc-43a0-b5b1-e269fe25431b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc332499d33e43a385c1b531716acfd7'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:11.508900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93edb2e-4e75-4ef7-a986-ac3d1680dffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2634554f9346f5b7aab54082c4f83d, user_id=00d5a93597244241b5b8e1bb7965f920, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:11.511942 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93edb2e-4e75-4ef7-a986-ac3d1680dffa admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:11.520301 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a18d0672-0ffc-43a0-b5b1-e269fe25431b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc332499d33e43a385c1b531716acfd7'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:11.527479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a18d0672-0ffc-43a0-b5b1-e269fe25431b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc332499d33e43a385c1b531716acfd7'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:11.531226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a18d0672-0ffc-43a0-b5b1-e269fe25431b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc332499d33e43a385c1b531716acfd7'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:11.546010 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a18d0672-0ffc-43a0-b5b1-e269fe25431b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc332499d33e43a385c1b531716acfd7'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:11.546302 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 967/1952] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:56:11 2022] PUT /identity/v3/projects/7d2634554f9346f5b7aab54082c4f83d/users/00d5a93597244241b5b8e1bb7965f920/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:56:11.551284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93edb2e-4e75-4ef7-a986-ac3d1680dffa admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:11.551284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f93edb2e-4e75-4ef7-a986-ac3d1680dffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:11.562843 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 986/1953] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:56:11 2022] DELETE /identity/v3/users/fc332499d33e43a385c1b531716acfd7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:56:11.565200 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69d0f8-26df-48be-a685-41eef46a5a56 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:11.567182 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69d0f8-26df-48be-a685-41eef46a5a56 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:11.567634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69d0f8-26df-48be-a685-41eef46a5a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:11.599588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ad69d0f8-26df-48be-a685-41eef46a5a56 None None] MFA Rules not processed for user `00d5a93597244241b5b8e1bb7965f920`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:11.600948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ad69d0f8-26df-48be-a685-41eef46a5a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:11.650022 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93edb2e-4e75-4ef7-a986-ac3d1680dffa admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:11.680909 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 987/1954] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:56:11.693136 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69d0f8-26df-48be-a685-41eef46a5a56 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:11.694843 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ad69d0f8-26df-48be-a685-41eef46a5a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:11.745577 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf375f-e2ee-4aa7-af85-d1677664e137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:11.746456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf375f-e2ee-4aa7-af85-d1677664e137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:11.746735 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf375f-e2ee-4aa7-af85-d1677664e137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:11.747028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf375f-e2ee-4aa7-af85-d1677664e137 admin admin] PATH_INFO: `/v3/projects/18c3dbd110f74571b141113164f9934e` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:11.748855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf375f-e2ee-4aa7-af85-d1677664e137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c3dbd110f74571b141113164f9934e)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:11.751103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf375f-e2ee-4aa7-af85-d1677664e137 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:11.772157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69d0f8-26df-48be-a685-41eef46a5a56 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:11.776774 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d6d27-0f06-4373-a63a-e2b1c81342cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '281c923b01a143dbb79d8c0ea04f55b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:11.777435 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d6d27-0f06-4373-a63a-e2b1c81342cf service glance] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:11.778915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d6d27-0f06-4373-a63a-e2b1c81342cf service glance] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:11.778915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d6d27-0f06-4373-a63a-e2b1c81342cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:11.788226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d6d27-0f06-4373-a63a-e2b1c81342cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:11.789760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d6d27-0f06-4373-a63a-e2b1c81342cf service glance] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:11.801263 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 988/1955] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:56:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:56:11.806531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dfbf375f-e2ee-4aa7-af85-d1677664e137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c3dbd110f74571b141113164f9934e', 'request_id': 'req-dfbf375f-e2ee-4aa7-af85-d1677664e137'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:11.813034 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dfbf375f-e2ee-4aa7-af85-d1677664e137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c3dbd110f74571b141113164f9934e', 'request_id': 'req-dfbf375f-e2ee-4aa7-af85-d1677664e137'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:11.832586 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dfbf375f-e2ee-4aa7-af85-d1677664e137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c3dbd110f74571b141113164f9934e', 'request_id': 'req-dfbf375f-e2ee-4aa7-af85-d1677664e137'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:11.844202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dfbf375f-e2ee-4aa7-af85-d1677664e137 admin admin] The token cache is being invalidate because project 18c3dbd110f74571b141113164f9934e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:56:11.844493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dfbf375f-e2ee-4aa7-af85-d1677664e137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:11.845152 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dfbf375f-e2ee-4aa7-af85-d1677664e137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:11.846764 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 968/1956] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:56:11 2022] DELETE /identity/v3/projects/18c3dbd110f74571b141113164f9934e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:56:11.850893 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d6d27-0f06-4373-a63a-e2b1c81342cf service glance] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:11.864166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d6d27-0f06-4373-a63a-e2b1c81342cf service glance] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:11.931158 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb409f-c022-4d8c-96e6-8cea50ab08cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:11.932901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb409f-c022-4d8c-96e6-8cea50ab08cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:11.933189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb409f-c022-4d8c-96e6-8cea50ab08cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:11.933487 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb409f-c022-4d8c-96e6-8cea50ab08cc admin admin] PATH_INFO: `/v3/users/ace2a39e0f1640cab91d1ad7fc4e6e43` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:11.936377 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb409f-c022-4d8c-96e6-8cea50ab08cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace2a39e0f1640cab91d1ad7fc4e6e43)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:11.937848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb409f-c022-4d8c-96e6-8cea50ab08cc admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:11.952848 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf375f-e2ee-4aa7-af85-d1677664e137 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:11.954474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-dfbf375f-e2ee-4aa7-af85-d1677664e137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:11.967745 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf375f-e2ee-4aa7-af85-d1677664e137 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:11.972460 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf82487-d499-4b8c-a033-32d92ba827dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:11.973731 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf82487-d499-4b8c-a033-32d92ba827dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:11.974281 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf82487-d499-4b8c-a033-32d92ba827dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:11.974606 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf82487-d499-4b8c-a033-32d92ba827dc admin admin] PATH_INFO: `/v3/projects/a58468c143cd4d74b44853171625fae0` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:11.975869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf82487-d499-4b8c-a033-32d92ba827dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58468c143cd4d74b44853171625fae0)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:11.977839 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf82487-d499-4b8c-a033-32d92ba827dc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:12.006264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6bbb409f-c022-4d8c-96e6-8cea50ab08cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace2a39e0f1640cab91d1ad7fc4e6e43'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:12.042861 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6bbb409f-c022-4d8c-96e6-8cea50ab08cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace2a39e0f1640cab91d1ad7fc4e6e43'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:12.043111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dcf82487-d499-4b8c-a033-32d92ba827dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58468c143cd4d74b44853171625fae0', 'request_id': 'req-dcf82487-d499-4b8c-a033-32d92ba827dc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:12.043973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6bbb409f-c022-4d8c-96e6-8cea50ab08cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace2a39e0f1640cab91d1ad7fc4e6e43'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:12.046385 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6bbb409f-c022-4d8c-96e6-8cea50ab08cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace2a39e0f1640cab91d1ad7fc4e6e43'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:12.053256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dcf82487-d499-4b8c-a033-32d92ba827dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58468c143cd4d74b44853171625fae0', 'request_id': 'req-dcf82487-d499-4b8c-a033-32d92ba827dc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:12.059634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6bbb409f-c022-4d8c-96e6-8cea50ab08cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace2a39e0f1640cab91d1ad7fc4e6e43'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:12.070317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dcf82487-d499-4b8c-a033-32d92ba827dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58468c143cd4d74b44853171625fae0', 'request_id': 'req-dcf82487-d499-4b8c-a033-32d92ba827dc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:12.088509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 989/1957] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:56:11 2022] DELETE /identity/v3/users/ace2a39e0f1640cab91d1ad7fc4e6e43 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:56:12.091681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dcf82487-d499-4b8c-a033-32d92ba827dc admin admin] The token cache is being invalidate because project a58468c143cd4d74b44853171625fae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:56:12.091681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dcf82487-d499-4b8c-a033-32d92ba827dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:12.091681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dcf82487-d499-4b8c-a033-32d92ba827dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:12.098407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6f2ba-c5ad-4ffa-bf47-30a5044325b1 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:12.098697 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6f2ba-c5ad-4ffa-bf47-30a5044325b1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:12.099540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6f2ba-c5ad-4ffa-bf47-30a5044325b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:12.102492 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 969/1958] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:56:11 2022] DELETE /identity/v3/projects/a58468c143cd4d74b44853171625fae0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:56:12.131804 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b5d6f2ba-c5ad-4ffa-bf47-30a5044325b1 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:12.134239 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b5d6f2ba-c5ad-4ffa-bf47-30a5044325b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:12.266872 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 990/1959] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:56:12.274744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3de6eb-825b-4728-9594-b3fefa54262b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:12.275771 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3de6eb-825b-4728-9594-b3fefa54262b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:12.276387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3de6eb-825b-4728-9594-b3fefa54262b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:12.331662 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-bd3de6eb-825b-4728-9594-b3fefa54262b None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:12.332910 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bd3de6eb-825b-4728-9594-b3fefa54262b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:12.374582 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 970/1960] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:56:12.376923 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6f2ba-c5ad-4ffa-bf47-30a5044325b1 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:12.388001 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6f2ba-c5ad-4ffa-bf47-30a5044325b1 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:12.393509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753c7af-38fc-4e2b-b3d6-d0547db22a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:12.394422 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753c7af-38fc-4e2b-b3d6-d0547db22a28 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:12.394712 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753c7af-38fc-4e2b-b3d6-d0547db22a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:12.395077 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753c7af-38fc-4e2b-b3d6-d0547db22a28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:12.395835 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753c7af-38fc-4e2b-b3d6-d0547db22a28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:56:12.396180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753c7af-38fc-4e2b-b3d6-d0547db22a28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:12.397888 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753c7af-38fc-4e2b-b3d6-d0547db22a28 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:12.418234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 991/1961] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:56:12.419489 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3de6eb-825b-4728-9594-b3fefa54262b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:12.431333 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3de6eb-825b-4728-9594-b3fefa54262b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:12.445198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a56853-5405-4f03-a71e-59afb80079eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:12.446021 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a56853-5405-4f03-a71e-59afb80079eb admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:12.446341 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a56853-5405-4f03-a71e-59afb80079eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:12.446565 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a56853-5405-4f03-a71e-59afb80079eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:12.447310 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a56853-5405-4f03-a71e-59afb80079eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:12.449336 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a56853-5405-4f03-a71e-59afb80079eb admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:12.488289 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 971/1962] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:56:12 2022] POST /identity/v3/projects => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:56:12.493440 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753c7af-38fc-4e2b-b3d6-d0547db22a28 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:12.509551 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753c7af-38fc-4e2b-b3d6-d0547db22a28 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:12.548332 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a56853-5405-4f03-a71e-59afb80079eb admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:12.550230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d8a56853-5405-4f03-a71e-59afb80079eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:12.604352 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22602d-02a2-43da-8e23-86170e9db0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:12.605310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22602d-02a2-43da-8e23-86170e9db0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:12.605710 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22602d-02a2-43da-8e23-86170e9db0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:12.606009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22602d-02a2-43da-8e23-86170e9db0e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:12.606917 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22602d-02a2-43da-8e23-86170e9db0e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:12.609975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22602d-02a2-43da-8e23-86170e9db0e4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:12.635132 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 992/1963] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:56:12 2022] POST /identity/v3/users => generated 284 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:56:12.637996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a56853-5405-4f03-a71e-59afb80079eb admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:12.638888 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22602d-02a2-43da-8e23-86170e9db0e4 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:12.643529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f3feb-241c-4c89-b6c9-e0b7d97722bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:12.644594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f3feb-241c-4c89-b6c9-e0b7d97722bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:12.645014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f3feb-241c-4c89-b6c9-e0b7d97722bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:12.645451 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f3feb-241c-4c89-b6c9-e0b7d97722bf admin admin] PATH_INFO: `/v3/projects/b819f98074a44322bf6c0dca8a3b1c69` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:12.647219 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f3feb-241c-4c89-b6c9-e0b7d97722bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b819f98074a44322bf6c0dca8a3b1c69)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:12.649173 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f3feb-241c-4c89-b6c9-e0b7d97722bf admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:12.651654 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22602d-02a2-43da-8e23-86170e9db0e4 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:12.660092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf806a96-a26a-4a42-a052-1ad6790203d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:12.661062 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf806a96-a26a-4a42-a052-1ad6790203d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:12.661335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf806a96-a26a-4a42-a052-1ad6790203d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:12.661610 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf806a96-a26a-4a42-a052-1ad6790203d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:12.662340 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf806a96-a26a-4a42-a052-1ad6790203d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:12.663977 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf806a96-a26a-4a42-a052-1ad6790203d9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:12.676973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 993/1964] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:56:12.678735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf806a96-a26a-4a42-a052-1ad6790203d9 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:12.688774 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf806a96-a26a-4a42-a052-1ad6790203d9 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:12.693342 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bbdaa-d6bf-4e48-a7e0-5d8a34b94e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:12.694067 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bbdaa-d6bf-4e48-a7e0-5d8a34b94e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:12.694283 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bbdaa-d6bf-4e48-a7e0-5d8a34b94e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:12.694555 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bbdaa-d6bf-4e48-a7e0-5d8a34b94e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:12.695316 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bbdaa-d6bf-4e48-a7e0-5d8a34b94e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:12.696907 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bbdaa-d6bf-4e48-a7e0-5d8a34b94e6a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:12.710998 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 994/1965] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:56:12.712282 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bbdaa-d6bf-4e48-a7e0-5d8a34b94e6a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:12.713811 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-242f3feb-241c-4c89-b6c9-e0b7d97722bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b819f98074a44322bf6c0dca8a3b1c69', 'request_id': 'req-242f3feb-241c-4c89-b6c9-e0b7d97722bf'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:12.720538 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-242f3feb-241c-4c89-b6c9-e0b7d97722bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b819f98074a44322bf6c0dca8a3b1c69', 'request_id': 'req-242f3feb-241c-4c89-b6c9-e0b7d97722bf'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:12.722638 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bbdaa-d6bf-4e48-a7e0-5d8a34b94e6a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:12.729206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-242f3feb-241c-4c89-b6c9-e0b7d97722bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b819f98074a44322bf6c0dca8a3b1c69', 'request_id': 'req-242f3feb-241c-4c89-b6c9-e0b7d97722bf'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:12.742356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-242f3feb-241c-4c89-b6c9-e0b7d97722bf admin admin] The token cache is being invalidate because project b819f98074a44322bf6c0dca8a3b1c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:56:12.742842 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-242f3feb-241c-4c89-b6c9-e0b7d97722bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:12.743586 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-242f3feb-241c-4c89-b6c9-e0b7d97722bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:12.745234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 972/1966] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:56:12 2022] DELETE /identity/v3/projects/b819f98074a44322bf6c0dca8a3b1c69 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:56:12.752962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e335fd-bef7-42a5-a560-12413be59a14 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:12.753547 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e335fd-bef7-42a5-a560-12413be59a14 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:12.754006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e335fd-bef7-42a5-a560-12413be59a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:12.776681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b1e335fd-bef7-42a5-a560-12413be59a14 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:12.778037 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b1e335fd-bef7-42a5-a560-12413be59a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:12.791139 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffd33a-cc00-4db5-bb12-097892da5a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:12.792064 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffd33a-cc00-4db5-bb12-097892da5a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:12.792346 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffd33a-cc00-4db5-bb12-097892da5a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:12.792621 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffd33a-cc00-4db5-bb12-097892da5a9b admin admin] PATH_INFO: `/v3/projects/df35235f807e47bcbd33fc67740d50e4/users/36d9de38fa6b46d9bca0c5298cbbe398/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:12.812156 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcffd33a-cc00-4db5-bb12-097892da5a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=df35235f807e47bcbd33fc67740d50e4, user_id=36d9de38fa6b46d9bca0c5298cbbe398, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:12.815400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcffd33a-cc00-4db5-bb12-097892da5a9b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:12.836709 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 995/1967] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:56:12 2022] PUT /identity/v3/projects/df35235f807e47bcbd33fc67740d50e4/users/36d9de38fa6b46d9bca0c5298cbbe398/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:56:12.848931 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104d426-c7ba-414c-8f16-3e1dcfd73f8c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:12.849243 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104d426-c7ba-414c-8f16-3e1dcfd73f8c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:12.849495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104d426-c7ba-414c-8f16-3e1dcfd73f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:12.860884 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 973/1968] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:56:12.871114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fe01f-09ae-409f-bd24-6b127e21418e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:12.871416 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fe01f-09ae-409f-bd24-6b127e21418e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:12.871702 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fe01f-09ae-409f-bd24-6b127e21418e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:12.881182 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1104d426-c7ba-414c-8f16-3e1dcfd73f8c None None] MFA Rules not processed for user `36d9de38fa6b46d9bca0c5298cbbe398`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:12.882444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1104d426-c7ba-414c-8f16-3e1dcfd73f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:12.890389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-6c0fe01f-09ae-409f-bd24-6b127e21418e None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:12.891621 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6c0fe01f-09ae-409f-bd24-6b127e21418e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:12.970800 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 974/1969] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:56:12.971931 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fe01f-09ae-409f-bd24-6b127e21418e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:12.977809 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 996/1970] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:56:12.982026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104d426-c7ba-414c-8f16-3e1dcfd73f8c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:12.983481 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1104d426-c7ba-414c-8f16-3e1dcfd73f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:12.985578 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fe01f-09ae-409f-bd24-6b127e21418e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:12.996502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d8ad8-9eb5-46c3-aa69-aeaf01d81511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:12.997294 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d8ad8-9eb5-46c3-aa69-aeaf01d81511 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:12.998039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104d426-c7ba-414c-8f16-3e1dcfd73f8c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:12.998728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d8ad8-9eb5-46c3-aa69-aeaf01d81511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:12.999097 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d8ad8-9eb5-46c3-aa69-aeaf01d81511 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:13.000765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d8ad8-9eb5-46c3-aa69-aeaf01d81511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:56:13.000765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d8ad8-9eb5-46c3-aa69-aeaf01d81511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:13.002989 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d8ad8-9eb5-46c3-aa69-aeaf01d81511 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:13.016229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8ec30-a060-4322-97f1-901d169c7868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:13.017340 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8ec30-a060-4322-97f1-901d169c7868 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:13.017684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8ec30-a060-4322-97f1-901d169c7868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:13.017995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8ec30-a060-4322-97f1-901d169c7868 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:13.018995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8ec30-a060-4322-97f1-901d169c7868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:13.020778 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8ec30-a060-4322-97f1-901d169c7868 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:13.030941 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 975/1971] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:56:13.032186 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d8ad8-9eb5-46c3-aa69-aeaf01d81511 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:13.046460 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d8ad8-9eb5-46c3-aa69-aeaf01d81511 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:13.052638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93158dde-eebc-438d-aec0-dc3507d6e54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:13.053495 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93158dde-eebc-438d-aec0-dc3507d6e54a admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:13.053781 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93158dde-eebc-438d-aec0-dc3507d6e54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:13.054398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93158dde-eebc-438d-aec0-dc3507d6e54a admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:13.055448 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93158dde-eebc-438d-aec0-dc3507d6e54a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:13.057351 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93158dde-eebc-438d-aec0-dc3507d6e54a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:13.066136 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 997/1972] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:56:12 2022] POST /identity/v3/projects => generated 369 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:56:13.069234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8ec30-a060-4322-97f1-901d169c7868 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:13.095001 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 976/1973] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:56:13 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:56:13.097604 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93158dde-eebc-438d-aec0-dc3507d6e54a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:13.155900 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8ec30-a060-4322-97f1-901d169c7868 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:13.173518 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93158dde-eebc-438d-aec0-dc3507d6e54a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:13.189371 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fa32b-eacd-4f2a-9fcb-efe3e9ba366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:13.190217 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fa32b-eacd-4f2a-9fcb-efe3e9ba366a admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:13.190535 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fa32b-eacd-4f2a-9fcb-efe3e9ba366a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:13.190850 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fa32b-eacd-4f2a-9fcb-efe3e9ba366a admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:13.191610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65fa32b-eacd-4f2a-9fcb-efe3e9ba366a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:13.193643 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65fa32b-eacd-4f2a-9fcb-efe3e9ba366a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:13.218576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 977/1974] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:56:13 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:56:13.222808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fa32b-eacd-4f2a-9fcb-efe3e9ba366a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:13.227894 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038cdc9-3ec0-4b67-ab7e-7e2abe8fdb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:13.228830 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038cdc9-3ec0-4b67-ab7e-7e2abe8fdb40 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:13.229334 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038cdc9-3ec0-4b67-ab7e-7e2abe8fdb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:13.229705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038cdc9-3ec0-4b67-ab7e-7e2abe8fdb40 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:13.230617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038cdc9-3ec0-4b67-ab7e-7e2abe8fdb40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:13.233357 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038cdc9-3ec0-4b67-ab7e-7e2abe8fdb40 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:13.233978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fa32b-eacd-4f2a-9fcb-efe3e9ba366a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:13.243181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb775a47-368b-421a-ba5b-b290d551c720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:13.243181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb775a47-368b-421a-ba5b-b290d551c720 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:13.243181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb775a47-368b-421a-ba5b-b290d551c720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:13.243181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb775a47-368b-421a-ba5b-b290d551c720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:13.243689 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb775a47-368b-421a-ba5b-b290d551c720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:13.244116 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb775a47-368b-421a-ba5b-b290d551c720 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:13.256204 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 978/1975] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:56:13.260358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb775a47-368b-421a-ba5b-b290d551c720 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:13.268518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 998/1976] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:56:13 2022] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:56:13.270396 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038cdc9-3ec0-4b67-ab7e-7e2abe8fdb40 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:13.279525 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb775a47-368b-421a-ba5b-b290d551c720 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:13.286672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038cdc9-3ec0-4b67-ab7e-7e2abe8fdb40 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:13.291693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d5de9-dcdb-4d3f-a9cc-c54119150ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:13.291992 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8e393-9898-42dc-83d4-8e34acb48ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:13.292859 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8e393-9898-42dc-83d4-8e34acb48ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:13.293270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8e393-9898-42dc-83d4-8e34acb48ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:13.293646 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8e393-9898-42dc-83d4-8e34acb48ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:13.294626 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8e393-9898-42dc-83d4-8e34acb48ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:13.296471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8e393-9898-42dc-83d4-8e34acb48ff4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:13.297523 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d5de9-dcdb-4d3f-a9cc-c54119150ffa admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:13.297870 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d5de9-dcdb-4d3f-a9cc-c54119150ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:13.298081 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d5de9-dcdb-4d3f-a9cc-c54119150ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:13.298835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d5de9-dcdb-4d3f-a9cc-c54119150ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:13.300489 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d5de9-dcdb-4d3f-a9cc-c54119150ffa admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:13.311317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 999/1977] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:56:13.315131 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 979/1978] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:56:13.315935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8e393-9898-42dc-83d4-8e34acb48ff4 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:13.316121 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d5de9-dcdb-4d3f-a9cc-c54119150ffa admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:13.326151 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8e393-9898-42dc-83d4-8e34acb48ff4 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:13.327602 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d5de9-dcdb-4d3f-a9cc-c54119150ffa admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:13.331577 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4667f-9287-4f0e-a9d8-d2599d1a9190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:13.332546 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4667f-9287-4f0e-a9d8-d2599d1a9190 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:13.332916 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4667f-9287-4f0e-a9d8-d2599d1a9190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:13.333257 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4667f-9287-4f0e-a9d8-d2599d1a9190 admin admin] PATH_INFO: `/v3/projects/ddf1d66de94a45b1843e2834876f7022/users/7cc86b5f6f004ad2896cb10e904c36de/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:13.334268 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13896c83-fd4e-4809-9077-b474ebac35a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:13.334721 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13896c83-fd4e-4809-9077-b474ebac35a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:13.336059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13896c83-fd4e-4809-9077-b474ebac35a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:13.336428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13896c83-fd4e-4809-9077-b474ebac35a2 admin admin] PATH_INFO: `/v3/projects/4b1d2c45e8994764933474ed8de30feb/users/b91630843e334898af570d547dd3f57e/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:13.356234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4667f-9287-4f0e-a9d8-d2599d1a9190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf1d66de94a45b1843e2834876f7022, user_id=7cc86b5f6f004ad2896cb10e904c36de, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:13.359065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4667f-9287-4f0e-a9d8-d2599d1a9190 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:13.361485 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13896c83-fd4e-4809-9077-b474ebac35a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1d2c45e8994764933474ed8de30feb, user_id=b91630843e334898af570d547dd3f57e, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:13.364471 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13896c83-fd4e-4809-9077-b474ebac35a2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:13.374992 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1000/1979] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:56:13 2022] PUT /identity/v3/projects/ddf1d66de94a45b1843e2834876f7022/users/7cc86b5f6f004ad2896cb10e904c36de/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:56:13.378815 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 980/1980] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:56:13 2022] PUT /identity/v3/projects/4b1d2c45e8994764933474ed8de30feb/users/b91630843e334898af570d547dd3f57e/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:56:13.378980 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4667f-9287-4f0e-a9d8-d2599d1a9190 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:13.391120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644a9ec-6141-4b0a-9aab-7bd9eef00acc None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:13.391120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644a9ec-6141-4b0a-9aab-7bd9eef00acc None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:13.391120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644a9ec-6141-4b0a-9aab-7bd9eef00acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:13.420095 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-4644a9ec-6141-4b0a-9aab-7bd9eef00acc None None] MFA Rules not processed for user `b91630843e334898af570d547dd3f57e`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:13.421558 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4644a9ec-6141-4b0a-9aab-7bd9eef00acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:13.454101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4667f-9287-4f0e-a9d8-d2599d1a9190 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:13.491575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 981/1981] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:56:13.500340 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644a9ec-6141-4b0a-9aab-7bd9eef00acc None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:13.501841 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4644a9ec-6141-4b0a-9aab-7bd9eef00acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:13.529006 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f8d6c-9a2c-4318-bc25-a99a187b2779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:13.529748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f8d6c-9a2c-4318-bc25-a99a187b2779 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:13.530037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f8d6c-9a2c-4318-bc25-a99a187b2779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:13.530313 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f8d6c-9a2c-4318-bc25-a99a187b2779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:13.531085 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f8d6c-9a2c-4318-bc25-a99a187b2779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:13.532714 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f8d6c-9a2c-4318-bc25-a99a187b2779 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:13.555562 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1001/1982] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:56:13.558775 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f8d6c-9a2c-4318-bc25-a99a187b2779 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:13.570551 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f8d6c-9a2c-4318-bc25-a99a187b2779 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:13.576057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af112e-ed83-46ec-b615-03594e380235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:13.576960 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af112e-ed83-46ec-b615-03594e380235 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:13.577351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af112e-ed83-46ec-b615-03594e380235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:13.577528 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af112e-ed83-46ec-b615-03594e380235 admin admin] PATH_INFO: `/v3/projects/ddf1d66de94a45b1843e2834876f7022/users/7cc86b5f6f004ad2896cb10e904c36de/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:13.579797 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af112e-ed83-46ec-b615-03594e380235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf1d66de94a45b1843e2834876f7022, user_id=7cc86b5f6f004ad2896cb10e904c36de, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:13.582460 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af112e-ed83-46ec-b615-03594e380235 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:13.584620 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644a9ec-6141-4b0a-9aab-7bd9eef00acc None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:13.589103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe604e2-d735-4f4f-93f3-5278a5ac6271 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:13.589760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe604e2-d735-4f4f-93f3-5278a5ac6271 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:13.590212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe604e2-d735-4f4f-93f3-5278a5ac6271 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:13.590487 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe604e2-d735-4f4f-93f3-5278a5ac6271 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:13.602902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1002/1983] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:56:13 2022] PUT /identity/v3/projects/ddf1d66de94a45b1843e2834876f7022/users/7cc86b5f6f004ad2896cb10e904c36de/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:56:13.604426 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe604e2-d735-4f4f-93f3-5278a5ac6271 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:13.605192 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd483a5-6d9f-4c83-b90d-1135ea69eb1c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:13.605538 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd483a5-6d9f-4c83-b90d-1135ea69eb1c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:13.606047 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd483a5-6d9f-4c83-b90d-1135ea69eb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:13.606213 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe604e2-d735-4f4f-93f3-5278a5ac6271 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:13.617526 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 982/1984] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:56:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:56:13.636544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-cdd483a5-6d9f-4c83-b90d-1135ea69eb1c None None] MFA Rules not processed for user `7cc86b5f6f004ad2896cb10e904c36de`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:13.638482 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cdd483a5-6d9f-4c83-b90d-1135ea69eb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:13.640232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe604e2-d735-4f4f-93f3-5278a5ac6271 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:13.650568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe604e2-d735-4f4f-93f3-5278a5ac6271 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:13.716196 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94c414-8ffd-4a67-9b17-a8f924b8b72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:13.716988 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1003/1985] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:13 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:56:13.717195 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94c414-8ffd-4a67-9b17-a8f924b8b72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:13.717471 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94c414-8ffd-4a67-9b17-a8f924b8b72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:13.717744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94c414-8ffd-4a67-9b17-a8f924b8b72e admin admin] PATH_INFO: `/v3/users/b91630843e334898af570d547dd3f57e` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:13.718979 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94c414-8ffd-4a67-9b17-a8f924b8b72e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b91630843e334898af570d547dd3f57e)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:13.720935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94c414-8ffd-4a67-9b17-a8f924b8b72e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:13.727507 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd483a5-6d9f-4c83-b90d-1135ea69eb1c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:13.728949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cdd483a5-6d9f-4c83-b90d-1135ea69eb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:13.766502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bf94c414-8ffd-4a67-9b17-a8f924b8b72e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b91630843e334898af570d547dd3f57e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:13.779356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bf94c414-8ffd-4a67-9b17-a8f924b8b72e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b91630843e334898af570d547dd3f57e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:13.780008 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bf94c414-8ffd-4a67-9b17-a8f924b8b72e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b91630843e334898af570d547dd3f57e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:13.780604 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bf94c414-8ffd-4a67-9b17-a8f924b8b72e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b91630843e334898af570d547dd3f57e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:13.788301 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bf94c414-8ffd-4a67-9b17-a8f924b8b72e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b91630843e334898af570d547dd3f57e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:13.791866 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd483a5-6d9f-4c83-b90d-1135ea69eb1c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:13.795832 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8db868-1cc1-4d7b-908a-285849625c09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:13.796485 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8db868-1cc1-4d7b-908a-285849625c09 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:13.796769 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8db868-1cc1-4d7b-908a-285849625c09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:13.797039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8db868-1cc1-4d7b-908a-285849625c09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:13.798825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bf8db868-1cc1-4d7b-908a-285849625c09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:13.801482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 983/1986] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:56:13 2022] DELETE /identity/v3/users/b91630843e334898af570d547dd3f57e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:56:13.806680 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6961319-0330-4519-b017-826af1b25d30 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:13.807145 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6961319-0330-4519-b017-826af1b25d30 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:13.807487 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6961319-0330-4519-b017-826af1b25d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:13.813897 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8db868-1cc1-4d7b-908a-285849625c09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:13.814753 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8db868-1cc1-4d7b-908a-285849625c09 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:13.824568 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1004/1987] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:56:13 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:56:13.831766 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c6961319-0330-4519-b017-826af1b25d30 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:13.832973 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c6961319-0330-4519-b017-826af1b25d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:13.904764 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 984/1988] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:56:13.915013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8db868-1cc1-4d7b-908a-285849625c09 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:13.916588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bf8db868-1cc1-4d7b-908a-285849625c09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:13.983716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8db868-1cc1-4d7b-908a-285849625c09 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:14.035779 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08e7c3-08b4-43fc-af1f-fdb25a2686c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:14.036447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08e7c3-08b4-43fc-af1f-fdb25a2686c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:14.036731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08e7c3-08b4-43fc-af1f-fdb25a2686c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:14.037008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08e7c3-08b4-43fc-af1f-fdb25a2686c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:14.048981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08e7c3-08b4-43fc-af1f-fdb25a2686c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:14.055058 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08e7c3-08b4-43fc-af1f-fdb25a2686c5 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:14.062355 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1005/1989] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:56:14.436806 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6961319-0330-4519-b017-826af1b25d30 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:14.438603 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c6961319-0330-4519-b017-826af1b25d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:14.469577 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6961319-0330-4519-b017-826af1b25d30 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:14.475271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1f1c7-5a80-43a4-9cfc-c8b6a7e4527c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:14.476159 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1f1c7-5a80-43a4-9cfc-c8b6a7e4527c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:14.476439 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1f1c7-5a80-43a4-9cfc-c8b6a7e4527c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:14.476712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1f1c7-5a80-43a4-9cfc-c8b6a7e4527c admin admin] PATH_INFO: `/v3/projects/4b1d2c45e8994764933474ed8de30feb` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:14.490703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1f1c7-5a80-43a4-9cfc-c8b6a7e4527c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b1d2c45e8994764933474ed8de30feb)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:14.493445 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1f1c7-5a80-43a4-9cfc-c8b6a7e4527c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:14.555078 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9ec1f1c7-5a80-43a4-9cfc-c8b6a7e4527c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b1d2c45e8994764933474ed8de30feb', 'request_id': 'req-9ec1f1c7-5a80-43a4-9cfc-c8b6a7e4527c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:14.561978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9ec1f1c7-5a80-43a4-9cfc-c8b6a7e4527c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b1d2c45e8994764933474ed8de30feb', 'request_id': 'req-9ec1f1c7-5a80-43a4-9cfc-c8b6a7e4527c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:14.579582 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9ec1f1c7-5a80-43a4-9cfc-c8b6a7e4527c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b1d2c45e8994764933474ed8de30feb', 'request_id': 'req-9ec1f1c7-5a80-43a4-9cfc-c8b6a7e4527c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:14.617014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9ec1f1c7-5a80-43a4-9cfc-c8b6a7e4527c admin admin] The token cache is being invalidate because project 4b1d2c45e8994764933474ed8de30feb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:56:14.617649 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9ec1f1c7-5a80-43a4-9cfc-c8b6a7e4527c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:14.620125 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9ec1f1c7-5a80-43a4-9cfc-c8b6a7e4527c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:14.626120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 985/1990] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:56:14 2022] DELETE /identity/v3/projects/4b1d2c45e8994764933474ed8de30feb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:56:14.629298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3be964-3dd0-47b1-aefc-6bbac204ae72 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:14.629791 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3be964-3dd0-47b1-aefc-6bbac204ae72 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:14.629868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3be964-3dd0-47b1-aefc-6bbac204ae72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:14.687519 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5b3be964-3dd0-47b1-aefc-6bbac204ae72 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:14.689028 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5b3be964-3dd0-47b1-aefc-6bbac204ae72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:14.757412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1006/1991] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:56:14.765709 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08963169-9e3f-4854-ae11-12a07de5d8e9 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:14.766686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08963169-9e3f-4854-ae11-12a07de5d8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:14.766991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08963169-9e3f-4854-ae11-12a07de5d8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:14.790952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-08963169-9e3f-4854-ae11-12a07de5d8e9 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:14.792391 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-08963169-9e3f-4854-ae11-12a07de5d8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:14.802299 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 986/1992] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:56:14.806797 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3be964-3dd0-47b1-aefc-6bbac204ae72 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:14.818679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3be964-3dd0-47b1-aefc-6bbac204ae72 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:14.824128 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0c9df-2afd-4397-89e5-044811de8f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:14.824811 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0c9df-2afd-4397-89e5-044811de8f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:14.825101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0c9df-2afd-4397-89e5-044811de8f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:14.825380 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0c9df-2afd-4397-89e5-044811de8f22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:14.826617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0c9df-2afd-4397-89e5-044811de8f22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:56:14.826930 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0c9df-2afd-4397-89e5-044811de8f22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:14.828592 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0c9df-2afd-4397-89e5-044811de8f22 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:14.841576 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1007/1993] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:56:14.845748 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08963169-9e3f-4854-ae11-12a07de5d8e9 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:14.859697 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08963169-9e3f-4854-ae11-12a07de5d8e9 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:14.864525 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d37d1-a78f-41a5-b2e3-729de1491486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:14.865323 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d37d1-a78f-41a5-b2e3-729de1491486 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:14.865993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d37d1-a78f-41a5-b2e3-729de1491486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:14.866369 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d37d1-a78f-41a5-b2e3-729de1491486 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:14.867385 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d37d1-a78f-41a5-b2e3-729de1491486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:14.870511 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d37d1-a78f-41a5-b2e3-729de1491486 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:14.919031 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 987/1994] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:56:14 2022] POST /identity/v3/projects => generated 365 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:56:14.920223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0c9df-2afd-4397-89e5-044811de8f22 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:14.931113 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0c9df-2afd-4397-89e5-044811de8f22 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:15.026287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a0c22-a8f9-4452-b348-26f0cc0a252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:15.027107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a0c22-a8f9-4452-b348-26f0cc0a252e admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:15.028160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a0c22-a8f9-4452-b348-26f0cc0a252e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:15.028529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a0c22-a8f9-4452-b348-26f0cc0a252e admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:15.029529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a0c22-a8f9-4452-b348-26f0cc0a252e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:15.032085 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a0c22-a8f9-4452-b348-26f0cc0a252e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:15.056492 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1008/1995] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:56:14 2022] POST /identity/v3/users => generated 283 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:56:15.060894 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d37d1-a78f-41a5-b2e3-729de1491486 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:15.072797 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d37d1-a78f-41a5-b2e3-729de1491486 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:15.078116 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed69011-196e-4bf8-873b-f404d8d9bf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:15.078898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed69011-196e-4bf8-873b-f404d8d9bf72 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:15.079275 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed69011-196e-4bf8-873b-f404d8d9bf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:15.079615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed69011-196e-4bf8-873b-f404d8d9bf72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:15.080425 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed69011-196e-4bf8-873b-f404d8d9bf72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:15.082191 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed69011-196e-4bf8-873b-f404d8d9bf72 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:15.093569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 988/1996] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:56:15.097489 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a0c22-a8f9-4452-b348-26f0cc0a252e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:15.108946 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a0c22-a8f9-4452-b348-26f0cc0a252e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:15.113723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c8abd-5fd3-4574-927f-e21dffc79252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:15.114391 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c8abd-5fd3-4574-927f-e21dffc79252 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:15.114672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c8abd-5fd3-4574-927f-e21dffc79252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:15.114948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c8abd-5fd3-4574-927f-e21dffc79252 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:15.115735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c8abd-5fd3-4574-927f-e21dffc79252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:15.117330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c8abd-5fd3-4574-927f-e21dffc79252 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:15.134626 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1009/1997] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:56:15.138790 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed69011-196e-4bf8-873b-f404d8d9bf72 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:15.148738 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed69011-196e-4bf8-873b-f404d8d9bf72 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:15.153307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa83f6-185b-454b-a542-b91870cc2661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:15.154238 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa83f6-185b-454b-a542-b91870cc2661 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:15.154519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa83f6-185b-454b-a542-b91870cc2661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:15.154794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa83f6-185b-454b-a542-b91870cc2661 admin admin] PATH_INFO: `/v3/projects/79cdf2f94daa4cceafccb76146db64f0/users/d8a56f059d194f3d922a878dde88c254/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:15.169190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa83f6-185b-454b-a542-b91870cc2661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79cdf2f94daa4cceafccb76146db64f0, user_id=d8a56f059d194f3d922a878dde88c254, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:15.171938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa83f6-185b-454b-a542-b91870cc2661 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:15.186340 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 989/1998] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:56:15 2022] PUT /identity/v3/projects/79cdf2f94daa4cceafccb76146db64f0/users/d8a56f059d194f3d922a878dde88c254/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:56:15.197357 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e0a76-c04d-46c7-9a39-252bda895d3e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:15.197651 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e0a76-c04d-46c7-9a39-252bda895d3e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:15.197934 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e0a76-c04d-46c7-9a39-252bda895d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:15.238092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-df0e0a76-c04d-46c7-9a39-252bda895d3e None None] MFA Rules not processed for user `d8a56f059d194f3d922a878dde88c254`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:15.239961 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-df0e0a76-c04d-46c7-9a39-252bda895d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:15.331165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1010/1999] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:15 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:56:15.344786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa83f6-185b-454b-a542-b91870cc2661 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:15.346636 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b3aa83f6-185b-454b-a542-b91870cc2661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:15.415860 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa83f6-185b-454b-a542-b91870cc2661 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:15.419888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3255f6-f92e-4ce3-b9a3-f675a3855c4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:15.420601 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3255f6-f92e-4ce3-b9a3-f675a3855c4a service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:15.420941 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3255f6-f92e-4ce3-b9a3-f675a3855c4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:15.421275 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3255f6-f92e-4ce3-b9a3-f675a3855c4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:15.428269 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e0a76-c04d-46c7-9a39-252bda895d3e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:15.429652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-df0e0a76-c04d-46c7-9a39-252bda895d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:15.430494 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3255f6-f92e-4ce3-b9a3-f675a3855c4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:15.431975 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3255f6-f92e-4ce3-b9a3-f675a3855c4a service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:15.441828 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 990/2000] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:56:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:56:15.536785 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e0a76-c04d-46c7-9a39-252bda895d3e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:15.541769 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77659ef2-a058-4e6c-a119-c549dfbdcffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:15.543067 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77659ef2-a058-4e6c-a119-c549dfbdcffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:15.543465 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77659ef2-a058-4e6c-a119-c549dfbdcffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:15.543837 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77659ef2-a058-4e6c-a119-c549dfbdcffe admin admin] PATH_INFO: `/v3/users/36d9de38fa6b46d9bca0c5298cbbe398` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:15.545143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77659ef2-a058-4e6c-a119-c549dfbdcffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=36d9de38fa6b46d9bca0c5298cbbe398)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:15.547292 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77659ef2-a058-4e6c-a119-c549dfbdcffe admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:15.600137 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-77659ef2-a058-4e6c-a119-c549dfbdcffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36d9de38fa6b46d9bca0c5298cbbe398'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:15.614752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-77659ef2-a058-4e6c-a119-c549dfbdcffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36d9de38fa6b46d9bca0c5298cbbe398'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:15.616486 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-77659ef2-a058-4e6c-a119-c549dfbdcffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36d9de38fa6b46d9bca0c5298cbbe398'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:15.617869 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-77659ef2-a058-4e6c-a119-c549dfbdcffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36d9de38fa6b46d9bca0c5298cbbe398'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:15.636726 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-77659ef2-a058-4e6c-a119-c549dfbdcffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36d9de38fa6b46d9bca0c5298cbbe398'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:15.675989 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1011/2001] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:56:15 2022] DELETE /identity/v3/users/36d9de38fa6b46d9bca0c5298cbbe398 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:56:15.680767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c213c42-1221-436b-9097-f693dc3888b2 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:15.680910 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c213c42-1221-436b-9097-f693dc3888b2 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:15.681263 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c213c42-1221-436b-9097-f693dc3888b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:15.727323 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2c213c42-1221-436b-9097-f693dc3888b2 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:15.729538 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2c213c42-1221-436b-9097-f693dc3888b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:15.802946 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 991/2002] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:56:15.822322 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77659ef2-a058-4e6c-a119-c549dfbdcffe admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:15.824100 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-77659ef2-a058-4e6c-a119-c549dfbdcffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:15.927189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77659ef2-a058-4e6c-a119-c549dfbdcffe admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:15.941180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6f276-f3fc-461d-8067-a9c9cd848ba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:15.942932 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6f276-f3fc-461d-8067-a9c9cd848ba0 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:15.945153 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6f276-f3fc-461d-8067-a9c9cd848ba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:15.945557 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6f276-f3fc-461d-8067-a9c9cd848ba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:15.956849 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6f276-f3fc-461d-8067-a9c9cd848ba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:15.958569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6f276-f3fc-461d-8067-a9c9cd848ba0 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:15.970913 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1012/2003] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:56:16.808880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c213c42-1221-436b-9097-f693dc3888b2 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:16.810926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2c213c42-1221-436b-9097-f693dc3888b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:16.824459 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c213c42-1221-436b-9097-f693dc3888b2 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:16.829588 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af876e1e-ebb9-4371-8ab6-893c34b2ed2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:16.830524 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af876e1e-ebb9-4371-8ab6-893c34b2ed2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:16.830804 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af876e1e-ebb9-4371-8ab6-893c34b2ed2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:16.831114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af876e1e-ebb9-4371-8ab6-893c34b2ed2f admin admin] PATH_INFO: `/v3/projects/df35235f807e47bcbd33fc67740d50e4` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:16.832683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af876e1e-ebb9-4371-8ab6-893c34b2ed2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=df35235f807e47bcbd33fc67740d50e4)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:16.834575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af876e1e-ebb9-4371-8ab6-893c34b2ed2f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:16.893448 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-af876e1e-ebb9-4371-8ab6-893c34b2ed2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df35235f807e47bcbd33fc67740d50e4', 'request_id': 'req-af876e1e-ebb9-4371-8ab6-893c34b2ed2f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:16.902313 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-af876e1e-ebb9-4371-8ab6-893c34b2ed2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df35235f807e47bcbd33fc67740d50e4', 'request_id': 'req-af876e1e-ebb9-4371-8ab6-893c34b2ed2f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:16.911352 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-af876e1e-ebb9-4371-8ab6-893c34b2ed2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df35235f807e47bcbd33fc67740d50e4', 'request_id': 'req-af876e1e-ebb9-4371-8ab6-893c34b2ed2f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:16.923442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-af876e1e-ebb9-4371-8ab6-893c34b2ed2f admin admin] The token cache is being invalidate because project df35235f807e47bcbd33fc67740d50e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:56:16.923895 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-af876e1e-ebb9-4371-8ab6-893c34b2ed2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:16.924661 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-af876e1e-ebb9-4371-8ab6-893c34b2ed2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:16.926455 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 992/2004] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:56:16 2022] DELETE /identity/v3/projects/df35235f807e47bcbd33fc67740d50e4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:56:16.930840 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6f276-f3fc-461d-8067-a9c9cd848ba0 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:16.959306 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6f276-f3fc-461d-8067-a9c9cd848ba0 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:17.024861 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97b1cd-22d4-4ac2-bc25-370d635660c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:17.025947 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97b1cd-22d4-4ac2-bc25-370d635660c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:17.026289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97b1cd-22d4-4ac2-bc25-370d635660c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:17.026631 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97b1cd-22d4-4ac2-bc25-370d635660c0 admin admin] PATH_INFO: `/v3/users/7cc86b5f6f004ad2896cb10e904c36de` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:17.028009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97b1cd-22d4-4ac2-bc25-370d635660c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cc86b5f6f004ad2896cb10e904c36de)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:17.031027 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97b1cd-22d4-4ac2-bc25-370d635660c0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:17.084019 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9a97b1cd-22d4-4ac2-bc25-370d635660c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cc86b5f6f004ad2896cb10e904c36de'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:17.096512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9a97b1cd-22d4-4ac2-bc25-370d635660c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cc86b5f6f004ad2896cb10e904c36de'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:17.097391 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9a97b1cd-22d4-4ac2-bc25-370d635660c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cc86b5f6f004ad2896cb10e904c36de'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:17.098022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9a97b1cd-22d4-4ac2-bc25-370d635660c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cc86b5f6f004ad2896cb10e904c36de'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:17.110334 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9a97b1cd-22d4-4ac2-bc25-370d635660c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cc86b5f6f004ad2896cb10e904c36de'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:17.130674 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1013/2005] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:56:16 2022] DELETE /identity/v3/users/7cc86b5f6f004ad2896cb10e904c36de => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:56:17.709377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af876e1e-ebb9-4371-8ab6-893c34b2ed2f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:17.711539 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-af876e1e-ebb9-4371-8ab6-893c34b2ed2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:17.726196 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af876e1e-ebb9-4371-8ab6-893c34b2ed2f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:17.792317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bcdf1-b22c-403e-a821-dfd4bf432899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:17.793995 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bcdf1-b22c-403e-a821-dfd4bf432899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:17.794311 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bcdf1-b22c-403e-a821-dfd4bf432899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:17.794607 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bcdf1-b22c-403e-a821-dfd4bf432899 admin admin] PATH_INFO: `/v3/projects/ddf1d66de94a45b1843e2834876f7022` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:17.797297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43bcdf1-b22c-403e-a821-dfd4bf432899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddf1d66de94a45b1843e2834876f7022)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:17.800075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43bcdf1-b22c-403e-a821-dfd4bf432899 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:17.859711 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d43bcdf1-b22c-403e-a821-dfd4bf432899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddf1d66de94a45b1843e2834876f7022', 'request_id': 'req-d43bcdf1-b22c-403e-a821-dfd4bf432899'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:17.867043 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d43bcdf1-b22c-403e-a821-dfd4bf432899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddf1d66de94a45b1843e2834876f7022', 'request_id': 'req-d43bcdf1-b22c-403e-a821-dfd4bf432899'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:17.875769 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d43bcdf1-b22c-403e-a821-dfd4bf432899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddf1d66de94a45b1843e2834876f7022', 'request_id': 'req-d43bcdf1-b22c-403e-a821-dfd4bf432899'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:17.887242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d43bcdf1-b22c-403e-a821-dfd4bf432899 admin admin] The token cache is being invalidate because project ddf1d66de94a45b1843e2834876f7022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:56:17.887678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d43bcdf1-b22c-403e-a821-dfd4bf432899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:17.888374 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d43bcdf1-b22c-403e-a821-dfd4bf432899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:56:17.890133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 993/2006] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:56:17 2022] DELETE /identity/v3/projects/ddf1d66de94a45b1843e2834876f7022 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:56:17.900951 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f470ba-88bb-4b59-8a98-7152cb13d358 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:17.900951 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f470ba-88bb-4b59-8a98-7152cb13d358 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:17.900951 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f470ba-88bb-4b59-8a98-7152cb13d358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:17.912926 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-62f470ba-88bb-4b59-8a98-7152cb13d358 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:17.914125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-62f470ba-88bb-4b59-8a98-7152cb13d358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:17.975895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1014/2007] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:56:17.983856 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559851bb-6c36-4e5f-aecd-5cbd7cde1da5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:17.984155 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559851bb-6c36-4e5f-aecd-5cbd7cde1da5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:17.984432 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559851bb-6c36-4e5f-aecd-5cbd7cde1da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:18.004605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-559851bb-6c36-4e5f-aecd-5cbd7cde1da5 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:18.007678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-559851bb-6c36-4e5f-aecd-5cbd7cde1da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:18.017866 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 994/2008] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:56:18.022035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f470ba-88bb-4b59-8a98-7152cb13d358 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:18.053962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f470ba-88bb-4b59-8a98-7152cb13d358 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:18.061327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c256d-78ff-413c-80ef-c7c23bd517d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:18.062186 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c256d-78ff-413c-80ef-c7c23bd517d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:18.062754 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c256d-78ff-413c-80ef-c7c23bd517d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:18.063370 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c256d-78ff-413c-80ef-c7c23bd517d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:18.064595 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c256d-78ff-413c-80ef-c7c23bd517d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:56:18.065523 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c256d-78ff-413c-80ef-c7c23bd517d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:18.067560 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c256d-78ff-413c-80ef-c7c23bd517d2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:18.085198 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1015/2009] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:56:18.090043 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559851bb-6c36-4e5f-aecd-5cbd7cde1da5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:18.109871 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559851bb-6c36-4e5f-aecd-5cbd7cde1da5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:18.115475 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e176ad-114c-42fe-8679-4cb69efe1adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:18.116155 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e176ad-114c-42fe-8679-4cb69efe1adc admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:18.116443 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e176ad-114c-42fe-8679-4cb69efe1adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:18.116718 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e176ad-114c-42fe-8679-4cb69efe1adc admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:18.117469 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e176ad-114c-42fe-8679-4cb69efe1adc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:18.119548 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e176ad-114c-42fe-8679-4cb69efe1adc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:18.155063 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 995/2010] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:56:18 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:56:18.157028 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c256d-78ff-413c-80ef-c7c23bd517d2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:18.168131 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c256d-78ff-413c-80ef-c7c23bd517d2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:18.231170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3c06f-261b-4600-960b-1954c3e2dc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:18.231897 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3c06f-261b-4600-960b-1954c3e2dc53 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:18.232181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3c06f-261b-4600-960b-1954c3e2dc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:18.232456 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3c06f-261b-4600-960b-1954c3e2dc53 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:18.233159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3c06f-261b-4600-960b-1954c3e2dc53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:18.235115 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3c06f-261b-4600-960b-1954c3e2dc53 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:18.256059 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1016/2011] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:56:18 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:56:18.260280 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e176ad-114c-42fe-8679-4cb69efe1adc admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:18.280237 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e176ad-114c-42fe-8679-4cb69efe1adc admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:18.295722 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64209558-6d4b-4e02-ad93-287e078f5806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:18.297302 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64209558-6d4b-4e02-ad93-287e078f5806 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:18.297686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64209558-6d4b-4e02-ad93-287e078f5806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:18.297865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64209558-6d4b-4e02-ad93-287e078f5806 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:18.298632 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64209558-6d4b-4e02-ad93-287e078f5806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:18.300396 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64209558-6d4b-4e02-ad93-287e078f5806 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:18.326770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 996/2012] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:56:18.331080 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3c06f-261b-4600-960b-1954c3e2dc53 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:18.345388 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3c06f-261b-4600-960b-1954c3e2dc53 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:18.350319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cef982-386a-4d6b-849c-fc1b37fea712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:18.351180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cef982-386a-4d6b-849c-fc1b37fea712 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:18.351545 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cef982-386a-4d6b-849c-fc1b37fea712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:18.351911 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cef982-386a-4d6b-849c-fc1b37fea712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:18.352826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cef982-386a-4d6b-849c-fc1b37fea712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:18.354452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cef982-386a-4d6b-849c-fc1b37fea712 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:18.370434 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1017/2013] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:56:18.370581 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64209558-6d4b-4e02-ad93-287e078f5806 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:18.380399 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64209558-6d4b-4e02-ad93-287e078f5806 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:18.385496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87922c-fa16-4c6e-a745-0bc6cfc4e57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:18.386458 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87922c-fa16-4c6e-a745-0bc6cfc4e57a admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:18.386866 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87922c-fa16-4c6e-a745-0bc6cfc4e57a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:18.387281 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87922c-fa16-4c6e-a745-0bc6cfc4e57a admin admin] PATH_INFO: `/v3/projects/6f4ba990587d4984a4d867862eff2b2f/users/1e3e113cf3de4fb090387fd90f5a6e35/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:18.403183 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87922c-fa16-4c6e-a745-0bc6cfc4e57a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4ba990587d4984a4d867862eff2b2f, user_id=1e3e113cf3de4fb090387fd90f5a6e35, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:18.405968 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87922c-fa16-4c6e-a745-0bc6cfc4e57a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:18.424228 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 997/2014] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:56:18 2022] PUT /identity/v3/projects/6f4ba990587d4984a4d867862eff2b2f/users/1e3e113cf3de4fb090387fd90f5a6e35/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:56:18.434620 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e10c4-682e-4e7d-aa9e-3be8ac219087 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:18.434941 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e10c4-682e-4e7d-aa9e-3be8ac219087 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:18.435256 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e10c4-682e-4e7d-aa9e-3be8ac219087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:18.462503 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-372e10c4-682e-4e7d-aa9e-3be8ac219087 None None] MFA Rules not processed for user `1e3e113cf3de4fb090387fd90f5a6e35`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:18.463782 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-372e10c4-682e-4e7d-aa9e-3be8ac219087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:18.527539 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1018/2015] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:56:18.532106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87922c-fa16-4c6e-a745-0bc6cfc4e57a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:18.597355 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87922c-fa16-4c6e-a745-0bc6cfc4e57a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:18.602603 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e665b-ffb0-4356-8edc-daf42f5d1cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:18.603293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e665b-ffb0-4356-8edc-daf42f5d1cba admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:18.603573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e665b-ffb0-4356-8edc-daf42f5d1cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:18.603849 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e665b-ffb0-4356-8edc-daf42f5d1cba admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:18.604522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e665b-ffb0-4356-8edc-daf42f5d1cba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:18.606467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e665b-ffb0-4356-8edc-daf42f5d1cba admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:18.635608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 998/2016] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:56:18 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:56:18.637671 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e10c4-682e-4e7d-aa9e-3be8ac219087 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:18.649922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e10c4-682e-4e7d-aa9e-3be8ac219087 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:18.717613 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f12f4e-d488-4217-8650-f60c1e9a3680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:18.718300 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f12f4e-d488-4217-8650-f60c1e9a3680 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:18.718580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f12f4e-d488-4217-8650-f60c1e9a3680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:18.718858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f12f4e-d488-4217-8650-f60c1e9a3680 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:18.719718 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f12f4e-d488-4217-8650-f60c1e9a3680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:18.722294 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f12f4e-d488-4217-8650-f60c1e9a3680 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:18.747995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1019/2017] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:56:18 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:56:18.751619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e665b-ffb0-4356-8edc-daf42f5d1cba admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:18.765628 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e665b-ffb0-4356-8edc-daf42f5d1cba admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:18.770655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c3eaf-adfd-48dd-a5ef-aaaa6ea4a7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:18.771761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c3eaf-adfd-48dd-a5ef-aaaa6ea4a7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:18.772043 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c3eaf-adfd-48dd-a5ef-aaaa6ea4a7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:18.772322 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c3eaf-adfd-48dd-a5ef-aaaa6ea4a7e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:18.773382 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c3eaf-adfd-48dd-a5ef-aaaa6ea4a7e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:18.775518 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c3eaf-adfd-48dd-a5ef-aaaa6ea4a7e8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:18.814932 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 999/2018] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:56:18.824332 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f12f4e-d488-4217-8650-f60c1e9a3680 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:18.844437 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f12f4e-d488-4217-8650-f60c1e9a3680 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:18.864676 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b862e-e4ea-4321-9704-2ce40efa47e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:18.865695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b862e-e4ea-4321-9704-2ce40efa47e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:18.866708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b862e-e4ea-4321-9704-2ce40efa47e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:18.871464 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b862e-e4ea-4321-9704-2ce40efa47e6 admin admin] PATH_INFO: `/v3/projects/ce1a5d28ab1b4107831f0a192ba0c90c/users/bd975c0984e74572b0fc5fbf697d201a/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:18.911739 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b862e-e4ea-4321-9704-2ce40efa47e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1a5d28ab1b4107831f0a192ba0c90c, user_id=bd975c0984e74572b0fc5fbf697d201a, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:18.914563 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b862e-e4ea-4321-9704-2ce40efa47e6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:18.929094 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1020/2019] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:56:18 2022] PUT /identity/v3/projects/ce1a5d28ab1b4107831f0a192ba0c90c/users/bd975c0984e74572b0fc5fbf697d201a/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:56:18.933573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c3eaf-adfd-48dd-a5ef-aaaa6ea4a7e8 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:18.953300 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c3eaf-adfd-48dd-a5ef-aaaa6ea4a7e8 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:19.035817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d592b7-6090-4ad6-81a7-6bced5e19fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:19.036600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d592b7-6090-4ad6-81a7-6bced5e19fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:19.037070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d592b7-6090-4ad6-81a7-6bced5e19fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:19.037417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d592b7-6090-4ad6-81a7-6bced5e19fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:19.038355 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d592b7-6090-4ad6-81a7-6bced5e19fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:19.040260 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d592b7-6090-4ad6-81a7-6bced5e19fd0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:19.056688 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1000/2020] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:56:19.059096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b862e-e4ea-4321-9704-2ce40efa47e6 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:19.070381 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b862e-e4ea-4321-9704-2ce40efa47e6 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:19.076416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64af6fe-97d2-41ea-93e5-24773d5b57d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:19.077316 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64af6fe-97d2-41ea-93e5-24773d5b57d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:19.077608 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64af6fe-97d2-41ea-93e5-24773d5b57d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:19.077919 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64af6fe-97d2-41ea-93e5-24773d5b57d5 admin admin] PATH_INFO: `/v3/projects/ce1a5d28ab1b4107831f0a192ba0c90c/users/bd975c0984e74572b0fc5fbf697d201a/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:19.080131 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64af6fe-97d2-41ea-93e5-24773d5b57d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1a5d28ab1b4107831f0a192ba0c90c, user_id=bd975c0984e74572b0fc5fbf697d201a, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:19.083367 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64af6fe-97d2-41ea-93e5-24773d5b57d5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:19.093865 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1021/2021] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:56:19 2022] PUT /identity/v3/projects/ce1a5d28ab1b4107831f0a192ba0c90c/users/bd975c0984e74572b0fc5fbf697d201a/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:56:19.104284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea0fc5-0e5c-4387-b988-6e8c19f452fd None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:19.104580 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea0fc5-0e5c-4387-b988-6e8c19f452fd None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:19.104858 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea0fc5-0e5c-4387-b988-6e8c19f452fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:19.131048 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-66ea0fc5-0e5c-4387-b988-6e8c19f452fd None None] MFA Rules not processed for user `bd975c0984e74572b0fc5fbf697d201a`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:56:19.132203 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-66ea0fc5-0e5c-4387-b988-6e8c19f452fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:19.201357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1001/2022] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:56:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:56:19.212134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64af6fe-97d2-41ea-93e5-24773d5b57d5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:19.214197 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b64af6fe-97d2-41ea-93e5-24773d5b57d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:19.273195 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64af6fe-97d2-41ea-93e5-24773d5b57d5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:19.277214 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbd881-bb6e-40e8-bc91-0ae8fc9ab37b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:19.277873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbd881-bb6e-40e8-bc91-0ae8fc9ab37b service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:19.278155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbd881-bb6e-40e8-bc91-0ae8fc9ab37b service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:19.278480 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbd881-bb6e-40e8-bc91-0ae8fc9ab37b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:19.350715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbd881-bb6e-40e8-bc91-0ae8fc9ab37b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:19.352216 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbd881-bb6e-40e8-bc91-0ae8fc9ab37b service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:19.362035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1022/2023] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:56:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:56:27.126644 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea0fc5-0e5c-4387-b988-6e8c19f452fd None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:56:27.128150 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-66ea0fc5-0e5c-4387-b988-6e8c19f452fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:56:27.140439 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea0fc5-0e5c-4387-b988-6e8c19f452fd None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:56:27.144884 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf7114-7843-4b64-9526-fadf873e16d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:56:27.145552 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf7114-7843-4b64-9526-fadf873e16d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:56:27.145862 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf7114-7843-4b64-9526-fadf873e16d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:56:27.146131 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf7114-7843-4b64-9526-fadf873e16d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:56:27.156034 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf7114-7843-4b64-9526-fadf873e16d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:56:27.157475 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf7114-7843-4b64-9526-fadf873e16d4 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:56:27.166969 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1002/2024] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:56:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:13.883049 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbd881-bb6e-40e8-bc91-0ae8fc9ab37b service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:14.005029 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbd881-bb6e-40e8-bc91-0ae8fc9ab37b service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:14.010761 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0a97f-e826-44ed-8679-eecdc036e3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:14.011709 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0a97f-e826-44ed-8679-eecdc036e3db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:14.012313 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0a97f-e826-44ed-8679-eecdc036e3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:14.012313 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0a97f-e826-44ed-8679-eecdc036e3db admin admin] PATH_INFO: `/v3/users/1e3e113cf3de4fb090387fd90f5a6e35` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:14.013503 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0a97f-e826-44ed-8679-eecdc036e3db admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e3e113cf3de4fb090387fd90f5a6e35)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:14.015817 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0a97f-e826-44ed-8679-eecdc036e3db admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:14.078087 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e3e0a97f-e826-44ed-8679-eecdc036e3db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e3e113cf3de4fb090387fd90f5a6e35'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:14.092098 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e3e0a97f-e826-44ed-8679-eecdc036e3db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e3e113cf3de4fb090387fd90f5a6e35'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:14.092831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e3e0a97f-e826-44ed-8679-eecdc036e3db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e3e113cf3de4fb090387fd90f5a6e35'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:14.093446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e3e0a97f-e826-44ed-8679-eecdc036e3db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e3e113cf3de4fb090387fd90f5a6e35'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:14.104822 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e3e0a97f-e826-44ed-8679-eecdc036e3db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e3e113cf3de4fb090387fd90f5a6e35'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:14.147036 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1023/2025] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:13 2022] DELETE /identity/v3/users/1e3e113cf3de4fb090387fd90f5a6e35 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:14.149680 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b08a41-bf82-41bb-8e62-d8eca4dff10f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:14.150229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b08a41-bf82-41bb-8e62-d8eca4dff10f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:14.150331 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b08a41-bf82-41bb-8e62-d8eca4dff10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:14.201726 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-40b08a41-bf82-41bb-8e62-d8eca4dff10f None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:14.203314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-40b08a41-bf82-41bb-8e62-d8eca4dff10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:14.261091 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1003/2026] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:14.271358 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0a97f-e826-44ed-8679-eecdc036e3db admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:14.272920 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e3e0a97f-e826-44ed-8679-eecdc036e3db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:14.369351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0a97f-e826-44ed-8679-eecdc036e3db admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:14.373435 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb110e-ccd2-4caf-8640-b99dc1a22d13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:14.374102 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb110e-ccd2-4caf-8640-b99dc1a22d13 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:14.374427 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb110e-ccd2-4caf-8640-b99dc1a22d13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:14.374645 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb110e-ccd2-4caf-8640-b99dc1a22d13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:14.384441 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb110e-ccd2-4caf-8640-b99dc1a22d13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:14.386687 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb110e-ccd2-4caf-8640-b99dc1a22d13 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:14.398994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1024/2027] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:14.691219 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b08a41-bf82-41bb-8e62-d8eca4dff10f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:14.692964 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-40b08a41-bf82-41bb-8e62-d8eca4dff10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:14.704747 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b08a41-bf82-41bb-8e62-d8eca4dff10f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:14.710437 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17774d2d-d463-4f04-9dbe-356977a67294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:14.712921 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17774d2d-d463-4f04-9dbe-356977a67294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:14.712921 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17774d2d-d463-4f04-9dbe-356977a67294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:14.712921 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17774d2d-d463-4f04-9dbe-356977a67294 admin admin] PATH_INFO: `/v3/projects/6f4ba990587d4984a4d867862eff2b2f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:14.714471 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17774d2d-d463-4f04-9dbe-356977a67294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f4ba990587d4984a4d867862eff2b2f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:14.716512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17774d2d-d463-4f04-9dbe-356977a67294 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:14.772723 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-17774d2d-d463-4f04-9dbe-356977a67294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f4ba990587d4984a4d867862eff2b2f', 'request_id': 'req-17774d2d-d463-4f04-9dbe-356977a67294'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:14.780917 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-17774d2d-d463-4f04-9dbe-356977a67294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f4ba990587d4984a4d867862eff2b2f', 'request_id': 'req-17774d2d-d463-4f04-9dbe-356977a67294'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:14.794781 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-17774d2d-d463-4f04-9dbe-356977a67294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f4ba990587d4984a4d867862eff2b2f', 'request_id': 'req-17774d2d-d463-4f04-9dbe-356977a67294'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:14.805931 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-17774d2d-d463-4f04-9dbe-356977a67294 admin admin] The token cache is being invalidate because project 6f4ba990587d4984a4d867862eff2b2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:14.806214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-17774d2d-d463-4f04-9dbe-356977a67294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:14.806858 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-17774d2d-d463-4f04-9dbe-356977a67294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:14.808532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1004/2028] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:14 2022] DELETE /identity/v3/projects/6f4ba990587d4984a4d867862eff2b2f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:14.812534 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb110e-ccd2-4caf-8640-b99dc1a22d13 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:14.822251 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb110e-ccd2-4caf-8640-b99dc1a22d13 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:14.877502 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ed33b-4676-4092-befb-48ee7e493513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:14.878426 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ed33b-4676-4092-befb-48ee7e493513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:14.878709 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ed33b-4676-4092-befb-48ee7e493513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:14.878991 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ed33b-4676-4092-befb-48ee7e493513 admin admin] PATH_INFO: `/v3/users/bd975c0984e74572b0fc5fbf697d201a` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:14.880239 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ed33b-4676-4092-befb-48ee7e493513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd975c0984e74572b0fc5fbf697d201a)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:14.882209 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ed33b-4676-4092-befb-48ee7e493513 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:14.942605 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-500ed33b-4676-4092-befb-48ee7e493513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd975c0984e74572b0fc5fbf697d201a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:14.944469 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-500ed33b-4676-4092-befb-48ee7e493513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd975c0984e74572b0fc5fbf697d201a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:14.945198 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-500ed33b-4676-4092-befb-48ee7e493513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd975c0984e74572b0fc5fbf697d201a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:14.945806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-500ed33b-4676-4092-befb-48ee7e493513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd975c0984e74572b0fc5fbf697d201a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:14.965401 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-500ed33b-4676-4092-befb-48ee7e493513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd975c0984e74572b0fc5fbf697d201a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:14.986836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1025/2029] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:14 2022] DELETE /identity/v3/users/bd975c0984e74572b0fc5fbf697d201a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:15.115644 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17774d2d-d463-4f04-9dbe-356977a67294 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:15.117185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-17774d2d-d463-4f04-9dbe-356977a67294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:15.130826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17774d2d-d463-4f04-9dbe-356977a67294 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:15.203835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f587d-c288-4d07-815e-99ab90c238f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:15.204845 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f587d-c288-4d07-815e-99ab90c238f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:15.205124 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f587d-c288-4d07-815e-99ab90c238f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:15.205535 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f587d-c288-4d07-815e-99ab90c238f9 admin admin] PATH_INFO: `/v3/users/00d5a93597244241b5b8e1bb7965f920` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:15.207588 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f587d-c288-4d07-815e-99ab90c238f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00d5a93597244241b5b8e1bb7965f920)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:15.209557 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f587d-c288-4d07-815e-99ab90c238f9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:15.273997 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1c6f587d-c288-4d07-815e-99ab90c238f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00d5a93597244241b5b8e1bb7965f920'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:15.305832 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1c6f587d-c288-4d07-815e-99ab90c238f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00d5a93597244241b5b8e1bb7965f920'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:15.306733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1c6f587d-c288-4d07-815e-99ab90c238f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00d5a93597244241b5b8e1bb7965f920'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:15.307474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1c6f587d-c288-4d07-815e-99ab90c238f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00d5a93597244241b5b8e1bb7965f920'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:15.317462 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ed33b-4676-4092-befb-48ee7e493513 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:15.319057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-500ed33b-4676-4092-befb-48ee7e493513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:15.324376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1c6f587d-c288-4d07-815e-99ab90c238f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00d5a93597244241b5b8e1bb7965f920'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:15.332902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ed33b-4676-4092-befb-48ee7e493513 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:15.349160 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1005/2030] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:15 2022] DELETE /identity/v3/users/00d5a93597244241b5b8e1bb7965f920 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:15.349446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e9eb0-ed03-468a-bac9-5013df25e63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:15.350547 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e9eb0-ed03-468a-bac9-5013df25e63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:15.350836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d80828-94ab-4f3a-aba8-215edfdfa0bc None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:15.350937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e9eb0-ed03-468a-bac9-5013df25e63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:15.351216 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d80828-94ab-4f3a-aba8-215edfdfa0bc None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:15.351500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d80828-94ab-4f3a-aba8-215edfdfa0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:15.351780 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e9eb0-ed03-468a-bac9-5013df25e63b admin admin] PATH_INFO: `/v3/projects/ce1a5d28ab1b4107831f0a192ba0c90c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:15.353007 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e9eb0-ed03-468a-bac9-5013df25e63b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1a5d28ab1b4107831f0a192ba0c90c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:15.360354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e9eb0-ed03-468a-bac9-5013df25e63b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:15.376398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-53d80828-94ab-4f3a-aba8-215edfdfa0bc None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:15.386076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-53d80828-94ab-4f3a-aba8-215edfdfa0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:15.423064 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-090e9eb0-ed03-468a-bac9-5013df25e63b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1a5d28ab1b4107831f0a192ba0c90c', 'request_id': 'req-090e9eb0-ed03-468a-bac9-5013df25e63b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:15.430220 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-090e9eb0-ed03-468a-bac9-5013df25e63b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1a5d28ab1b4107831f0a192ba0c90c', 'request_id': 'req-090e9eb0-ed03-468a-bac9-5013df25e63b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:15.445019 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-090e9eb0-ed03-468a-bac9-5013df25e63b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1a5d28ab1b4107831f0a192ba0c90c', 'request_id': 'req-090e9eb0-ed03-468a-bac9-5013df25e63b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:15.457338 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-090e9eb0-ed03-468a-bac9-5013df25e63b admin admin] The token cache is being invalidate because project ce1a5d28ab1b4107831f0a192ba0c90c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:15.457624 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-090e9eb0-ed03-468a-bac9-5013df25e63b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:15.458258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-090e9eb0-ed03-468a-bac9-5013df25e63b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:15.460107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1026/2031] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:15 2022] DELETE /identity/v3/projects/ce1a5d28ab1b4107831f0a192ba0c90c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:57:15.464819 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed34c5-f2eb-481c-889e-d73fbb653328 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:15.465194 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed34c5-f2eb-481c-889e-d73fbb653328 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:15.466084 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed34c5-f2eb-481c-889e-d73fbb653328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:15.483117 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1006/2032] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:15.492181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d80828-94ab-4f3a-aba8-215edfdfa0bc None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:15.496281 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-53d80828-94ab-4f3a-aba8-215edfdfa0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:15.519921 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-37ed34c5-f2eb-481c-889e-d73fbb653328 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:15.521376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-37ed34c5-f2eb-481c-889e-d73fbb653328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:15.564716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d80828-94ab-4f3a-aba8-215edfdfa0bc None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:15.591208 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1027/2033] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:15.597070 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe45d36-e348-4bfe-88da-7f4adb59bda6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:15.597350 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe45d36-e348-4bfe-88da-7f4adb59bda6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:15.597620 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe45d36-e348-4bfe-88da-7f4adb59bda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:15.622136 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-abe45d36-e348-4bfe-88da-7f4adb59bda6 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:15.624076 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-abe45d36-e348-4bfe-88da-7f4adb59bda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:15.631098 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae8527-d9a5-4d4c-a735-2652d39c6350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:15.631778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae8527-d9a5-4d4c-a735-2652d39c6350 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:15.632028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae8527-d9a5-4d4c-a735-2652d39c6350 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:15.632276 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae8527-d9a5-4d4c-a735-2652d39c6350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:15.635957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1028/2034] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:57:15.636861 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe45d36-e348-4bfe-88da-7f4adb59bda6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:15.647251 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe45d36-e348-4bfe-88da-7f4adb59bda6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:15.648538 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae8527-d9a5-4d4c-a735-2652d39c6350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:15.650035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae8527-d9a5-4d4c-a735-2652d39c6350 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:15.652234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1a76d-6ad4-4629-a333-cd9da16beb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:15.653030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1a76d-6ad4-4629-a333-cd9da16beb8f admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:15.653418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1a76d-6ad4-4629-a333-cd9da16beb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:15.653855 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1a76d-6ad4-4629-a333-cd9da16beb8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:15.654792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1a76d-6ad4-4629-a333-cd9da16beb8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:57:15.655337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1a76d-6ad4-4629-a333-cd9da16beb8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:15.657267 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1a76d-6ad4-4629-a333-cd9da16beb8f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:15.667136 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1007/2035] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:57:15.669754 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1029/2036] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:57:15.674067 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae8527-d9a5-4d4c-a735-2652d39c6350 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:15.689093 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae8527-d9a5-4d4c-a735-2652d39c6350 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:15.697562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f7152-c6e4-46f9-87dc-3f98cb0e8092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:15.698234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f7152-c6e4-46f9-87dc-3f98cb0e8092 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:15.698512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f7152-c6e4-46f9-87dc-3f98cb0e8092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:15.698846 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f7152-c6e4-46f9-87dc-3f98cb0e8092 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:15.699569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f7152-c6e4-46f9-87dc-3f98cb0e8092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:15.702070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f7152-c6e4-46f9-87dc-3f98cb0e8092 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:15.739895 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1008/2037] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:15 2022] POST /identity/v3/projects => generated 367 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:15.744189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1a76d-6ad4-4629-a333-cd9da16beb8f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:15.756362 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1a76d-6ad4-4629-a333-cd9da16beb8f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:15.818294 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654cb7a-77a5-4b94-9a92-94f5cdcbc0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:15.818998 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654cb7a-77a5-4b94-9a92-94f5cdcbc0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:15.819323 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654cb7a-77a5-4b94-9a92-94f5cdcbc0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:15.819599 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654cb7a-77a5-4b94-9a92-94f5cdcbc0e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:15.822807 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654cb7a-77a5-4b94-9a92-94f5cdcbc0e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:15.822807 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654cb7a-77a5-4b94-9a92-94f5cdcbc0e6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:15.849320 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1030/2038] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:15 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:15.856308 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f7152-c6e4-46f9-87dc-3f98cb0e8092 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:15.869428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f7152-c6e4-46f9-87dc-3f98cb0e8092 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:15.879603 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e55f2-b052-42ee-8e8f-5d57c019756f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:15.880229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e55f2-b052-42ee-8e8f-5d57c019756f admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:15.880509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e55f2-b052-42ee-8e8f-5d57c019756f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:15.880778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e55f2-b052-42ee-8e8f-5d57c019756f admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:15.881510 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e55f2-b052-42ee-8e8f-5d57c019756f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:15.884007 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e55f2-b052-42ee-8e8f-5d57c019756f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:15.896499 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1009/2039] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:15.901758 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654cb7a-77a5-4b94-9a92-94f5cdcbc0e6 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:15.912656 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654cb7a-77a5-4b94-9a92-94f5cdcbc0e6 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:15.917284 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb08fb-ecfe-434e-b0ad-35690383f1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:15.917956 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb08fb-ecfe-434e-b0ad-35690383f1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:15.918243 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb08fb-ecfe-434e-b0ad-35690383f1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:15.918522 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb08fb-ecfe-434e-b0ad-35690383f1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:15.919353 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb08fb-ecfe-434e-b0ad-35690383f1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:15.921238 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb08fb-ecfe-434e-b0ad-35690383f1e3 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:15.932121 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1031/2040] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:57:15.935565 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e55f2-b052-42ee-8e8f-5d57c019756f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:15.945341 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e55f2-b052-42ee-8e8f-5d57c019756f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:15.950669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531e676-cb30-4a91-bcd0-5cb733cc576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:15.951693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531e676-cb30-4a91-bcd0-5cb733cc576d admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:15.951974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531e676-cb30-4a91-bcd0-5cb733cc576d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:15.952261 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531e676-cb30-4a91-bcd0-5cb733cc576d admin admin] PATH_INFO: `/v3/projects/f8012afe35fd4e2b879724af936bdf80/users/56cec3f16a214aa7b611f7080ec0fa92/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:15.967857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531e676-cb30-4a91-bcd0-5cb733cc576d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8012afe35fd4e2b879724af936bdf80, user_id=56cec3f16a214aa7b611f7080ec0fa92, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:15.970534 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531e676-cb30-4a91-bcd0-5cb733cc576d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:15.973609 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb08fb-ecfe-434e-b0ad-35690383f1e3 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:15.975669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6efb08fb-ecfe-434e-b0ad-35690383f1e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:15.992507 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1010/2041] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:15 2022] PUT /identity/v3/projects/f8012afe35fd4e2b879724af936bdf80/users/56cec3f16a214aa7b611f7080ec0fa92/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:15.994128 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb08fb-ecfe-434e-b0ad-35690383f1e3 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:16.002740 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f10deb-b88c-4ea3-acdc-15400dbb4be0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:16.002842 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f10deb-b88c-4ea3-acdc-15400dbb4be0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:16.003155 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f10deb-b88c-4ea3-acdc-15400dbb4be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:16.030876 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-85f10deb-b88c-4ea3-acdc-15400dbb4be0 None None] MFA Rules not processed for user `56cec3f16a214aa7b611f7080ec0fa92`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:16.032170 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-85f10deb-b88c-4ea3-acdc-15400dbb4be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:16.050839 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320ed31-7b6a-4d81-b62e-70c9dd2ea567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:16.051779 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ed31-7b6a-4d81-b62e-70c9dd2ea567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:16.052085 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ed31-7b6a-4d81-b62e-70c9dd2ea567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:16.052359 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ed31-7b6a-4d81-b62e-70c9dd2ea567 admin admin] PATH_INFO: `/v3/projects/7d2634554f9346f5b7aab54082c4f83d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:16.053687 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320ed31-7b6a-4d81-b62e-70c9dd2ea567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2634554f9346f5b7aab54082c4f83d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:16.056314 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320ed31-7b6a-4d81-b62e-70c9dd2ea567 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:16.094769 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1011/2042] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:16.099218 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f10deb-b88c-4ea3-acdc-15400dbb4be0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:16.104865 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4320ed31-7b6a-4d81-b62e-70c9dd2ea567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2634554f9346f5b7aab54082c4f83d', 'request_id': 'req-4320ed31-7b6a-4d81-b62e-70c9dd2ea567'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:16.109198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f10deb-b88c-4ea3-acdc-15400dbb4be0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:16.112037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4320ed31-7b6a-4d81-b62e-70c9dd2ea567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2634554f9346f5b7aab54082c4f83d', 'request_id': 'req-4320ed31-7b6a-4d81-b62e-70c9dd2ea567'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:16.121423 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4320ed31-7b6a-4d81-b62e-70c9dd2ea567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2634554f9346f5b7aab54082c4f83d', 'request_id': 'req-4320ed31-7b6a-4d81-b62e-70c9dd2ea567'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:16.133207 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4320ed31-7b6a-4d81-b62e-70c9dd2ea567 admin admin] The token cache is being invalidate because project 7d2634554f9346f5b7aab54082c4f83d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:16.133457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4320ed31-7b6a-4d81-b62e-70c9dd2ea567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:16.134208 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4320ed31-7b6a-4d81-b62e-70c9dd2ea567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:16.139005 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1032/2043] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:15 2022] DELETE /identity/v3/projects/7d2634554f9346f5b7aab54082c4f83d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:57:16.141519 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472659d-eefa-41a3-ae03-7516882cb52b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:16.141811 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472659d-eefa-41a3-ae03-7516882cb52b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:16.142079 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472659d-eefa-41a3-ae03-7516882cb52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:16.162386 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f472659d-eefa-41a3-ae03-7516882cb52b None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:16.163620 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f472659d-eefa-41a3-ae03-7516882cb52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:16.179645 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc3e78-81c7-4b27-8fcb-a5f81ab76780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:16.180610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc3e78-81c7-4b27-8fcb-a5f81ab76780 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:16.181288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc3e78-81c7-4b27-8fcb-a5f81ab76780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:16.181718 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc3e78-81c7-4b27-8fcb-a5f81ab76780 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:16.182567 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc3e78-81c7-4b27-8fcb-a5f81ab76780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:16.184739 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc3e78-81c7-4b27-8fcb-a5f81ab76780 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:16.222611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1012/2044] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:16 2022] POST /identity/v3/projects => generated 367 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:57:16.224769 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc3e78-81c7-4b27-8fcb-a5f81ab76780 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:16.228408 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e7fc3e78-81c7-4b27-8fcb-a5f81ab76780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:16.238143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1033/2045] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:16.246924 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b92501-53d7-4cc4-99b5-c396bb97dce3 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:16.247375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b92501-53d7-4cc4-99b5-c396bb97dce3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:16.247659 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b92501-53d7-4cc4-99b5-c396bb97dce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:16.268198 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-88b92501-53d7-4cc4-99b5-c396bb97dce3 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:16.269400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-88b92501-53d7-4cc4-99b5-c396bb97dce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:16.318624 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc3e78-81c7-4b27-8fcb-a5f81ab76780 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:16.323222 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c9aaa-ab73-42e9-90b4-baa12a24d8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:16.323885 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c9aaa-ab73-42e9-90b4-baa12a24d8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:16.324168 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c9aaa-ab73-42e9-90b4-baa12a24d8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:16.324441 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c9aaa-ab73-42e9-90b4-baa12a24d8c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:16.325138 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c9aaa-ab73-42e9-90b4-baa12a24d8c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:16.327138 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c9aaa-ab73-42e9-90b4-baa12a24d8c8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:16.328458 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1034/2046] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:16.332669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b92501-53d7-4cc4-99b5-c396bb97dce3 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:16.341689 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b92501-53d7-4cc4-99b5-c396bb97dce3 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:16.346865 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48b413-da9c-4709-89e2-e83a95c21e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:16.347569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48b413-da9c-4709-89e2-e83a95c21e48 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:16.347854 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48b413-da9c-4709-89e2-e83a95c21e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:16.348125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48b413-da9c-4709-89e2-e83a95c21e48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:16.348849 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48b413-da9c-4709-89e2-e83a95c21e48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:57:16.349156 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48b413-da9c-4709-89e2-e83a95c21e48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:16.353014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1013/2047] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:16 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:16.353161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48b413-da9c-4709-89e2-e83a95c21e48 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:16.354048 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c9aaa-ab73-42e9-90b4-baa12a24d8c8 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:16.363014 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1035/2048] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:57:16.364109 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c9aaa-ab73-42e9-90b4-baa12a24d8c8 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:16.367251 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48b413-da9c-4709-89e2-e83a95c21e48 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:16.368922 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e908f-9c5b-48a6-a104-8842d329724e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:16.369582 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e908f-9c5b-48a6-a104-8842d329724e admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:16.369862 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e908f-9c5b-48a6-a104-8842d329724e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:16.370134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e908f-9c5b-48a6-a104-8842d329724e admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:16.370854 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e908f-9c5b-48a6-a104-8842d329724e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:16.372547 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e908f-9c5b-48a6-a104-8842d329724e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:16.377035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48b413-da9c-4709-89e2-e83a95c21e48 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:16.381596 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a0c9f-3021-4644-88ef-72d0a8fea639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:16.382234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a0c9f-3021-4644-88ef-72d0a8fea639 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:16.382406 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1014/2049] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:57:16.383086 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a0c9f-3021-4644-88ef-72d0a8fea639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:16.383452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a0c9f-3021-4644-88ef-72d0a8fea639 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:16.384096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a0c9f-3021-4644-88ef-72d0a8fea639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:16.385954 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a0c9f-3021-4644-88ef-72d0a8fea639 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:16.386393 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e908f-9c5b-48a6-a104-8842d329724e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:16.396075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e908f-9c5b-48a6-a104-8842d329724e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:16.401037 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696f126-819a-471d-809a-95e9531fbf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:16.401974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696f126-819a-471d-809a-95e9531fbf72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:16.402237 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696f126-819a-471d-809a-95e9531fbf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:16.402760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696f126-819a-471d-809a-95e9531fbf72 admin admin] PATH_INFO: `/v3/projects/844bce9b5fcf4822a1509b0844bff888/users/48c0d504c5bb4d73bf3986d256743e63/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:16.415775 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1036/2050] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:16 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:16.421186 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696f126-819a-471d-809a-95e9531fbf72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=844bce9b5fcf4822a1509b0844bff888, user_id=48c0d504c5bb4d73bf3986d256743e63, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:16.423609 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a0c9f-3021-4644-88ef-72d0a8fea639 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:16.423827 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696f126-819a-471d-809a-95e9531fbf72 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:16.444614 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1015/2051] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:16 2022] PUT /identity/v3/projects/844bce9b5fcf4822a1509b0844bff888/users/48c0d504c5bb4d73bf3986d256743e63/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:16.448434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696f126-819a-471d-809a-95e9531fbf72 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:16.502814 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a0c9f-3021-4644-88ef-72d0a8fea639 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:16.513722 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696f126-819a-471d-809a-95e9531fbf72 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:16.519008 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635da1c7-3732-4018-8ac0-419ce53146c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:16.519766 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635da1c7-3732-4018-8ac0-419ce53146c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:16.520413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635da1c7-3732-4018-8ac0-419ce53146c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:16.520413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635da1c7-3732-4018-8ac0-419ce53146c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:16.521386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635da1c7-3732-4018-8ac0-419ce53146c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:16.523124 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635da1c7-3732-4018-8ac0-419ce53146c2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:16.538817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1016/2052] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:16.543157 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635da1c7-3732-4018-8ac0-419ce53146c2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:16.554231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635da1c7-3732-4018-8ac0-419ce53146c2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:16.559025 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52415730-adf2-4366-9ede-fa6317b00a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:16.559941 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52415730-adf2-4366-9ede-fa6317b00a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:16.560219 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52415730-adf2-4366-9ede-fa6317b00a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:16.560490 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52415730-adf2-4366-9ede-fa6317b00a98 admin admin] PATH_INFO: `/v3/projects/844bce9b5fcf4822a1509b0844bff888/users/48c0d504c5bb4d73bf3986d256743e63/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:16.562781 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52415730-adf2-4366-9ede-fa6317b00a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=844bce9b5fcf4822a1509b0844bff888, user_id=48c0d504c5bb4d73bf3986d256743e63, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:16.565457 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52415730-adf2-4366-9ede-fa6317b00a98 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:16.567132 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0df9d-e72a-4a3d-8fef-08c97bfcf842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:16.567821 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0df9d-e72a-4a3d-8fef-08c97bfcf842 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:16.568103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0df9d-e72a-4a3d-8fef-08c97bfcf842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:16.568559 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0df9d-e72a-4a3d-8fef-08c97bfcf842 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:16.569089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0df9d-e72a-4a3d-8fef-08c97bfcf842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:16.571036 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0df9d-e72a-4a3d-8fef-08c97bfcf842 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:16.575585 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1017/2053] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:16 2022] PUT /identity/v3/projects/844bce9b5fcf4822a1509b0844bff888/users/48c0d504c5bb4d73bf3986d256743e63/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:16.586565 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdeab7-f9f0-48a0-8811-ae29b396b1b2 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:16.586885 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdeab7-f9f0-48a0-8811-ae29b396b1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:16.587256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdeab7-f9f0-48a0-8811-ae29b396b1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:16.596727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1037/2054] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:16 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:16.603379 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0df9d-e72a-4a3d-8fef-08c97bfcf842 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:16.614168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0df9d-e72a-4a3d-8fef-08c97bfcf842 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:16.619766 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-dacdeab7-f9f0-48a0-8811-ae29b396b1b2 None None] MFA Rules not processed for user `48c0d504c5bb4d73bf3986d256743e63`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:16.621022 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-dacdeab7-f9f0-48a0-8811-ae29b396b1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:16.671339 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272004b4-b9d8-4ef0-a4e7-2793f5f40253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:16.672149 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272004b4-b9d8-4ef0-a4e7-2793f5f40253 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:16.672626 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272004b4-b9d8-4ef0-a4e7-2793f5f40253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:16.672737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272004b4-b9d8-4ef0-a4e7-2793f5f40253 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:16.673493 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272004b4-b9d8-4ef0-a4e7-2793f5f40253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:16.675134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272004b4-b9d8-4ef0-a4e7-2793f5f40253 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:16.687007 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1038/2055] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:16.689529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272004b4-b9d8-4ef0-a4e7-2793f5f40253 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:16.690872 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1018/2056] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:16 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:57:16.699867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272004b4-b9d8-4ef0-a4e7-2793f5f40253 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:16.701882 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdeab7-f9f0-48a0-8811-ae29b396b1b2 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:16.703273 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-dacdeab7-f9f0-48a0-8811-ae29b396b1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:16.704777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edc34f-063f-4c91-a377-24d597ace5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:16.705445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edc34f-063f-4c91-a377-24d597ace5db admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:16.705709 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edc34f-063f-4c91-a377-24d597ace5db admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:16.705986 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edc34f-063f-4c91-a377-24d597ace5db admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:16.706714 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edc34f-063f-4c91-a377-24d597ace5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:16.708587 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edc34f-063f-4c91-a377-24d597ace5db admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:16.722025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1039/2057] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:57:16.722994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edc34f-063f-4c91-a377-24d597ace5db admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:16.732847 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edc34f-063f-4c91-a377-24d597ace5db admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:16.737895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3296f4-6889-4e1a-a645-2d97d78fb68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:16.738487 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3296f4-6889-4e1a-a645-2d97d78fb68f admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:16.738769 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3296f4-6889-4e1a-a645-2d97d78fb68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:16.739087 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3296f4-6889-4e1a-a645-2d97d78fb68f admin admin] PATH_INFO: `/v3/projects/6c7a5d1787d6408c97db0d70f9389e61/users/09f44e4806674f85897c45647f8e7172/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:16.765288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3296f4-6889-4e1a-a645-2d97d78fb68f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7a5d1787d6408c97db0d70f9389e61, user_id=09f44e4806674f85897c45647f8e7172, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:16.768141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3296f4-6889-4e1a-a645-2d97d78fb68f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:16.780637 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdeab7-f9f0-48a0-8811-ae29b396b1b2 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:16.784680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1040/2058] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:16 2022] PUT /identity/v3/projects/6c7a5d1787d6408c97db0d70f9389e61/users/09f44e4806674f85897c45647f8e7172/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:57:16.795647 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036f4c1-1e9b-44b1-9618-ed6a7440a222 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:16.796103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036f4c1-1e9b-44b1-9618-ed6a7440a222 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:16.796453 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036f4c1-1e9b-44b1-9618-ed6a7440a222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:16.824223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b036f4c1-1e9b-44b1-9618-ed6a7440a222 None None] MFA Rules not processed for user `09f44e4806674f85897c45647f8e7172`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:16.825496 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b036f4c1-1e9b-44b1-9618-ed6a7440a222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:16.829867 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734db5a-9108-4515-8f46-7fbb61175d2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:16.830528 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734db5a-9108-4515-8f46-7fbb61175d2b service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:16.831575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734db5a-9108-4515-8f46-7fbb61175d2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:16.831838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734db5a-9108-4515-8f46-7fbb61175d2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:16.893120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734db5a-9108-4515-8f46-7fbb61175d2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:16.897223 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1041/2059] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:57:16.901567 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036f4c1-1e9b-44b1-9618-ed6a7440a222 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:16.905402 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734db5a-9108-4515-8f46-7fbb61175d2b service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:16.925504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1019/2060] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:16 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:57:16.980084 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036f4c1-1e9b-44b1-9618-ed6a7440a222 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:16.984737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ab51f-9f47-4924-bdb2-d7c808a46055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:16.985404 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ab51f-9f47-4924-bdb2-d7c808a46055 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:16.985735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ab51f-9f47-4924-bdb2-d7c808a46055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:16.986017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ab51f-9f47-4924-bdb2-d7c808a46055 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:16.987122 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734db5a-9108-4515-8f46-7fbb61175d2b service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:16.987751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ab51f-9f47-4924-bdb2-d7c808a46055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:16.988653 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1734db5a-9108-4515-8f46-7fbb61175d2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:16.989716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ab51f-9f47-4924-bdb2-d7c808a46055 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:16.999765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734db5a-9108-4515-8f46-7fbb61175d2b service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:17.003723 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e99b93-c047-4685-9920-c70dc45d53f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:17.004383 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e99b93-c047-4685-9920-c70dc45d53f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:17.004665 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e99b93-c047-4685-9920-c70dc45d53f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:17.004940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e99b93-c047-4685-9920-c70dc45d53f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:17.007098 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c7e99b93-c047-4685-9920-c70dc45d53f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:17.022009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1042/2061] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:16 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:17.025940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ab51f-9f47-4924-bdb2-d7c808a46055 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:17.079863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e99b93-c047-4685-9920-c70dc45d53f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:17.081446 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e99b93-c047-4685-9920-c70dc45d53f2 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:17.095096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1020/2062] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:16 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:57:17.095219 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ab51f-9f47-4924-bdb2-d7c808a46055 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:17.096545 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7721c-186f-4b45-a95b-587aa2d9ac57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:17.097287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7721c-186f-4b45-a95b-587aa2d9ac57 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:17.097568 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7721c-186f-4b45-a95b-587aa2d9ac57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:17.097838 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7721c-186f-4b45-a95b-587aa2d9ac57 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:17.098521 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7721c-186f-4b45-a95b-587aa2d9ac57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:17.100581 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7721c-186f-4b45-a95b-587aa2d9ac57 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:17.120598 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1043/2063] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:17 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:17.124937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e99b93-c047-4685-9920-c70dc45d53f2 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:17.136329 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e99b93-c047-4685-9920-c70dc45d53f2 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:17.140946 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c93e66-8acd-40af-9e4a-4130f11e7ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:17.141625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c93e66-8acd-40af-9e4a-4130f11e7ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:17.141897 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c93e66-8acd-40af-9e4a-4130f11e7ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:17.142293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c93e66-8acd-40af-9e4a-4130f11e7ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:17.143059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c93e66-8acd-40af-9e4a-4130f11e7ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:17.144679 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c93e66-8acd-40af-9e4a-4130f11e7ed3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:17.154914 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1021/2064] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:57:17.159153 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7721c-186f-4b45-a95b-587aa2d9ac57 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:17.169149 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7721c-186f-4b45-a95b-587aa2d9ac57 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:17.173907 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf99d34-acaa-4397-be26-775aaba93a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:17.174570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf99d34-acaa-4397-be26-775aaba93a46 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:17.174853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf99d34-acaa-4397-be26-775aaba93a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:17.175171 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf99d34-acaa-4397-be26-775aaba93a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:17.175954 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf99d34-acaa-4397-be26-775aaba93a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:17.177861 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf99d34-acaa-4397-be26-775aaba93a46 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:17.190870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1044/2065] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:17.192185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c93e66-8acd-40af-9e4a-4130f11e7ed3 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:17.201926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c93e66-8acd-40af-9e4a-4130f11e7ed3 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:17.207286 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4f05e-251e-4c12-8856-3566f03dcdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:17.208152 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4f05e-251e-4c12-8856-3566f03dcdfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:17.208427 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4f05e-251e-4c12-8856-3566f03dcdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:17.208692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4f05e-251e-4c12-8856-3566f03dcdfc admin admin] PATH_INFO: `/v3/projects/aa8d56284df64f76b93cbd7d134c52b0/users/5ba5ab80950c41fcacc0482497272f65/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:17.224699 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4f05e-251e-4c12-8856-3566f03dcdfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa8d56284df64f76b93cbd7d134c52b0, user_id=5ba5ab80950c41fcacc0482497272f65, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:17.227456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4f05e-251e-4c12-8856-3566f03dcdfc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:17.242136 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1022/2066] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:17 2022] PUT /identity/v3/projects/aa8d56284df64f76b93cbd7d134c52b0/users/5ba5ab80950c41fcacc0482497272f65/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:17.252839 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ee470-7d63-4f25-87fa-745e015b7f34 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:17.253282 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ee470-7d63-4f25-87fa-745e015b7f34 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:17.253544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ee470-7d63-4f25-87fa-745e015b7f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:17.281040 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-107ee470-7d63-4f25-87fa-745e015b7f34 None None] MFA Rules not processed for user `5ba5ab80950c41fcacc0482497272f65`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:17.282448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-107ee470-7d63-4f25-87fa-745e015b7f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:17.377389 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1045/2067] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:17.378768 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4f05e-251e-4c12-8856-3566f03dcdfc admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:17.463759 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4f05e-251e-4c12-8856-3566f03dcdfc admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:17.468602 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf951e0-e44c-4ea7-b2d9-d9d829cc364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:17.469386 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf951e0-e44c-4ea7-b2d9-d9d829cc364d admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:17.469747 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf951e0-e44c-4ea7-b2d9-d9d829cc364d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:17.470082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf951e0-e44c-4ea7-b2d9-d9d829cc364d admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:17.470851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf951e0-e44c-4ea7-b2d9-d9d829cc364d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:17.472914 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf951e0-e44c-4ea7-b2d9-d9d829cc364d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:17.498339 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1023/2068] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:17 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:17.502486 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ee470-7d63-4f25-87fa-745e015b7f34 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:17.513701 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ee470-7d63-4f25-87fa-745e015b7f34 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:17.569405 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59caf773-5c4e-443c-b667-b828049a96e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:17.570099 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caf773-5c4e-443c-b667-b828049a96e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:17.570381 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caf773-5c4e-443c-b667-b828049a96e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:17.570652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caf773-5c4e-443c-b667-b828049a96e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:17.571388 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59caf773-5c4e-443c-b667-b828049a96e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:17.573325 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59caf773-5c4e-443c-b667-b828049a96e8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:17.598323 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1046/2069] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:17 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:17.599181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf951e0-e44c-4ea7-b2d9-d9d829cc364d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:17.612388 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf951e0-e44c-4ea7-b2d9-d9d829cc364d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:17.615234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86a5ef-4c38-42e2-bd6e-4eba8de6887a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:17.616127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86a5ef-4c38-42e2-bd6e-4eba8de6887a admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:17.616468 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86a5ef-4c38-42e2-bd6e-4eba8de6887a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:17.616781 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86a5ef-4c38-42e2-bd6e-4eba8de6887a admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:17.617623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb86a5ef-4c38-42e2-bd6e-4eba8de6887a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:17.619424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb86a5ef-4c38-42e2-bd6e-4eba8de6887a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:17.630720 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1024/2070] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:17.634938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59caf773-5c4e-443c-b667-b828049a96e8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:17.645073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59caf773-5c4e-443c-b667-b828049a96e8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:17.649702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469973a-f553-454b-86a1-da7309362a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:17.650573 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469973a-f553-454b-86a1-da7309362a26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:17.650946 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469973a-f553-454b-86a1-da7309362a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:17.651242 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469973a-f553-454b-86a1-da7309362a26 admin admin] PATH_INFO: `/v3/projects/f7f85bd02d384b3a8566d44c155f0549/users/4f9d09826d7e4f8bb941cc912fd4b086/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:17.667669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469973a-f553-454b-86a1-da7309362a26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f85bd02d384b3a8566d44c155f0549, user_id=4f9d09826d7e4f8bb941cc912fd4b086, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:17.670447 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469973a-f553-454b-86a1-da7309362a26 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:17.684690 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1047/2071] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:17 2022] PUT /identity/v3/projects/f7f85bd02d384b3a8566d44c155f0549/users/4f9d09826d7e4f8bb941cc912fd4b086/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:17.688651 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86a5ef-4c38-42e2-bd6e-4eba8de6887a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:17.698650 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86a5ef-4c38-42e2-bd6e-4eba8de6887a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:17.753319 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a8683-a50e-42ba-a647-6a33a28c0bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:17.753979 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a8683-a50e-42ba-a647-6a33a28c0bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:17.754257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a8683-a50e-42ba-a647-6a33a28c0bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:17.754507 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a8683-a50e-42ba-a647-6a33a28c0bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:17.755281 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a8683-a50e-42ba-a647-6a33a28c0bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:17.756904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a8683-a50e-42ba-a647-6a33a28c0bf8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:17.766418 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1025/2072] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:57:17.770567 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469973a-f553-454b-86a1-da7309362a26 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:17.780868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469973a-f553-454b-86a1-da7309362a26 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:17.785680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e7f0b-5c98-4eb4-bf6b-e93fe92393ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:17.786559 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e7f0b-5c98-4eb4-bf6b-e93fe92393ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:17.786844 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e7f0b-5c98-4eb4-bf6b-e93fe92393ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:17.787102 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e7f0b-5c98-4eb4-bf6b-e93fe92393ab admin admin] PATH_INFO: `/v3/projects/f7f85bd02d384b3a8566d44c155f0549/users/4f9d09826d7e4f8bb941cc912fd4b086/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:17.789128 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e7f0b-5c98-4eb4-bf6b-e93fe92393ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f85bd02d384b3a8566d44c155f0549, user_id=4f9d09826d7e4f8bb941cc912fd4b086, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:17.791797 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e7f0b-5c98-4eb4-bf6b-e93fe92393ab admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:17.802262 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1048/2073] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:17 2022] PUT /identity/v3/projects/f7f85bd02d384b3a8566d44c155f0549/users/4f9d09826d7e4f8bb941cc912fd4b086/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:17.813158 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbad478-2fc3-4d87-845b-239d1b14e295 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:17.813427 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbad478-2fc3-4d87-845b-239d1b14e295 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:17.813700 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbad478-2fc3-4d87-845b-239d1b14e295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:17.840411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fcbad478-2fc3-4d87-845b-239d1b14e295 None None] MFA Rules not processed for user `4f9d09826d7e4f8bb941cc912fd4b086`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:17.841690 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fcbad478-2fc3-4d87-845b-239d1b14e295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:17.933824 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1026/2074] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:17.945453 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e7f0b-5c98-4eb4-bf6b-e93fe92393ab admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:18.000508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e7f0b-5c98-4eb4-bf6b-e93fe92393ab admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:18.007373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d182461-e6d6-418d-ab5b-81bc84a78e13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:18.008371 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d182461-e6d6-418d-ab5b-81bc84a78e13 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:18.008699 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d182461-e6d6-418d-ab5b-81bc84a78e13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:18.009064 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d182461-e6d6-418d-ab5b-81bc84a78e13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:18.067882 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d182461-e6d6-418d-ab5b-81bc84a78e13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:18.069325 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d182461-e6d6-418d-ab5b-81bc84a78e13 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:18.078551 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1049/2075] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:19.582992 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbad478-2fc3-4d87-845b-239d1b14e295 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:19.592266 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbad478-2fc3-4d87-845b-239d1b14e295 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:19.596118 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da763f11-9650-46cd-86eb-4562116ce653 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:19.596813 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da763f11-9650-46cd-86eb-4562116ce653 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:19.597096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da763f11-9650-46cd-86eb-4562116ce653 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:19.597485 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da763f11-9650-46cd-86eb-4562116ce653 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:19.655245 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da763f11-9650-46cd-86eb-4562116ce653 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:19.656683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da763f11-9650-46cd-86eb-4562116ce653 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:19.671044 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1027/2076] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:20.551980 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d182461-e6d6-418d-ab5b-81bc84a78e13 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:20.563851 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d182461-e6d6-418d-ab5b-81bc84a78e13 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:20.570039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09075f9-8870-4c76-a629-f3fd55569087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:20.570778 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09075f9-8870-4c76-a629-f3fd55569087 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:20.571015 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09075f9-8870-4c76-a629-f3fd55569087 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:20.571534 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09075f9-8870-4c76-a629-f3fd55569087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:20.588032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09075f9-8870-4c76-a629-f3fd55569087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:20.590101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09075f9-8870-4c76-a629-f3fd55569087 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:20.605531 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1050/2077] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:20.770805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da763f11-9650-46cd-86eb-4562116ce653 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:20.832147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da763f11-9650-46cd-86eb-4562116ce653 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:20.836749 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67857340-5180-4476-b855-d4d74d6aa934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:20.837694 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67857340-5180-4476-b855-d4d74d6aa934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:20.838066 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67857340-5180-4476-b855-d4d74d6aa934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:20.838417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67857340-5180-4476-b855-d4d74d6aa934 admin admin] PATH_INFO: `/v3/users/56cec3f16a214aa7b611f7080ec0fa92` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:20.839807 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67857340-5180-4476-b855-d4d74d6aa934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56cec3f16a214aa7b611f7080ec0fa92)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:20.841904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67857340-5180-4476-b855-d4d74d6aa934 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:20.891309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-67857340-5180-4476-b855-d4d74d6aa934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56cec3f16a214aa7b611f7080ec0fa92'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:20.902775 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-67857340-5180-4476-b855-d4d74d6aa934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56cec3f16a214aa7b611f7080ec0fa92'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:20.903551 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-67857340-5180-4476-b855-d4d74d6aa934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56cec3f16a214aa7b611f7080ec0fa92'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:20.904154 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-67857340-5180-4476-b855-d4d74d6aa934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56cec3f16a214aa7b611f7080ec0fa92'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:20.913475 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-67857340-5180-4476-b855-d4d74d6aa934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56cec3f16a214aa7b611f7080ec0fa92'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:20.929340 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1028/2078] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:20 2022] DELETE /identity/v3/users/56cec3f16a214aa7b611f7080ec0fa92 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:20.933915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2a0ac-c860-447a-b097-6ed1daacd72a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:20.934988 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2a0ac-c860-447a-b097-6ed1daacd72a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:20.935295 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2a0ac-c860-447a-b097-6ed1daacd72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:20.952648 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d3f2a0ac-c860-447a-b097-6ed1daacd72a None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:20.953862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d3f2a0ac-c860-447a-b097-6ed1daacd72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:21.004661 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67857340-5180-4476-b855-d4d74d6aa934 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:21.007659 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-67857340-5180-4476-b855-d4d74d6aa934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:21.020120 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1051/2079] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:21.029839 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2a0ac-c860-447a-b097-6ed1daacd72a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:21.031266 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d3f2a0ac-c860-447a-b097-6ed1daacd72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:21.074792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67857340-5180-4476-b855-d4d74d6aa934 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:21.079487 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd8e3f-6fb0-4068-a0f4-7a757707ef07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:21.080367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd8e3f-6fb0-4068-a0f4-7a757707ef07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:21.080642 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd8e3f-6fb0-4068-a0f4-7a757707ef07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:21.080913 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd8e3f-6fb0-4068-a0f4-7a757707ef07 admin admin] PATH_INFO: `/v3/users/35d6f4af057e4fa4868e0d418765be37` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:21.082117 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd8e3f-6fb0-4068-a0f4-7a757707ef07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35d6f4af057e4fa4868e0d418765be37)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:21.084146 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd8e3f-6fb0-4068-a0f4-7a757707ef07 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:21.086004 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2a0ac-c860-447a-b097-6ed1daacd72a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:21.089590 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e287e2e-ccf6-4c81-ab20-3ff77d8d1792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:21.090235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e287e2e-ccf6-4c81-ab20-3ff77d8d1792 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:21.090517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e287e2e-ccf6-4c81-ab20-3ff77d8d1792 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:21.090793 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e287e2e-ccf6-4c81-ab20-3ff77d8d1792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:21.099748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e287e2e-ccf6-4c81-ab20-3ff77d8d1792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:21.101179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e287e2e-ccf6-4c81-ab20-3ff77d8d1792 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:21.110573 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1052/2080] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:57:21.137289 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dfcd8e3f-6fb0-4068-a0f4-7a757707ef07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35d6f4af057e4fa4868e0d418765be37'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:21.149588 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dfcd8e3f-6fb0-4068-a0f4-7a757707ef07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35d6f4af057e4fa4868e0d418765be37'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:21.150435 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dfcd8e3f-6fb0-4068-a0f4-7a757707ef07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35d6f4af057e4fa4868e0d418765be37'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:21.151168 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dfcd8e3f-6fb0-4068-a0f4-7a757707ef07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35d6f4af057e4fa4868e0d418765be37'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:21.160306 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dfcd8e3f-6fb0-4068-a0f4-7a757707ef07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35d6f4af057e4fa4868e0d418765be37'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:21.173359 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1029/2081] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:21 2022] DELETE /identity/v3/users/35d6f4af057e4fa4868e0d418765be37 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:57:21.375273 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e287e2e-ccf6-4c81-ab20-3ff77d8d1792 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:21.391834 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e287e2e-ccf6-4c81-ab20-3ff77d8d1792 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:21.396504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd8e3f-6fb0-4068-a0f4-7a757707ef07 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:21.398246 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-dfcd8e3f-6fb0-4068-a0f4-7a757707ef07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:21.452970 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdda6bd-3750-42d0-a6c7-a5c25b24d4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:21.453848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdda6bd-3750-42d0-a6c7-a5c25b24d4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:21.454137 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdda6bd-3750-42d0-a6c7-a5c25b24d4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:21.454417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdda6bd-3750-42d0-a6c7-a5c25b24d4dd admin admin] PATH_INFO: `/v3/projects/27c3689015e24bb4ba9dd0ca0561f08b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:21.455607 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdda6bd-3750-42d0-a6c7-a5c25b24d4dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=27c3689015e24bb4ba9dd0ca0561f08b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:21.457868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdda6bd-3750-42d0-a6c7-a5c25b24d4dd admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:21.466651 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd8e3f-6fb0-4068-a0f4-7a757707ef07 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:21.471573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be5311-bb51-45ad-914c-c53374132e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:21.472507 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be5311-bb51-45ad-914c-c53374132e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:21.472788 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be5311-bb51-45ad-914c-c53374132e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:21.473062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be5311-bb51-45ad-914c-c53374132e7e admin admin] PATH_INFO: `/v3/projects/f8012afe35fd4e2b879724af936bdf80` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:21.474251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be5311-bb51-45ad-914c-c53374132e7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8012afe35fd4e2b879724af936bdf80)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:21.476182 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be5311-bb51-45ad-914c-c53374132e7e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:21.505067 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8cdda6bd-3750-42d0-a6c7-a5c25b24d4dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27c3689015e24bb4ba9dd0ca0561f08b', 'request_id': 'req-8cdda6bd-3750-42d0-a6c7-a5c25b24d4dd'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:21.511578 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8cdda6bd-3750-42d0-a6c7-a5c25b24d4dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27c3689015e24bb4ba9dd0ca0561f08b', 'request_id': 'req-8cdda6bd-3750-42d0-a6c7-a5c25b24d4dd'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:21.522443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8cdda6bd-3750-42d0-a6c7-a5c25b24d4dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27c3689015e24bb4ba9dd0ca0561f08b', 'request_id': 'req-8cdda6bd-3750-42d0-a6c7-a5c25b24d4dd'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:21.522690 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-64be5311-bb51-45ad-914c-c53374132e7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8012afe35fd4e2b879724af936bdf80', 'request_id': 'req-64be5311-bb51-45ad-914c-c53374132e7e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:21.530089 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-64be5311-bb51-45ad-914c-c53374132e7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8012afe35fd4e2b879724af936bdf80', 'request_id': 'req-64be5311-bb51-45ad-914c-c53374132e7e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:21.534645 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8cdda6bd-3750-42d0-a6c7-a5c25b24d4dd admin admin] The token cache is being invalidate because project 27c3689015e24bb4ba9dd0ca0561f08b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:21.534951 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8cdda6bd-3750-42d0-a6c7-a5c25b24d4dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:21.535631 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8cdda6bd-3750-42d0-a6c7-a5c25b24d4dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:21.537198 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1053/2082] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:21 2022] DELETE /identity/v3/projects/27c3689015e24bb4ba9dd0ca0561f08b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:21.540741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-64be5311-bb51-45ad-914c-c53374132e7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8012afe35fd4e2b879724af936bdf80', 'request_id': 'req-64be5311-bb51-45ad-914c-c53374132e7e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:21.542276 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23987824-389c-4d61-856c-bb57ddce8bc4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:21.542568 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23987824-389c-4d61-856c-bb57ddce8bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:21.542839 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23987824-389c-4d61-856c-bb57ddce8bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:21.550468 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-64be5311-bb51-45ad-914c-c53374132e7e admin admin] The token cache is being invalidate because project f8012afe35fd4e2b879724af936bdf80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:21.550859 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-64be5311-bb51-45ad-914c-c53374132e7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:21.551606 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-64be5311-bb51-45ad-914c-c53374132e7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:21.554311 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1030/2083] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:21 2022] DELETE /identity/v3/projects/f8012afe35fd4e2b879724af936bdf80 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:57:21.558160 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be5311-bb51-45ad-914c-c53374132e7e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:21.559867 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-64be5311-bb51-45ad-914c-c53374132e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:21.573509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-23987824-389c-4d61-856c-bb57ddce8bc4 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:21.574697 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-23987824-389c-4d61-856c-bb57ddce8bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:21.622268 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be5311-bb51-45ad-914c-c53374132e7e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:21.626949 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea1759-7229-4a4a-a8d8-749825e870a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:21.627869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea1759-7229-4a4a-a8d8-749825e870a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:21.628149 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea1759-7229-4a4a-a8d8-749825e870a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:21.628424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea1759-7229-4a4a-a8d8-749825e870a8 admin admin] PATH_INFO: `/v3/users/48c0d504c5bb4d73bf3986d256743e63` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:21.629624 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea1759-7229-4a4a-a8d8-749825e870a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48c0d504c5bb4d73bf3986d256743e63)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:21.631611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea1759-7229-4a4a-a8d8-749825e870a8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:21.634119 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1054/2084] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:21.642274 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2dbaa-5287-478d-a65f-b14ba160b13f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:21.642653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2dbaa-5287-478d-a65f-b14ba160b13f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:21.642936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2dbaa-5287-478d-a65f-b14ba160b13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:21.660827 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-86e2dbaa-5287-478d-a65f-b14ba160b13f None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:21.662049 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-86e2dbaa-5287-478d-a65f-b14ba160b13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:21.670812 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1055/2085] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:57:21.674855 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2dbaa-5287-478d-a65f-b14ba160b13f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:21.682070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9eea1759-7229-4a4a-a8d8-749825e870a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48c0d504c5bb4d73bf3986d256743e63'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:21.684118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2dbaa-5287-478d-a65f-b14ba160b13f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:21.689858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9985d-f023-452c-a1aa-876c111cf1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:21.690663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9985d-f023-452c-a1aa-876c111cf1ab admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:21.691081 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9985d-f023-452c-a1aa-876c111cf1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:21.691452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9985d-f023-452c-a1aa-876c111cf1ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:21.692194 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9985d-f023-452c-a1aa-876c111cf1ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:57:21.692526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9985d-f023-452c-a1aa-876c111cf1ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:21.694172 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9985d-f023-452c-a1aa-876c111cf1ab admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:21.694518 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9eea1759-7229-4a4a-a8d8-749825e870a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48c0d504c5bb4d73bf3986d256743e63'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:21.695390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9eea1759-7229-4a4a-a8d8-749825e870a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48c0d504c5bb4d73bf3986d256743e63'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:21.696038 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9eea1759-7229-4a4a-a8d8-749825e870a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48c0d504c5bb4d73bf3986d256743e63'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:21.706140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9eea1759-7229-4a4a-a8d8-749825e870a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48c0d504c5bb4d73bf3986d256743e63'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:21.710319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1056/2086] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:57:21.715680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9985d-f023-452c-a1aa-876c111cf1ab admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:21.717890 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-58d9985d-f023-452c-a1aa-876c111cf1ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:21.722232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1031/2087] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:21 2022] DELETE /identity/v3/users/48c0d504c5bb4d73bf3986d256743e63 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:57:21.738584 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68e5d7-dc1d-42e5-ae7c-8e8e895ccf3b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:21.738878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68e5d7-dc1d-42e5-ae7c-8e8e895ccf3b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:21.739181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68e5d7-dc1d-42e5-ae7c-8e8e895ccf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:21.741763 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9985d-f023-452c-a1aa-876c111cf1ab admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:21.761218 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2d68e5d7-dc1d-42e5-ae7c-8e8e895ccf3b None None] MFA Rules not processed for user `1c163ef83b1a4ceea41f9e5b83cc222d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:21.762649 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2d68e5d7-dc1d-42e5-ae7c-8e8e895ccf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:21.818324 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a06d9b-5eca-4ff6-8abd-4d22af226563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:21.820491 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a06d9b-5eca-4ff6-8abd-4d22af226563 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:21.821455 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a06d9b-5eca-4ff6-8abd-4d22af226563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:21.825725 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1032/2088] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:21.826163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a06d9b-5eca-4ff6-8abd-4d22af226563 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:21.826163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a06d9b-5eca-4ff6-8abd-4d22af226563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:21.826163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a06d9b-5eca-4ff6-8abd-4d22af226563 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:21.886101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1057/2089] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:21 2022] POST /identity/v3/projects => generated 365 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:57:21.889701 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68e5d7-dc1d-42e5-ae7c-8e8e895ccf3b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:21.901321 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68e5d7-dc1d-42e5-ae7c-8e8e895ccf3b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:21.966212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c5c43-23f9-433b-83e3-4d21ce7e75f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:21.966923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c5c43-23f9-433b-83e3-4d21ce7e75f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:21.967240 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c5c43-23f9-433b-83e3-4d21ce7e75f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:21.967517 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c5c43-23f9-433b-83e3-4d21ce7e75f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:21.968239 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c5c43-23f9-433b-83e3-4d21ce7e75f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:21.970192 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c5c43-23f9-433b-83e3-4d21ce7e75f1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:21.990541 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1033/2090] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:21 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:21.994774 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a06d9b-5eca-4ff6-8abd-4d22af226563 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:22.005309 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a06d9b-5eca-4ff6-8abd-4d22af226563 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:22.010138 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4d7bc-d29f-4e63-b18c-7a17888912a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:22.010812 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d7bc-d29f-4e63-b18c-7a17888912a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:22.011130 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d7bc-d29f-4e63-b18c-7a17888912a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:22.011413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d7bc-d29f-4e63-b18c-7a17888912a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:22.012201 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4d7bc-d29f-4e63-b18c-7a17888912a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:22.013868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4d7bc-d29f-4e63-b18c-7a17888912a3 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:22.023885 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1058/2091] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:22.028542 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c5c43-23f9-433b-83e3-4d21ce7e75f1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:22.038543 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c5c43-23f9-433b-83e3-4d21ce7e75f1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:22.044287 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614e0b1-613e-4923-8493-25e5c8108986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:22.044962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614e0b1-613e-4923-8493-25e5c8108986 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:22.045241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614e0b1-613e-4923-8493-25e5c8108986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:22.045498 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614e0b1-613e-4923-8493-25e5c8108986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:22.046224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614e0b1-613e-4923-8493-25e5c8108986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:22.047879 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614e0b1-613e-4923-8493-25e5c8108986 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:22.058575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1034/2092] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:22.062900 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4d7bc-d29f-4e63-b18c-7a17888912a3 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:22.073412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4d7bc-d29f-4e63-b18c-7a17888912a3 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:22.078827 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde38a48-8796-4232-b7a5-72e9dac82555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:22.079773 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde38a48-8796-4232-b7a5-72e9dac82555 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:22.080057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde38a48-8796-4232-b7a5-72e9dac82555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:22.080329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde38a48-8796-4232-b7a5-72e9dac82555 admin admin] PATH_INFO: `/v3/projects/04b2d9f0e828402b83db7b2155660649/users/fad5719000be4d199120d3fbf7915a3c/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:22.099193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde38a48-8796-4232-b7a5-72e9dac82555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b2d9f0e828402b83db7b2155660649, user_id=fad5719000be4d199120d3fbf7915a3c, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:22.102354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde38a48-8796-4232-b7a5-72e9dac82555 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:22.118977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614e0b1-613e-4923-8493-25e5c8108986 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:22.119752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1059/2093] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:22 2022] PUT /identity/v3/projects/04b2d9f0e828402b83db7b2155660649/users/fad5719000be4d199120d3fbf7915a3c/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:57:22.133884 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1614e0b1-613e-4923-8493-25e5c8108986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:22.135428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4fb6d-7ba5-40e3-bc9e-aa6bb9a664fe None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:22.135959 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4fb6d-7ba5-40e3-bc9e-aa6bb9a664fe None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:22.136443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4fb6d-7ba5-40e3-bc9e-aa6bb9a664fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:22.168189 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614e0b1-613e-4923-8493-25e5c8108986 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:22.197378 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-37f4fb6d-7ba5-40e3-bc9e-aa6bb9a664fe None None] MFA Rules not processed for user `fad5719000be4d199120d3fbf7915a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:22.199435 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-37f4fb6d-7ba5-40e3-bc9e-aa6bb9a664fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:22.256753 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881eb26-22db-4f31-8d58-63ed7db82614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:22.257826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881eb26-22db-4f31-8d58-63ed7db82614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:22.258112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881eb26-22db-4f31-8d58-63ed7db82614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:22.258448 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881eb26-22db-4f31-8d58-63ed7db82614 admin admin] PATH_INFO: `/v3/projects/844bce9b5fcf4822a1509b0844bff888` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:22.259800 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881eb26-22db-4f31-8d58-63ed7db82614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=844bce9b5fcf4822a1509b0844bff888)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:22.261728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881eb26-22db-4f31-8d58-63ed7db82614 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:22.274695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1060/2094] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:22.279851 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8d40c-fcb1-4a15-b0c3-34e6ba802b7c None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:22.280207 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8d40c-fcb1-4a15-b0c3-34e6ba802b7c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:22.280550 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8d40c-fcb1-4a15-b0c3-34e6ba802b7c None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:22.282133 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1061/2095] 10.222.0.77 () {54 vars in 912 bytes} [Wed May 11 06:57:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:57:22.288262 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e32bbc-c386-4ca2-a690-bfa0b8070773 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:22.288566 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e32bbc-c386-4ca2-a690-bfa0b8070773 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:22.289088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e32bbc-c386-4ca2-a690-bfa0b8070773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:22.314466 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2881eb26-22db-4f31-8d58-63ed7db82614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '844bce9b5fcf4822a1509b0844bff888', 'request_id': 'req-2881eb26-22db-4f31-8d58-63ed7db82614'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:22.318174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-08e32bbc-c386-4ca2-a690-bfa0b8070773 None None] MFA Rules not processed for user `3c92f4b777a644ad8055f15b1a8bd0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:22.319607 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-08e32bbc-c386-4ca2-a690-bfa0b8070773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:22.320577 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2881eb26-22db-4f31-8d58-63ed7db82614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '844bce9b5fcf4822a1509b0844bff888', 'request_id': 'req-2881eb26-22db-4f31-8d58-63ed7db82614'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:22.329358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2881eb26-22db-4f31-8d58-63ed7db82614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '844bce9b5fcf4822a1509b0844bff888', 'request_id': 'req-2881eb26-22db-4f31-8d58-63ed7db82614'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:22.339314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2881eb26-22db-4f31-8d58-63ed7db82614 admin admin] The token cache is being invalidate because project 844bce9b5fcf4822a1509b0844bff888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:22.339804 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2881eb26-22db-4f31-8d58-63ed7db82614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:22.340443 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2881eb26-22db-4f31-8d58-63ed7db82614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:22.342331 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1035/2096] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:22 2022] DELETE /identity/v3/projects/844bce9b5fcf4822a1509b0844bff888 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:22.343135 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881eb26-22db-4f31-8d58-63ed7db82614 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:22.344432 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2881eb26-22db-4f31-8d58-63ed7db82614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:22.370582 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1062/2097] 10.222.0.77 () {58 vars in 1009 bytes} [Wed May 11 06:57:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:57:22.371887 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441237c-4033-4665-8bcc-3c508bbb4ca3 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:22.372224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441237c-4033-4665-8bcc-3c508bbb4ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:22.372503 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441237c-4033-4665-8bcc-3c508bbb4ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:22.393555 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f441237c-4033-4665-8bcc-3c508bbb4ca3 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:22.394800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f441237c-4033-4665-8bcc-3c508bbb4ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:22.408505 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881eb26-22db-4f31-8d58-63ed7db82614 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:22.412114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcedb13d-5c4b-484e-9c27-d5b2470fbccd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:22.412783 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedb13d-5c4b-484e-9c27-d5b2470fbccd service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:22.413058 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedb13d-5c4b-484e-9c27-d5b2470fbccd service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:22.413325 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedb13d-5c4b-484e-9c27-d5b2470fbccd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:22.415199 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bcedb13d-5c4b-484e-9c27-d5b2470fbccd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:22.455257 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1063/2098] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:22.456442 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441237c-4033-4665-8bcc-3c508bbb4ca3 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:22.457914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f441237c-4033-4665-8bcc-3c508bbb4ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:22.469925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441237c-4033-4665-8bcc-3c508bbb4ca3 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:22.473873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aee17e-a6f1-47b9-a34e-c40c6ee2b60d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:22.474522 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aee17e-a6f1-47b9-a34e-c40c6ee2b60d service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:22.474805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aee17e-a6f1-47b9-a34e-c40c6ee2b60d service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:22.475122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aee17e-a6f1-47b9-a34e-c40c6ee2b60d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:22.479212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcedb13d-5c4b-484e-9c27-d5b2470fbccd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:22.480661 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcedb13d-5c4b-484e-9c27-d5b2470fbccd service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:22.482232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aee17e-a6f1-47b9-a34e-c40c6ee2b60d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:22.483711 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aee17e-a6f1-47b9-a34e-c40c6ee2b60d service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:22.489895 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1036/2099] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:22 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:22.491382 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792fd04-9bba-4669-8bb4-84eb34ca5bdb None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:22.491773 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792fd04-9bba-4669-8bb4-84eb34ca5bdb None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:22.492069 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1064/2100] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:22.492248 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792fd04-9bba-4669-8bb4-84eb34ca5bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:22.510099 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e792fd04-9bba-4669-8bb4-84eb34ca5bdb None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:22.511533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e792fd04-9bba-4669-8bb4-84eb34ca5bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:22.519866 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1037/2101] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:22.524165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aee17e-a6f1-47b9-a34e-c40c6ee2b60d service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:22.537699 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aee17e-a6f1-47b9-a34e-c40c6ee2b60d service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:22.543351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6708b68-8bb5-4e2a-a722-1158ea96a9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:22.544176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6708b68-8bb5-4e2a-a722-1158ea96a9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:22.544535 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6708b68-8bb5-4e2a-a722-1158ea96a9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:22.544886 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6708b68-8bb5-4e2a-a722-1158ea96a9f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:22.545774 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6708b68-8bb5-4e2a-a722-1158ea96a9f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:57:22.546075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6708b68-8bb5-4e2a-a722-1158ea96a9f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:22.547826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6708b68-8bb5-4e2a-a722-1158ea96a9f3 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:22.560818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1065/2102] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:57:22.565027 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792fd04-9bba-4669-8bb4-84eb34ca5bdb None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:22.574872 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792fd04-9bba-4669-8bb4-84eb34ca5bdb None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:22.580525 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a5d53-9f77-4c5b-bce1-458704ed8aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:22.581918 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a5d53-9f77-4c5b-bce1-458704ed8aac admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:22.581918 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a5d53-9f77-4c5b-bce1-458704ed8aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:22.581918 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a5d53-9f77-4c5b-bce1-458704ed8aac admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:22.582542 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a5d53-9f77-4c5b-bce1-458704ed8aac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:22.585254 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a5d53-9f77-4c5b-bce1-458704ed8aac admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:22.618570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1038/2103] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:22 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:57:22.624149 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6708b68-8bb5-4e2a-a722-1158ea96a9f3 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:22.647494 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6708b68-8bb5-4e2a-a722-1158ea96a9f3 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:22.733994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a205a-abcc-48e4-b35a-a7bddeb5f3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:22.735397 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a205a-abcc-48e4-b35a-a7bddeb5f3e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:22.735787 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a205a-abcc-48e4-b35a-a7bddeb5f3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:22.736163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a205a-abcc-48e4-b35a-a7bddeb5f3e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:22.738258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a205a-abcc-48e4-b35a-a7bddeb5f3e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:22.741547 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a205a-abcc-48e4-b35a-a7bddeb5f3e0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:22.771758 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1066/2104] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:22 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:22.772902 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a5d53-9f77-4c5b-bce1-458704ed8aac admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:22.799202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a5d53-9f77-4c5b-bce1-458704ed8aac admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:22.810213 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169dcda-9030-4047-9b4a-fb34ee2fa641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:22.811160 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169dcda-9030-4047-9b4a-fb34ee2fa641 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:22.811448 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169dcda-9030-4047-9b4a-fb34ee2fa641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:22.811728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169dcda-9030-4047-9b4a-fb34ee2fa641 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:22.812483 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169dcda-9030-4047-9b4a-fb34ee2fa641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:22.814200 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169dcda-9030-4047-9b4a-fb34ee2fa641 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:22.830879 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1039/2105] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:22.833037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a205a-abcc-48e4-b35a-a7bddeb5f3e0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:22.848858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a205a-abcc-48e4-b35a-a7bddeb5f3e0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:22.859619 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bfb5a-d662-4285-b25d-8f6d91564398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:22.860321 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bfb5a-d662-4285-b25d-8f6d91564398 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:22.860630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bfb5a-d662-4285-b25d-8f6d91564398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:22.860962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bfb5a-d662-4285-b25d-8f6d91564398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:22.861824 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2bfb5a-d662-4285-b25d-8f6d91564398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:22.863656 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2bfb5a-d662-4285-b25d-8f6d91564398 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:22.891677 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1067/2106] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:22.895571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169dcda-9030-4047-9b4a-fb34ee2fa641 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:22.909574 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169dcda-9030-4047-9b4a-fb34ee2fa641 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:22.920123 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e60b04-31e2-4918-b1e7-2732a13b5dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:22.921130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e60b04-31e2-4918-b1e7-2732a13b5dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:22.921419 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e60b04-31e2-4918-b1e7-2732a13b5dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:22.921698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e60b04-31e2-4918-b1e7-2732a13b5dd6 admin admin] PATH_INFO: `/v3/projects/0e5eb2c2b3cb465faa0303a5173ac8c4/users/8620e3a8b80e428ab9d966302f1d9224/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:22.958922 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e60b04-31e2-4918-b1e7-2732a13b5dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5eb2c2b3cb465faa0303a5173ac8c4, user_id=8620e3a8b80e428ab9d966302f1d9224, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:22.968261 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e60b04-31e2-4918-b1e7-2732a13b5dd6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:23.019245 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1040/2107] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:22 2022] PUT /identity/v3/projects/0e5eb2c2b3cb465faa0303a5173ac8c4/users/8620e3a8b80e428ab9d966302f1d9224/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:57:23.019357 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700d427-9d55-404e-8fe2-4c5709e95a50 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:23.019704 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700d427-9d55-404e-8fe2-4c5709e95a50 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:23.019990 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700d427-9d55-404e-8fe2-4c5709e95a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:23.056592 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3700d427-9d55-404e-8fe2-4c5709e95a50 None None] MFA Rules not processed for user `8620e3a8b80e428ab9d966302f1d9224`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:23.058340 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3700d427-9d55-404e-8fe2-4c5709e95a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:23.155238 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1068/2108] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:57:23.160211 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e60b04-31e2-4918-b1e7-2732a13b5dd6 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:23.235948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e60b04-31e2-4918-b1e7-2732a13b5dd6 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:23.241874 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911425d-c4d7-481d-8e6d-32cf78d712a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:23.242696 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911425d-c4d7-481d-8e6d-32cf78d712a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:23.243320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911425d-c4d7-481d-8e6d-32cf78d712a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:23.243543 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911425d-c4d7-481d-8e6d-32cf78d712a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:23.244676 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911425d-c4d7-481d-8e6d-32cf78d712a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:23.247698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911425d-c4d7-481d-8e6d-32cf78d712a7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:23.283805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700d427-9d55-404e-8fe2-4c5709e95a50 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:23.293158 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1041/2109] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:23 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:23.301765 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700d427-9d55-404e-8fe2-4c5709e95a50 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:23.382365 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af6004-75f9-4f21-b095-88f309d27a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:23.383204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af6004-75f9-4f21-b095-88f309d27a03 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:23.383606 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af6004-75f9-4f21-b095-88f309d27a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:23.383978 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af6004-75f9-4f21-b095-88f309d27a03 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:23.384801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af6004-75f9-4f21-b095-88f309d27a03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:23.387117 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af6004-75f9-4f21-b095-88f309d27a03 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:23.417966 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1069/2110] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:23 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:23.419978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911425d-c4d7-481d-8e6d-32cf78d712a7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:23.432333 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911425d-c4d7-481d-8e6d-32cf78d712a7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:23.437226 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dbcdc-643d-4a14-846c-18226d489ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:23.438009 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dbcdc-643d-4a14-846c-18226d489ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:23.438393 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dbcdc-643d-4a14-846c-18226d489ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:23.438676 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dbcdc-643d-4a14-846c-18226d489ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:23.439462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dbcdc-643d-4a14-846c-18226d489ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:23.441346 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dbcdc-643d-4a14-846c-18226d489ae0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:23.453061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1042/2111] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:57:23.457546 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af6004-75f9-4f21-b095-88f309d27a03 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:23.469553 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af6004-75f9-4f21-b095-88f309d27a03 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:23.475746 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cf129-a621-4247-bed5-1a878302bbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:23.476388 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cf129-a621-4247-bed5-1a878302bbea admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:23.477052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cf129-a621-4247-bed5-1a878302bbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:23.477169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cf129-a621-4247-bed5-1a878302bbea admin admin] PATH_INFO: `/v3/projects/3f928749064746a48e6c8653c0468dda/users/16d9b0b42b524468a7989029639320ab/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:23.492879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cf129-a621-4247-bed5-1a878302bbea admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f928749064746a48e6c8653c0468dda, user_id=16d9b0b42b524468a7989029639320ab, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:23.495655 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cf129-a621-4247-bed5-1a878302bbea admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:23.509659 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1070/2112] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:23 2022] PUT /identity/v3/projects/3f928749064746a48e6c8653c0468dda/users/16d9b0b42b524468a7989029639320ab/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:23.513454 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dbcdc-643d-4a14-846c-18226d489ae0 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:23.524565 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dbcdc-643d-4a14-846c-18226d489ae0 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:23.589213 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ffe0b-5e3d-4363-a867-4450be1e6b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:23.590234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ffe0b-5e3d-4363-a867-4450be1e6b17 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:23.590523 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ffe0b-5e3d-4363-a867-4450be1e6b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:23.590806 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ffe0b-5e3d-4363-a867-4450be1e6b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:23.591672 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ffe0b-5e3d-4363-a867-4450be1e6b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:23.593312 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ffe0b-5e3d-4363-a867-4450be1e6b17 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:23.605049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1043/2113] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:23.609405 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cf129-a621-4247-bed5-1a878302bbea admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:23.620994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cf129-a621-4247-bed5-1a878302bbea admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:23.628528 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede4cd4-ceb1-48d0-8b24-a817e816bab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:23.629802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede4cd4-ceb1-48d0-8b24-a817e816bab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:23.630237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede4cd4-ceb1-48d0-8b24-a817e816bab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:23.630519 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede4cd4-ceb1-48d0-8b24-a817e816bab3 admin admin] PATH_INFO: `/v3/projects/3f928749064746a48e6c8653c0468dda/users/16d9b0b42b524468a7989029639320ab/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:23.632611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede4cd4-ceb1-48d0-8b24-a817e816bab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f928749064746a48e6c8653c0468dda, user_id=16d9b0b42b524468a7989029639320ab, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:23.635290 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede4cd4-ceb1-48d0-8b24-a817e816bab3 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:23.645700 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1071/2114] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:23 2022] PUT /identity/v3/projects/3f928749064746a48e6c8653c0468dda/users/16d9b0b42b524468a7989029639320ab/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:23.657063 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774179b-6964-4dfc-b0b9-53bc461d2e74 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:23.657398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774179b-6964-4dfc-b0b9-53bc461d2e74 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:23.657750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774179b-6964-4dfc-b0b9-53bc461d2e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:23.689311 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a774179b-6964-4dfc-b0b9-53bc461d2e74 None None] MFA Rules not processed for user `16d9b0b42b524468a7989029639320ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:23.690203 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a774179b-6964-4dfc-b0b9-53bc461d2e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:23.757316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1044/2115] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:23.770122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede4cd4-ceb1-48d0-8b24-a817e816bab3 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:23.834304 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede4cd4-ceb1-48d0-8b24-a817e816bab3 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:23.843237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dccf22-2ba8-4b70-b8b7-25eada9ea52c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:23.843897 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dccf22-2ba8-4b70-b8b7-25eada9ea52c service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:23.844180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dccf22-2ba8-4b70-b8b7-25eada9ea52c service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:23.844456 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dccf22-2ba8-4b70-b8b7-25eada9ea52c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:23.855171 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dccf22-2ba8-4b70-b8b7-25eada9ea52c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:23.856651 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dccf22-2ba8-4b70-b8b7-25eada9ea52c service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:23.867185 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1072/2116] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:24.205437 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774179b-6964-4dfc-b0b9-53bc461d2e74 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:24.215206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774179b-6964-4dfc-b0b9-53bc461d2e74 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:24.219922 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ddf65-d03e-4b9d-8b1f-d619b1bc1610 tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d9b0b42b524468a7989029639320ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f928749064746a48e6c8653c0468dda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:24.221205 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ddf65-d03e-4b9d-8b1f-d619b1bc1610 tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:24.221497 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ddf65-d03e-4b9d-8b1f-d619b1bc1610 tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:24.221775 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ddf65-d03e-4b9d-8b1f-d619b1bc1610 tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:24.222645 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ddf65-d03e-4b9d-8b1f-d619b1bc1610 tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:57:24.222986 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ddf65-d03e-4b9d-8b1f-d619b1bc1610 tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:24.224630 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ddf65-d03e-4b9d-8b1f-d619b1bc1610 tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:24.239771 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1045/2117] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:57:24.244296 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dccf22-2ba8-4b70-b8b7-25eada9ea52c service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:24.254463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dccf22-2ba8-4b70-b8b7-25eada9ea52c service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:24.259963 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569acda5-199e-4afc-a63d-868997a520bb tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d9b0b42b524468a7989029639320ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f928749064746a48e6c8653c0468dda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:24.260628 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569acda5-199e-4afc-a63d-868997a520bb tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:24.260908 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569acda5-199e-4afc-a63d-868997a520bb tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:24.261269 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569acda5-199e-4afc-a63d-868997a520bb tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:24.262038 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569acda5-199e-4afc-a63d-868997a520bb tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:24.264062 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569acda5-199e-4afc-a63d-868997a520bb tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:24.300960 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1073/2118] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:24 2022] POST /identity/v3/projects => generated 355 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:24.305491 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ddf65-d03e-4b9d-8b1f-d619b1bc1610 tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:24.315651 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ddf65-d03e-4b9d-8b1f-d619b1bc1610 tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:24.376868 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47256fc5-d811-4f25-a6fd-ff4d0bc7e91e tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d9b0b42b524468a7989029639320ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f928749064746a48e6c8653c0468dda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:24.377599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47256fc5-d811-4f25-a6fd-ff4d0bc7e91e tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:24.377902 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47256fc5-d811-4f25-a6fd-ff4d0bc7e91e tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:24.378154 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47256fc5-d811-4f25-a6fd-ff4d0bc7e91e tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:24.378888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47256fc5-d811-4f25-a6fd-ff4d0bc7e91e tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:57:24.379235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47256fc5-d811-4f25-a6fd-ff4d0bc7e91e tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:24.380884 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47256fc5-d811-4f25-a6fd-ff4d0bc7e91e tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:24.392739 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1046/2119] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:57:24.435908 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569acda5-199e-4afc-a63d-868997a520bb tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:24.448583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569acda5-199e-4afc-a63d-868997a520bb tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:24.453254 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5366b-00d2-44e3-97d9-b621ed9a770d tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d9b0b42b524468a7989029639320ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f928749064746a48e6c8653c0468dda', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:24.454123 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5366b-00d2-44e3-97d9-b621ed9a770d tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:24.454403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5366b-00d2-44e3-97d9-b621ed9a770d tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:24.454728 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5366b-00d2-44e3-97d9-b621ed9a770d tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] PATH_INFO: `/v3/projects/a6871fa4d5114251ba51345647ed6405` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:24.455954 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5366b-00d2-44e3-97d9-b621ed9a770d tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a6871fa4d5114251ba51345647ed6405)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:24.458346 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5366b-00d2-44e3-97d9-b621ed9a770d tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:24.515251 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-60f5366b-00d2-44e3-97d9-b621ed9a770d tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6871fa4d5114251ba51345647ed6405', 'request_id': 'req-60f5366b-00d2-44e3-97d9-b621ed9a770d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:24.521594 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-60f5366b-00d2-44e3-97d9-b621ed9a770d tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6871fa4d5114251ba51345647ed6405', 'request_id': 'req-60f5366b-00d2-44e3-97d9-b621ed9a770d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:24.530453 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-60f5366b-00d2-44e3-97d9-b621ed9a770d tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6871fa4d5114251ba51345647ed6405', 'request_id': 'req-60f5366b-00d2-44e3-97d9-b621ed9a770d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:24.541009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-60f5366b-00d2-44e3-97d9-b621ed9a770d tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] The token cache is being invalidate because project a6871fa4d5114251ba51345647ed6405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:24.541292 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-60f5366b-00d2-44e3-97d9-b621ed9a770d tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:24.543372 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-60f5366b-00d2-44e3-97d9-b621ed9a770d tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:24.545009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1074/2120] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:24 2022] DELETE /identity/v3/projects/a6871fa4d5114251ba51345647ed6405 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:24.734263 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47256fc5-d811-4f25-a6fd-ff4d0bc7e91e tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:24.736222 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-47256fc5-d811-4f25-a6fd-ff4d0bc7e91e tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:24.801589 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47256fc5-d811-4f25-a6fd-ff4d0bc7e91e tempest-VolumeQuotaClassesTest-1096048802 tempest-VolumeQuotaClassesTest-1096048802-project-admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:24.856847 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cdb49-6940-4497-a749-bef9bf40f66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:24.857736 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cdb49-6940-4497-a749-bef9bf40f66e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:24.858016 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cdb49-6940-4497-a749-bef9bf40f66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:24.858277 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cdb49-6940-4497-a749-bef9bf40f66e admin admin] PATH_INFO: `/v3/users/8620e3a8b80e428ab9d966302f1d9224` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:24.859538 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cdb49-6940-4497-a749-bef9bf40f66e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8620e3a8b80e428ab9d966302f1d9224)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:24.861476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cdb49-6940-4497-a749-bef9bf40f66e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:24.910517 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b81cdb49-6940-4497-a749-bef9bf40f66e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8620e3a8b80e428ab9d966302f1d9224'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:24.922263 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b81cdb49-6940-4497-a749-bef9bf40f66e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8620e3a8b80e428ab9d966302f1d9224'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:24.922861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b81cdb49-6940-4497-a749-bef9bf40f66e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8620e3a8b80e428ab9d966302f1d9224'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:24.923487 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b81cdb49-6940-4497-a749-bef9bf40f66e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8620e3a8b80e428ab9d966302f1d9224'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:24.931716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b81cdb49-6940-4497-a749-bef9bf40f66e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8620e3a8b80e428ab9d966302f1d9224'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:24.944377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1047/2121] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:24 2022] DELETE /identity/v3/users/8620e3a8b80e428ab9d966302f1d9224 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:24.949004 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f4c34-30c9-4360-b732-5362c6634dc7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:24.949480 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f4c34-30c9-4360-b732-5362c6634dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:24.949572 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f4c34-30c9-4360-b732-5362c6634dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:24.970347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f81f4c34-30c9-4360-b732-5362c6634dc7 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:24.971675 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f81f4c34-30c9-4360-b732-5362c6634dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:25.030415 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1075/2122] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:25.040461 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cdb49-6940-4497-a749-bef9bf40f66e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:25.042011 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b81cdb49-6940-4497-a749-bef9bf40f66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:25.100096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cdb49-6940-4497-a749-bef9bf40f66e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:25.104041 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66b0a7-432c-414a-94fe-607d635a02ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:25.104693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66b0a7-432c-414a-94fe-607d635a02ab service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:25.104969 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66b0a7-432c-414a-94fe-607d635a02ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:25.105264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66b0a7-432c-414a-94fe-607d635a02ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:25.114886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66b0a7-432c-414a-94fe-607d635a02ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:25.116360 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66b0a7-432c-414a-94fe-607d635a02ab service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:25.127774 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1048/2123] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:25.472118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f4c34-30c9-4360-b732-5362c6634dc7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:25.473780 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f81f4c34-30c9-4360-b732-5362c6634dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:25.489161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f4c34-30c9-4360-b732-5362c6634dc7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:25.504390 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fadaa-e40e-47fb-aeba-fd987b272ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:25.505633 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fadaa-e40e-47fb-aeba-fd987b272ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:25.506013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fadaa-e40e-47fb-aeba-fd987b272ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:25.506509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fadaa-e40e-47fb-aeba-fd987b272ffa admin admin] PATH_INFO: `/v3/projects/0e5eb2c2b3cb465faa0303a5173ac8c4` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:25.508728 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396fadaa-e40e-47fb-aeba-fd987b272ffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e5eb2c2b3cb465faa0303a5173ac8c4)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:25.511518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396fadaa-e40e-47fb-aeba-fd987b272ffa admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:25.565356 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-396fadaa-e40e-47fb-aeba-fd987b272ffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5eb2c2b3cb465faa0303a5173ac8c4', 'request_id': 'req-396fadaa-e40e-47fb-aeba-fd987b272ffa'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:25.574727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-396fadaa-e40e-47fb-aeba-fd987b272ffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5eb2c2b3cb465faa0303a5173ac8c4', 'request_id': 'req-396fadaa-e40e-47fb-aeba-fd987b272ffa'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:25.591363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-396fadaa-e40e-47fb-aeba-fd987b272ffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5eb2c2b3cb465faa0303a5173ac8c4', 'request_id': 'req-396fadaa-e40e-47fb-aeba-fd987b272ffa'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:25.612554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-396fadaa-e40e-47fb-aeba-fd987b272ffa admin admin] The token cache is being invalidate because project 0e5eb2c2b3cb465faa0303a5173ac8c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:25.612722 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-396fadaa-e40e-47fb-aeba-fd987b272ffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:25.613650 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-396fadaa-e40e-47fb-aeba-fd987b272ffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:25.615471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1076/2124] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:25 2022] DELETE /identity/v3/projects/0e5eb2c2b3cb465faa0303a5173ac8c4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:25.619692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66b0a7-432c-414a-94fe-607d635a02ab service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:25.631803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66b0a7-432c-414a-94fe-607d635a02ab service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:25.711803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359adc9-995a-46d3-b63c-59a629e2f7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:25.713024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359adc9-995a-46d3-b63c-59a629e2f7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:25.713397 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359adc9-995a-46d3-b63c-59a629e2f7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:25.713762 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359adc9-995a-46d3-b63c-59a629e2f7d7 admin admin] PATH_INFO: `/v3/users/16d9b0b42b524468a7989029639320ab` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:25.715124 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359adc9-995a-46d3-b63c-59a629e2f7d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16d9b0b42b524468a7989029639320ab)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:25.717188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359adc9-995a-46d3-b63c-59a629e2f7d7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:25.771000 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f359adc9-995a-46d3-b63c-59a629e2f7d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16d9b0b42b524468a7989029639320ab'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:25.783692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f359adc9-995a-46d3-b63c-59a629e2f7d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16d9b0b42b524468a7989029639320ab'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:25.784729 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f359adc9-995a-46d3-b63c-59a629e2f7d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16d9b0b42b524468a7989029639320ab'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:25.785514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f359adc9-995a-46d3-b63c-59a629e2f7d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16d9b0b42b524468a7989029639320ab'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:25.796046 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f359adc9-995a-46d3-b63c-59a629e2f7d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16d9b0b42b524468a7989029639320ab'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:25.810599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1049/2125] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:25 2022] DELETE /identity/v3/users/16d9b0b42b524468a7989029639320ab => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:57:26.248353 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fadaa-e40e-47fb-aeba-fd987b272ffa admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:26.250852 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-396fadaa-e40e-47fb-aeba-fd987b272ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:26.264529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fadaa-e40e-47fb-aeba-fd987b272ffa admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:26.326516 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34caf4a-d916-40d3-83a6-801d1ee530ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:26.327536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34caf4a-d916-40d3-83a6-801d1ee530ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:26.327914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34caf4a-d916-40d3-83a6-801d1ee530ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:26.328193 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34caf4a-d916-40d3-83a6-801d1ee530ee admin admin] PATH_INFO: `/v3/projects/3f928749064746a48e6c8653c0468dda` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:26.329646 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34caf4a-d916-40d3-83a6-801d1ee530ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f928749064746a48e6c8653c0468dda)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:26.332019 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34caf4a-d916-40d3-83a6-801d1ee530ee admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:26.380229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a34caf4a-d916-40d3-83a6-801d1ee530ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f928749064746a48e6c8653c0468dda', 'request_id': 'req-a34caf4a-d916-40d3-83a6-801d1ee530ee'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:26.386238 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a34caf4a-d916-40d3-83a6-801d1ee530ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f928749064746a48e6c8653c0468dda', 'request_id': 'req-a34caf4a-d916-40d3-83a6-801d1ee530ee'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:26.394898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a34caf4a-d916-40d3-83a6-801d1ee530ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f928749064746a48e6c8653c0468dda', 'request_id': 'req-a34caf4a-d916-40d3-83a6-801d1ee530ee'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:26.406182 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a34caf4a-d916-40d3-83a6-801d1ee530ee admin admin] The token cache is being invalidate because project 3f928749064746a48e6c8653c0468dda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:26.406586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a34caf4a-d916-40d3-83a6-801d1ee530ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:26.407350 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a34caf4a-d916-40d3-83a6-801d1ee530ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:26.409682 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1077/2126] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:26 2022] DELETE /identity/v3/projects/3f928749064746a48e6c8653c0468dda => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:26.414895 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a67500-60d2-4822-bc85-071fd91a2386 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:26.415214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a67500-60d2-4822-bc85-071fd91a2386 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:26.415491 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a67500-60d2-4822-bc85-071fd91a2386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:26.435985 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-45a67500-60d2-4822-bc85-071fd91a2386 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:26.437273 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-45a67500-60d2-4822-bc85-071fd91a2386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:26.508302 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1050/2127] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:57:26.517361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7f0b2-f575-42ca-943c-462cdafc1f22 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:26.517751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7f0b2-f575-42ca-943c-462cdafc1f22 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:26.518219 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7f0b2-f575-42ca-943c-462cdafc1f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:26.543239 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b7e7f0b2-f575-42ca-943c-462cdafc1f22 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:26.545381 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b7e7f0b2-f575-42ca-943c-462cdafc1f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:26.558780 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1078/2128] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:26.563556 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a67500-60d2-4822-bc85-071fd91a2386 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:26.574912 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a67500-60d2-4822-bc85-071fd91a2386 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:26.579747 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c57243-e865-4177-b343-527af83dc496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:26.580385 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c57243-e865-4177-b343-527af83dc496 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:26.580665 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c57243-e865-4177-b343-527af83dc496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:26.580973 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c57243-e865-4177-b343-527af83dc496 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:26.581807 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c57243-e865-4177-b343-527af83dc496 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:57:26.582072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c57243-e865-4177-b343-527af83dc496 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:26.583850 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c57243-e865-4177-b343-527af83dc496 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:26.603531 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7f0b2-f575-42ca-943c-462cdafc1f22 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:26.606059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1051/2129] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:57:26.613302 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7f0b2-f575-42ca-943c-462cdafc1f22 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:26.619659 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac19f7-c06c-4413-b97f-78344b7e4dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:26.620504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac19f7-c06c-4413-b97f-78344b7e4dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:26.620833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac19f7-c06c-4413-b97f-78344b7e4dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:26.621058 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac19f7-c06c-4413-b97f-78344b7e4dd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:26.621772 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac19f7-c06c-4413-b97f-78344b7e4dd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:26.624131 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac19f7-c06c-4413-b97f-78344b7e4dd7 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:26.659012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1079/2130] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:26 2022] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:57:26.661689 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c57243-e865-4177-b343-527af83dc496 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:26.672329 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c57243-e865-4177-b343-527af83dc496 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:26.731512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88407eb-e3f1-4edf-8259-1003ca0673c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:26.732214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88407eb-e3f1-4edf-8259-1003ca0673c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:26.732495 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88407eb-e3f1-4edf-8259-1003ca0673c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:26.732766 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88407eb-e3f1-4edf-8259-1003ca0673c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:26.733467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88407eb-e3f1-4edf-8259-1003ca0673c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:26.735455 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88407eb-e3f1-4edf-8259-1003ca0673c3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:26.759779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1052/2131] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:26 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:26.765259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac19f7-c06c-4413-b97f-78344b7e4dd7 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:26.782175 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac19f7-c06c-4413-b97f-78344b7e4dd7 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:26.789891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f224f3a-cc06-4b7f-b59a-1d25919ba9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:26.790630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f224f3a-cc06-4b7f-b59a-1d25919ba9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:26.790914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f224f3a-cc06-4b7f-b59a-1d25919ba9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:26.791401 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f224f3a-cc06-4b7f-b59a-1d25919ba9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:26.792151 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f224f3a-cc06-4b7f-b59a-1d25919ba9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:26.794033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f224f3a-cc06-4b7f-b59a-1d25919ba9d9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:26.806175 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1080/2132] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:26.810465 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88407eb-e3f1-4edf-8259-1003ca0673c3 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:26.822993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88407eb-e3f1-4edf-8259-1003ca0673c3 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:26.828171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57645a7-d9ac-4370-9c37-b02eb19f17c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:26.828945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57645a7-d9ac-4370-9c37-b02eb19f17c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:26.829287 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57645a7-d9ac-4370-9c37-b02eb19f17c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:26.829625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57645a7-d9ac-4370-9c37-b02eb19f17c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:26.830401 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57645a7-d9ac-4370-9c37-b02eb19f17c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:26.832157 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57645a7-d9ac-4370-9c37-b02eb19f17c0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:26.846902 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1053/2133] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:26.848135 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f224f3a-cc06-4b7f-b59a-1d25919ba9d9 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:26.859897 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f224f3a-cc06-4b7f-b59a-1d25919ba9d9 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:26.866346 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e774f7-6b2e-4f0b-9999-8c593d9e4cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:26.867294 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e774f7-6b2e-4f0b-9999-8c593d9e4cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:26.867573 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e774f7-6b2e-4f0b-9999-8c593d9e4cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:26.867845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e774f7-6b2e-4f0b-9999-8c593d9e4cd5 admin admin] PATH_INFO: `/v3/projects/5a6cb4c8df4148c5a9c7b0c15a45da5c/users/085eb5d3a7434e1c8810b995b804c59c/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:26.891968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e774f7-6b2e-4f0b-9999-8c593d9e4cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6cb4c8df4148c5a9c7b0c15a45da5c, user_id=085eb5d3a7434e1c8810b995b804c59c, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:26.894862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e774f7-6b2e-4f0b-9999-8c593d9e4cd5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:26.911413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1081/2134] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:26 2022] PUT /identity/v3/projects/5a6cb4c8df4148c5a9c7b0c15a45da5c/users/085eb5d3a7434e1c8810b995b804c59c/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:26.924430 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23bb2c-7c85-403d-baea-e04a1da25301 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:26.924725 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23bb2c-7c85-403d-baea-e04a1da25301 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:26.925072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23bb2c-7c85-403d-baea-e04a1da25301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:26.961650 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ef23bb2c-7c85-403d-baea-e04a1da25301 None None] MFA Rules not processed for user `085eb5d3a7434e1c8810b995b804c59c`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:26.963181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ef23bb2c-7c85-403d-baea-e04a1da25301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:27.033480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1054/2135] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:27.038808 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e774f7-6b2e-4f0b-9999-8c593d9e4cd5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:27.104606 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e774f7-6b2e-4f0b-9999-8c593d9e4cd5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:27.113124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3c385-fdc1-4c08-9892-946b2711ece3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:27.113791 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3c385-fdc1-4c08-9892-946b2711ece3 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:27.114074 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3c385-fdc1-4c08-9892-946b2711ece3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:27.114317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3c385-fdc1-4c08-9892-946b2711ece3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:27.115035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3c385-fdc1-4c08-9892-946b2711ece3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:27.117006 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3c385-fdc1-4c08-9892-946b2711ece3 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:27.145724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1082/2136] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:27 2022] POST /identity/v3/projects => generated 401 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:27.149975 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23bb2c-7c85-403d-baea-e04a1da25301 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:27.160838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23bb2c-7c85-403d-baea-e04a1da25301 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:27.220707 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb255873-a4e9-4304-b285-25d4ea314c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:27.221390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb255873-a4e9-4304-b285-25d4ea314c8c admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:27.221674 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb255873-a4e9-4304-b285-25d4ea314c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:27.221968 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb255873-a4e9-4304-b285-25d4ea314c8c admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:27.222702 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb255873-a4e9-4304-b285-25d4ea314c8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:27.224920 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb255873-a4e9-4304-b285-25d4ea314c8c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:27.247214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1055/2137] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:27 2022] POST /identity/v3/users => generated 307 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:27.251452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3c385-fdc1-4c08-9892-946b2711ece3 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:27.262018 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3c385-fdc1-4c08-9892-946b2711ece3 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:27.267238 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878c825-f717-4fa0-a947-6fb2a268a905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:27.267944 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878c825-f717-4fa0-a947-6fb2a268a905 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:27.268212 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878c825-f717-4fa0-a947-6fb2a268a905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:27.268482 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878c825-f717-4fa0-a947-6fb2a268a905 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:27.269224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878c825-f717-4fa0-a947-6fb2a268a905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:27.270874 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878c825-f717-4fa0-a947-6fb2a268a905 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:27.281800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1083/2138] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:27.286334 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb255873-a4e9-4304-b285-25d4ea314c8c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:27.296895 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb255873-a4e9-4304-b285-25d4ea314c8c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:27.301548 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59493a-426f-4c52-8231-e8c831868c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:27.302434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59493a-426f-4c52-8231-e8c831868c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:27.302712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59493a-426f-4c52-8231-e8c831868c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:27.303006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59493a-426f-4c52-8231-e8c831868c62 admin admin] PATH_INFO: `/v3/projects/3cda87e6f7ca42579fcee559b65965f0/users/78bb18d40a2a45b0b9885370e16a36b0/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:27.318371 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59493a-426f-4c52-8231-e8c831868c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cda87e6f7ca42579fcee559b65965f0, user_id=78bb18d40a2a45b0b9885370e16a36b0, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:27.321028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59493a-426f-4c52-8231-e8c831868c62 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:27.335326 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1056/2139] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:27 2022] PUT /identity/v3/projects/3cda87e6f7ca42579fcee559b65965f0/users/78bb18d40a2a45b0b9885370e16a36b0/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:27.339534 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878c825-f717-4fa0-a947-6fb2a268a905 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:27.349567 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878c825-f717-4fa0-a947-6fb2a268a905 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:27.405142 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd678b-3a7d-455a-95cf-31609623be5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:27.405840 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd678b-3a7d-455a-95cf-31609623be5a admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:27.406123 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd678b-3a7d-455a-95cf-31609623be5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:27.406400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd678b-3a7d-455a-95cf-31609623be5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:27.407168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd678b-3a7d-455a-95cf-31609623be5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:27.408768 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd678b-3a7d-455a-95cf-31609623be5a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:27.418319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1084/2140] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:27.422765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59493a-426f-4c52-8231-e8c831868c62 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:27.434222 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59493a-426f-4c52-8231-e8c831868c62 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:27.439954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e39d5f-bd81-4e56-b818-c6bf6bd5d6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:27.440864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e39d5f-bd81-4e56-b818-c6bf6bd5d6eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:27.441143 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e39d5f-bd81-4e56-b818-c6bf6bd5d6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:27.441457 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e39d5f-bd81-4e56-b818-c6bf6bd5d6eb admin admin] PATH_INFO: `/v3/projects/3cda87e6f7ca42579fcee559b65965f0/users/78bb18d40a2a45b0b9885370e16a36b0/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:27.443852 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e39d5f-bd81-4e56-b818-c6bf6bd5d6eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cda87e6f7ca42579fcee559b65965f0, user_id=78bb18d40a2a45b0b9885370e16a36b0, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:27.446512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e39d5f-bd81-4e56-b818-c6bf6bd5d6eb admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:27.464953 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1057/2141] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:27 2022] PUT /identity/v3/projects/3cda87e6f7ca42579fcee559b65965f0/users/78bb18d40a2a45b0b9885370e16a36b0/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:27.478653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2eb4c5-13c9-434f-92f1-d8b50efb54d7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:27.478944 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2eb4c5-13c9-434f-92f1-d8b50efb54d7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:27.479279 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2eb4c5-13c9-434f-92f1-d8b50efb54d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:27.507879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6e2eb4c5-13c9-434f-92f1-d8b50efb54d7 None None] MFA Rules not processed for user `78bb18d40a2a45b0b9885370e16a36b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:27.509103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6e2eb4c5-13c9-434f-92f1-d8b50efb54d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:27.580285 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1085/2142] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:27 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:27.591538 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e39d5f-bd81-4e56-b818-c6bf6bd5d6eb admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:27.593349 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-20e39d5f-bd81-4e56-b818-c6bf6bd5d6eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:27.653207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e39d5f-bd81-4e56-b818-c6bf6bd5d6eb admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:27.657119 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b0375-a0b2-4c81-a0f9-0c2e557f960f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:27.657841 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b0375-a0b2-4c81-a0f9-0c2e557f960f service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:27.658180 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b0375-a0b2-4c81-a0f9-0c2e557f960f service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:27.658515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b0375-a0b2-4c81-a0f9-0c2e557f960f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:27.668833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b0375-a0b2-4c81-a0f9-0c2e557f960f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:27.670280 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b0375-a0b2-4c81-a0f9-0c2e557f960f service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:27.680924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1058/2143] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:27 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:27.760770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2eb4c5-13c9-434f-92f1-d8b50efb54d7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:27.774353 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2eb4c5-13c9-434f-92f1-d8b50efb54d7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:27.779626 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fd204-026c-4dec-a8f9-4e444a3b8265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:27.780289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fd204-026c-4dec-a8f9-4e444a3b8265 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:27.780571 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fd204-026c-4dec-a8f9-4e444a3b8265 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:27.780850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fd204-026c-4dec-a8f9-4e444a3b8265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:27.853378 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4fd204-026c-4dec-a8f9-4e444a3b8265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:27.855928 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4fd204-026c-4dec-a8f9-4e444a3b8265 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:27.865763 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1086/2144] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:27 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:28.083295 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b0375-a0b2-4c81-a0f9-0c2e557f960f service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:28.084660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-161b0375-a0b2-4c81-a0f9-0c2e557f960f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:28.160081 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b0375-a0b2-4c81-a0f9-0c2e557f960f service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:28.164732 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13257af-ddc4-4dc9-8795-94844c0738da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:28.165678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13257af-ddc4-4dc9-8795-94844c0738da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:28.165963 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13257af-ddc4-4dc9-8795-94844c0738da admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:28.166237 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13257af-ddc4-4dc9-8795-94844c0738da admin admin] PATH_INFO: `/v3/users/09f44e4806674f85897c45647f8e7172` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:28.167809 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13257af-ddc4-4dc9-8795-94844c0738da admin admin] RBAC: Authorizing `identity:delete_user(user_id=09f44e4806674f85897c45647f8e7172)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:28.169787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13257af-ddc4-4dc9-8795-94844c0738da admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:28.217628 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a13257af-ddc4-4dc9-8795-94844c0738da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09f44e4806674f85897c45647f8e7172'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:28.238350 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a13257af-ddc4-4dc9-8795-94844c0738da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09f44e4806674f85897c45647f8e7172'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:28.239179 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a13257af-ddc4-4dc9-8795-94844c0738da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09f44e4806674f85897c45647f8e7172'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:28.239958 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a13257af-ddc4-4dc9-8795-94844c0738da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09f44e4806674f85897c45647f8e7172'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:28.248572 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a13257af-ddc4-4dc9-8795-94844c0738da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09f44e4806674f85897c45647f8e7172'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:28.262034 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1059/2145] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:28 2022] DELETE /identity/v3/users/09f44e4806674f85897c45647f8e7172 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:28.266901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7295831-e5ae-4be1-8d65-3811ec55d127 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:28.267378 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7295831-e5ae-4be1-8d65-3811ec55d127 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:28.267676 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7295831-e5ae-4be1-8d65-3811ec55d127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:28.290922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f7295831-e5ae-4be1-8d65-3811ec55d127 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:28.292180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f7295831-e5ae-4be1-8d65-3811ec55d127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:28.357212 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1087/2146] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:28.367092 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13257af-ddc4-4dc9-8795-94844c0738da admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:28.368637 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a13257af-ddc4-4dc9-8795-94844c0738da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:28.427786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13257af-ddc4-4dc9-8795-94844c0738da admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:28.432063 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4058211-b05c-4c5a-ac25-e1c3e3703f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:28.432712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4058211-b05c-4c5a-ac25-e1c3e3703f89 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:28.432993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4058211-b05c-4c5a-ac25-e1c3e3703f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:28.433265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4058211-b05c-4c5a-ac25-e1c3e3703f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:28.443934 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4058211-b05c-4c5a-ac25-e1c3e3703f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:28.445396 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4058211-b05c-4c5a-ac25-e1c3e3703f89 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:28.454787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1060/2147] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:28.725710 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7295831-e5ae-4be1-8d65-3811ec55d127 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:28.727378 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f7295831-e5ae-4be1-8d65-3811ec55d127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:28.740557 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7295831-e5ae-4be1-8d65-3811ec55d127 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:28.745509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebc470-f764-4b82-925b-9fbc56c1ab1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:28.747196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebc470-f764-4b82-925b-9fbc56c1ab1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:28.747825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebc470-f764-4b82-925b-9fbc56c1ab1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:28.748105 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebc470-f764-4b82-925b-9fbc56c1ab1d admin admin] PATH_INFO: `/v3/projects/6c7a5d1787d6408c97db0d70f9389e61` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:28.749307 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebc470-f764-4b82-925b-9fbc56c1ab1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c7a5d1787d6408c97db0d70f9389e61)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:28.751259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebc470-f764-4b82-925b-9fbc56c1ab1d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:28.796606 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dcebc470-f764-4b82-925b-9fbc56c1ab1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c7a5d1787d6408c97db0d70f9389e61', 'request_id': 'req-dcebc470-f764-4b82-925b-9fbc56c1ab1d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:28.802527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dcebc470-f764-4b82-925b-9fbc56c1ab1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c7a5d1787d6408c97db0d70f9389e61', 'request_id': 'req-dcebc470-f764-4b82-925b-9fbc56c1ab1d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:28.811895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dcebc470-f764-4b82-925b-9fbc56c1ab1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c7a5d1787d6408c97db0d70f9389e61', 'request_id': 'req-dcebc470-f764-4b82-925b-9fbc56c1ab1d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:28.822164 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dcebc470-f764-4b82-925b-9fbc56c1ab1d admin admin] The token cache is being invalidate because project 6c7a5d1787d6408c97db0d70f9389e61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:28.822441 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dcebc470-f764-4b82-925b-9fbc56c1ab1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:28.823125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dcebc470-f764-4b82-925b-9fbc56c1ab1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:28.824624 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1088/2148] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:28 2022] DELETE /identity/v3/projects/6c7a5d1787d6408c97db0d70f9389e61 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:28.828821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4058211-b05c-4c5a-ac25-e1c3e3703f89 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:28.838861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4058211-b05c-4c5a-ac25-e1c3e3703f89 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:28.906082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfa346-d4b0-4a64-a748-32d3bb15c86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:28.906985 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfa346-d4b0-4a64-a748-32d3bb15c86e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:28.907263 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfa346-d4b0-4a64-a748-32d3bb15c86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:28.907533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfa346-d4b0-4a64-a748-32d3bb15c86e admin admin] PATH_INFO: `/v3/users/5ba5ab80950c41fcacc0482497272f65` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:28.908730 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfa346-d4b0-4a64-a748-32d3bb15c86e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba5ab80950c41fcacc0482497272f65)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:28.910742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfa346-d4b0-4a64-a748-32d3bb15c86e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:28.970490 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-cabfa346-d4b0-4a64-a748-32d3bb15c86e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba5ab80950c41fcacc0482497272f65'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:28.983612 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-cabfa346-d4b0-4a64-a748-32d3bb15c86e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba5ab80950c41fcacc0482497272f65'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:28.984312 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-cabfa346-d4b0-4a64-a748-32d3bb15c86e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba5ab80950c41fcacc0482497272f65'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:28.984910 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-cabfa346-d4b0-4a64-a748-32d3bb15c86e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba5ab80950c41fcacc0482497272f65'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:28.993607 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-cabfa346-d4b0-4a64-a748-32d3bb15c86e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba5ab80950c41fcacc0482497272f65'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:29.006324 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1061/2149] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:28 2022] DELETE /identity/v3/users/5ba5ab80950c41fcacc0482497272f65 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:29.356791 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebc470-f764-4b82-925b-9fbc56c1ab1d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:29.358863 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-dcebc470-f764-4b82-925b-9fbc56c1ab1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:29.372625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebc470-f764-4b82-925b-9fbc56c1ab1d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:29.433301 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178134d-35dd-4c3f-8bd9-a00f989135a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:29.434451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178134d-35dd-4c3f-8bd9-a00f989135a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:29.434731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178134d-35dd-4c3f-8bd9-a00f989135a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:29.435065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178134d-35dd-4c3f-8bd9-a00f989135a8 admin admin] PATH_INFO: `/v3/projects/aa8d56284df64f76b93cbd7d134c52b0` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:29.436313 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178134d-35dd-4c3f-8bd9-a00f989135a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa8d56284df64f76b93cbd7d134c52b0)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:29.445735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178134d-35dd-4c3f-8bd9-a00f989135a8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:29.490270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7178134d-35dd-4c3f-8bd9-a00f989135a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa8d56284df64f76b93cbd7d134c52b0', 'request_id': 'req-7178134d-35dd-4c3f-8bd9-a00f989135a8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:29.496762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7178134d-35dd-4c3f-8bd9-a00f989135a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa8d56284df64f76b93cbd7d134c52b0', 'request_id': 'req-7178134d-35dd-4c3f-8bd9-a00f989135a8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:29.506577 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7178134d-35dd-4c3f-8bd9-a00f989135a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa8d56284df64f76b93cbd7d134c52b0', 'request_id': 'req-7178134d-35dd-4c3f-8bd9-a00f989135a8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:29.517945 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7178134d-35dd-4c3f-8bd9-a00f989135a8 admin admin] The token cache is being invalidate because project aa8d56284df64f76b93cbd7d134c52b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:29.518059 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7178134d-35dd-4c3f-8bd9-a00f989135a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:29.518784 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7178134d-35dd-4c3f-8bd9-a00f989135a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:29.520927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1089/2150] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:29 2022] DELETE /identity/v3/projects/aa8d56284df64f76b93cbd7d134c52b0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:29.525066 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfa346-d4b0-4a64-a748-32d3bb15c86e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:29.526557 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cabfa346-d4b0-4a64-a748-32d3bb15c86e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:29.539751 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfa346-d4b0-4a64-a748-32d3bb15c86e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:29.602331 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef32b28-53e3-4baa-ac06-4081f2321a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:29.603230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef32b28-53e3-4baa-ac06-4081f2321a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:29.603506 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef32b28-53e3-4baa-ac06-4081f2321a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:29.603763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef32b28-53e3-4baa-ac06-4081f2321a4c admin admin] PATH_INFO: `/v3/users/4f9d09826d7e4f8bb941cc912fd4b086` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:29.604954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef32b28-53e3-4baa-ac06-4081f2321a4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f9d09826d7e4f8bb941cc912fd4b086)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:29.607189 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef32b28-53e3-4baa-ac06-4081f2321a4c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:29.652260 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bef32b28-53e3-4baa-ac06-4081f2321a4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f9d09826d7e4f8bb941cc912fd4b086'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:29.664219 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bef32b28-53e3-4baa-ac06-4081f2321a4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f9d09826d7e4f8bb941cc912fd4b086'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:29.665118 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bef32b28-53e3-4baa-ac06-4081f2321a4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f9d09826d7e4f8bb941cc912fd4b086'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:29.666124 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bef32b28-53e3-4baa-ac06-4081f2321a4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f9d09826d7e4f8bb941cc912fd4b086'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:29.673902 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bef32b28-53e3-4baa-ac06-4081f2321a4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f9d09826d7e4f8bb941cc912fd4b086'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:29.686875 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1062/2151] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:29 2022] DELETE /identity/v3/users/4f9d09826d7e4f8bb941cc912fd4b086 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:30.014066 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178134d-35dd-4c3f-8bd9-a00f989135a8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:30.015888 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7178134d-35dd-4c3f-8bd9-a00f989135a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:30.039308 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178134d-35dd-4c3f-8bd9-a00f989135a8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:30.123523 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbed70a-afaf-4d2d-8398-9719676cf430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:30.124408 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbed70a-afaf-4d2d-8398-9719676cf430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:30.124692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbed70a-afaf-4d2d-8398-9719676cf430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:30.124970 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbed70a-afaf-4d2d-8398-9719676cf430 admin admin] PATH_INFO: `/v3/projects/f7f85bd02d384b3a8566d44c155f0549` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:30.126183 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbed70a-afaf-4d2d-8398-9719676cf430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7f85bd02d384b3a8566d44c155f0549)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:30.128150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbed70a-afaf-4d2d-8398-9719676cf430 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:30.190373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0dbed70a-afaf-4d2d-8398-9719676cf430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7f85bd02d384b3a8566d44c155f0549', 'request_id': 'req-0dbed70a-afaf-4d2d-8398-9719676cf430'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:30.198845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0dbed70a-afaf-4d2d-8398-9719676cf430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7f85bd02d384b3a8566d44c155f0549', 'request_id': 'req-0dbed70a-afaf-4d2d-8398-9719676cf430'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:30.209504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0dbed70a-afaf-4d2d-8398-9719676cf430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7f85bd02d384b3a8566d44c155f0549', 'request_id': 'req-0dbed70a-afaf-4d2d-8398-9719676cf430'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:30.225251 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0dbed70a-afaf-4d2d-8398-9719676cf430 admin admin] The token cache is being invalidate because project f7f85bd02d384b3a8566d44c155f0549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:30.225583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0dbed70a-afaf-4d2d-8398-9719676cf430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:30.226564 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0dbed70a-afaf-4d2d-8398-9719676cf430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:30.228653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1090/2152] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:30 2022] DELETE /identity/v3/projects/f7f85bd02d384b3a8566d44c155f0549 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:57:30.233866 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a37ff-bb3b-40a4-bdec-77e264e29ee1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:30.234370 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a37ff-bb3b-40a4-bdec-77e264e29ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:30.234474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a37ff-bb3b-40a4-bdec-77e264e29ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:30.279617 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e59a37ff-bb3b-40a4-bdec-77e264e29ee1 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:30.280988 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e59a37ff-bb3b-40a4-bdec-77e264e29ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:30.396729 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1063/2153] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:30.405127 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988a2cc-0cc9-4b92-bb3c-94463083b61f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:30.406023 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988a2cc-0cc9-4b92-bb3c-94463083b61f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:30.406526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988a2cc-0cc9-4b92-bb3c-94463083b61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:30.427720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9988a2cc-0cc9-4b92-bb3c-94463083b61f None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:30.429824 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9988a2cc-0cc9-4b92-bb3c-94463083b61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:30.452529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1091/2154] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:30.453933 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a37ff-bb3b-40a4-bdec-77e264e29ee1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:30.470023 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a37ff-bb3b-40a4-bdec-77e264e29ee1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:30.486464 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd8878-7380-4c91-b9d3-dbcd6f589464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:30.487482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd8878-7380-4c91-b9d3-dbcd6f589464 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:30.487909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd8878-7380-4c91-b9d3-dbcd6f589464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:30.488328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd8878-7380-4c91-b9d3-dbcd6f589464 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:30.489206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd8878-7380-4c91-b9d3-dbcd6f589464 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:57:30.489779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd8878-7380-4c91-b9d3-dbcd6f589464 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:30.491456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd8878-7380-4c91-b9d3-dbcd6f589464 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:30.511678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1064/2155] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:57:30.516225 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988a2cc-0cc9-4b92-bb3c-94463083b61f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:30.533251 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988a2cc-0cc9-4b92-bb3c-94463083b61f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:30.537241 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e26886-20b4-41d6-8097-b0442f594919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:30.538158 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e26886-20b4-41d6-8097-b0442f594919 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:30.538679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e26886-20b4-41d6-8097-b0442f594919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:30.539228 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e26886-20b4-41d6-8097-b0442f594919 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:30.540219 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e26886-20b4-41d6-8097-b0442f594919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:30.542994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e26886-20b4-41d6-8097-b0442f594919 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:30.581857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1092/2156] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:30 2022] POST /identity/v3/projects => generated 369 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:30.586206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd8878-7380-4c91-b9d3-dbcd6f589464 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:30.611691 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd8878-7380-4c91-b9d3-dbcd6f589464 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:30.695563 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7b486-0d10-4a50-aba0-25d66c1baf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:30.696972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7b486-0d10-4a50-aba0-25d66c1baf1b admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:30.697255 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7b486-0d10-4a50-aba0-25d66c1baf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:30.697533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7b486-0d10-4a50-aba0-25d66c1baf1b admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:30.698269 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7b486-0d10-4a50-aba0-25d66c1baf1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:30.700416 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7b486-0d10-4a50-aba0-25d66c1baf1b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:30.727793 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1065/2157] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:30 2022] POST /identity/v3/users => generated 285 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:30.731929 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e26886-20b4-41d6-8097-b0442f594919 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:30.751211 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e26886-20b4-41d6-8097-b0442f594919 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:30.751569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfd2f4-e979-4949-8970-8bc57b591b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:30.752800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfd2f4-e979-4949-8970-8bc57b591b7c admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:30.753047 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfd2f4-e979-4949-8970-8bc57b591b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:30.753331 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfd2f4-e979-4949-8970-8bc57b591b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:30.754636 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bfd2f4-e979-4949-8970-8bc57b591b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:30.756281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bfd2f4-e979-4949-8970-8bc57b591b7c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:30.771004 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1093/2158] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:30.774631 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7b486-0d10-4a50-aba0-25d66c1baf1b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:30.789174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7b486-0d10-4a50-aba0-25d66c1baf1b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:30.795730 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d690f-c4ab-4f6e-b993-aa0cd8029887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:30.796414 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d690f-c4ab-4f6e-b993-aa0cd8029887 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:30.796696 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d690f-c4ab-4f6e-b993-aa0cd8029887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:30.797054 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d690f-c4ab-4f6e-b993-aa0cd8029887 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:30.797765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d690f-c4ab-4f6e-b993-aa0cd8029887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:30.799344 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d690f-c4ab-4f6e-b993-aa0cd8029887 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:30.812608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1066/2159] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:30.816431 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfd2f4-e979-4949-8970-8bc57b591b7c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:30.828426 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfd2f4-e979-4949-8970-8bc57b591b7c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:30.833231 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9db24-a639-4e9a-abfa-34281633b477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:30.834163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9db24-a639-4e9a-abfa-34281633b477 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:30.834575 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9db24-a639-4e9a-abfa-34281633b477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:30.834743 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9db24-a639-4e9a-abfa-34281633b477 admin admin] PATH_INFO: `/v3/projects/051e9b54c55f4892af26a760aab09b57/users/145e5a44e4ff43948f2c4d603e750a8c/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:30.854281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9db24-a639-4e9a-abfa-34281633b477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=051e9b54c55f4892af26a760aab09b57, user_id=145e5a44e4ff43948f2c4d603e750a8c, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:30.857928 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9db24-a639-4e9a-abfa-34281633b477 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:30.880224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1094/2160] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:30 2022] PUT /identity/v3/projects/051e9b54c55f4892af26a760aab09b57/users/145e5a44e4ff43948f2c4d603e750a8c/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:30.890373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bf350-4485-4f5a-8918-d9f782a1bd73 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:30.890660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bf350-4485-4f5a-8918-d9f782a1bd73 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:30.890933 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bf350-4485-4f5a-8918-d9f782a1bd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:30.933306 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f22bf350-4485-4f5a-8918-d9f782a1bd73 None None] MFA Rules not processed for user `145e5a44e4ff43948f2c4d603e750a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:30.933306 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f22bf350-4485-4f5a-8918-d9f782a1bd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:31.000135 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1067/2161] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:57:31.011333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9db24-a639-4e9a-abfa-34281633b477 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:31.016017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-80e9db24-a639-4e9a-abfa-34281633b477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:31.084172 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9db24-a639-4e9a-abfa-34281633b477 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:31.087847 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1065c62-b95c-41db-8fea-89588411c478 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '281c923b01a143dbb79d8c0ea04f55b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:31.088509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1065c62-b95c-41db-8fea-89588411c478 service glance] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:31.088796 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1065c62-b95c-41db-8fea-89588411c478 service glance] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:31.089073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1065c62-b95c-41db-8fea-89588411c478 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:31.097726 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1065c62-b95c-41db-8fea-89588411c478 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:31.099195 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1065c62-b95c-41db-8fea-89588411c478 service glance] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:31.108508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1095/2162] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:33.216406 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bf350-4485-4f5a-8918-d9f782a1bd73 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:33.218130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f22bf350-4485-4f5a-8918-d9f782a1bd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:33.302660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bf350-4485-4f5a-8918-d9f782a1bd73 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:33.311534 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f7b50-3773-45b1-b1d3-c4ff80431541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:33.312426 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f7b50-3773-45b1-b1d3-c4ff80431541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:33.312700 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f7b50-3773-45b1-b1d3-c4ff80431541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:33.312979 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f7b50-3773-45b1-b1d3-c4ff80431541 admin admin] PATH_INFO: `/v3/users/085eb5d3a7434e1c8810b995b804c59c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:33.314169 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f7b50-3773-45b1-b1d3-c4ff80431541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=085eb5d3a7434e1c8810b995b804c59c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:33.316150 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f7b50-3773-45b1-b1d3-c4ff80431541 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:33.376477 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e69f7b50-3773-45b1-b1d3-c4ff80431541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '085eb5d3a7434e1c8810b995b804c59c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:33.390147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e69f7b50-3773-45b1-b1d3-c4ff80431541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '085eb5d3a7434e1c8810b995b804c59c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:33.390856 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e69f7b50-3773-45b1-b1d3-c4ff80431541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '085eb5d3a7434e1c8810b995b804c59c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:33.391496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e69f7b50-3773-45b1-b1d3-c4ff80431541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '085eb5d3a7434e1c8810b995b804c59c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:33.399871 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e69f7b50-3773-45b1-b1d3-c4ff80431541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '085eb5d3a7434e1c8810b995b804c59c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:33.412328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1068/2163] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:33 2022] DELETE /identity/v3/users/085eb5d3a7434e1c8810b995b804c59c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:33.417455 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb5283-50b4-40e9-a1f8-eae5f40d9b49 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:33.417961 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb5283-50b4-40e9-a1f8-eae5f40d9b49 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:33.418216 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb5283-50b4-40e9-a1f8-eae5f40d9b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:33.443516 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d0eb5283-50b4-40e9-a1f8-eae5f40d9b49 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:33.444675 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d0eb5283-50b4-40e9-a1f8-eae5f40d9b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:33.502823 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1096/2164] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:57:33.512745 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f7b50-3773-45b1-b1d3-c4ff80431541 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:33.514153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e69f7b50-3773-45b1-b1d3-c4ff80431541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:33.577074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f7b50-3773-45b1-b1d3-c4ff80431541 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:33.580967 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a1294-6778-497e-940d-1600afc6082e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:33.581653 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a1294-6778-497e-940d-1600afc6082e service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:33.581927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a1294-6778-497e-940d-1600afc6082e service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:33.582292 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a1294-6778-497e-940d-1600afc6082e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:33.591831 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a1294-6778-497e-940d-1600afc6082e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:33.593258 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a1294-6778-497e-940d-1600afc6082e service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:33.602485 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1069/2165] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:33.866212 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb5283-50b4-40e9-a1f8-eae5f40d9b49 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:33.868267 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d0eb5283-50b4-40e9-a1f8-eae5f40d9b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:33.885713 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb5283-50b4-40e9-a1f8-eae5f40d9b49 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:33.891754 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df503416-c30c-49b0-b368-15fa7eb214b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:33.893349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df503416-c30c-49b0-b368-15fa7eb214b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:33.893757 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df503416-c30c-49b0-b368-15fa7eb214b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:33.894329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df503416-c30c-49b0-b368-15fa7eb214b2 admin admin] PATH_INFO: `/v3/projects/5a6cb4c8df4148c5a9c7b0c15a45da5c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:33.895920 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df503416-c30c-49b0-b368-15fa7eb214b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a6cb4c8df4148c5a9c7b0c15a45da5c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:33.898037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df503416-c30c-49b0-b368-15fa7eb214b2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:33.951219 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-df503416-c30c-49b0-b368-15fa7eb214b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a6cb4c8df4148c5a9c7b0c15a45da5c', 'request_id': 'req-df503416-c30c-49b0-b368-15fa7eb214b2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:33.958012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-df503416-c30c-49b0-b368-15fa7eb214b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a6cb4c8df4148c5a9c7b0c15a45da5c', 'request_id': 'req-df503416-c30c-49b0-b368-15fa7eb214b2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:33.965523 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-df503416-c30c-49b0-b368-15fa7eb214b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a6cb4c8df4148c5a9c7b0c15a45da5c', 'request_id': 'req-df503416-c30c-49b0-b368-15fa7eb214b2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:33.976205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-df503416-c30c-49b0-b368-15fa7eb214b2 admin admin] The token cache is being invalidate because project 5a6cb4c8df4148c5a9c7b0c15a45da5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:33.976487 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-df503416-c30c-49b0-b368-15fa7eb214b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:33.977121 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-df503416-c30c-49b0-b368-15fa7eb214b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:33.978996 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1097/2166] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:33 2022] DELETE /identity/v3/projects/5a6cb4c8df4148c5a9c7b0c15a45da5c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:33.983261 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a1294-6778-497e-940d-1600afc6082e service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:33.992464 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a1294-6778-497e-940d-1600afc6082e service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:34.055111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dad9a1-9b41-4f8e-ac1e-88ea9871a1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:34.056035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dad9a1-9b41-4f8e-ac1e-88ea9871a1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:34.056292 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dad9a1-9b41-4f8e-ac1e-88ea9871a1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:34.056560 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dad9a1-9b41-4f8e-ac1e-88ea9871a1db admin admin] PATH_INFO: `/v3/users/78bb18d40a2a45b0b9885370e16a36b0` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:34.057779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dad9a1-9b41-4f8e-ac1e-88ea9871a1db admin admin] RBAC: Authorizing `identity:delete_user(user_id=78bb18d40a2a45b0b9885370e16a36b0)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:34.059779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dad9a1-9b41-4f8e-ac1e-88ea9871a1db admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:34.113991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-11dad9a1-9b41-4f8e-ac1e-88ea9871a1db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78bb18d40a2a45b0b9885370e16a36b0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:34.131872 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-11dad9a1-9b41-4f8e-ac1e-88ea9871a1db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78bb18d40a2a45b0b9885370e16a36b0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:34.132646 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-11dad9a1-9b41-4f8e-ac1e-88ea9871a1db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78bb18d40a2a45b0b9885370e16a36b0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:34.133250 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-11dad9a1-9b41-4f8e-ac1e-88ea9871a1db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78bb18d40a2a45b0b9885370e16a36b0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:34.140836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-11dad9a1-9b41-4f8e-ac1e-88ea9871a1db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78bb18d40a2a45b0b9885370e16a36b0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:34.153307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1070/2167] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:33 2022] DELETE /identity/v3/users/78bb18d40a2a45b0b9885370e16a36b0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:34.387927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df503416-c30c-49b0-b368-15fa7eb214b2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:34.389612 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-df503416-c30c-49b0-b368-15fa7eb214b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:34.403313 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df503416-c30c-49b0-b368-15fa7eb214b2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:34.432025 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dad9a1-9b41-4f8e-ac1e-88ea9871a1db admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:34.433729 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-11dad9a1-9b41-4f8e-ac1e-88ea9871a1db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:34.473642 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7454df-bb32-40a5-97b3-f3f681c16f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:34.474568 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7454df-bb32-40a5-97b3-f3f681c16f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:34.474846 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7454df-bb32-40a5-97b3-f3f681c16f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:34.475150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7454df-bb32-40a5-97b3-f3f681c16f5c admin admin] PATH_INFO: `/v3/users/d8a56f059d194f3d922a878dde88c254` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:34.476471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7454df-bb32-40a5-97b3-f3f681c16f5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8a56f059d194f3d922a878dde88c254)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:34.478401 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7454df-bb32-40a5-97b3-f3f681c16f5c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:34.510102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dad9a1-9b41-4f8e-ac1e-88ea9871a1db admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:34.515286 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86edd4-c5b2-4ef7-a9b4-c41f9a88ad42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:34.516206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86edd4-c5b2-4ef7-a9b4-c41f9a88ad42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:34.516507 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86edd4-c5b2-4ef7-a9b4-c41f9a88ad42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:34.516862 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86edd4-c5b2-4ef7-a9b4-c41f9a88ad42 admin admin] PATH_INFO: `/v3/projects/3cda87e6f7ca42579fcee559b65965f0` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:34.518305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86edd4-c5b2-4ef7-a9b4-c41f9a88ad42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cda87e6f7ca42579fcee559b65965f0)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:34.520455 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86edd4-c5b2-4ef7-a9b4-c41f9a88ad42 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:34.532784 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0e7454df-bb32-40a5-97b3-f3f681c16f5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8a56f059d194f3d922a878dde88c254'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:34.544669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0e7454df-bb32-40a5-97b3-f3f681c16f5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8a56f059d194f3d922a878dde88c254'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:34.545334 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0e7454df-bb32-40a5-97b3-f3f681c16f5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8a56f059d194f3d922a878dde88c254'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:34.546080 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0e7454df-bb32-40a5-97b3-f3f681c16f5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8a56f059d194f3d922a878dde88c254'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:34.555963 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0e7454df-bb32-40a5-97b3-f3f681c16f5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8a56f059d194f3d922a878dde88c254'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:34.568483 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1098/2168] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:34 2022] DELETE /identity/v3/users/d8a56f059d194f3d922a878dde88c254 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:34.569591 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7454df-bb32-40a5-97b3-f3f681c16f5c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:34.570976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0e7454df-bb32-40a5-97b3-f3f681c16f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:34.575991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7c86edd4-c5b2-4ef7-a9b4-c41f9a88ad42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cda87e6f7ca42579fcee559b65965f0', 'request_id': 'req-7c86edd4-c5b2-4ef7-a9b4-c41f9a88ad42'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:34.582441 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7c86edd4-c5b2-4ef7-a9b4-c41f9a88ad42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cda87e6f7ca42579fcee559b65965f0', 'request_id': 'req-7c86edd4-c5b2-4ef7-a9b4-c41f9a88ad42'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:34.589607 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7c86edd4-c5b2-4ef7-a9b4-c41f9a88ad42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cda87e6f7ca42579fcee559b65965f0', 'request_id': 'req-7c86edd4-c5b2-4ef7-a9b4-c41f9a88ad42'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:34.600080 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7c86edd4-c5b2-4ef7-a9b4-c41f9a88ad42 admin admin] The token cache is being invalidate because project 3cda87e6f7ca42579fcee559b65965f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:34.600486 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7c86edd4-c5b2-4ef7-a9b4-c41f9a88ad42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:34.601219 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7c86edd4-c5b2-4ef7-a9b4-c41f9a88ad42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:34.603192 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1071/2169] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:34 2022] DELETE /identity/v3/projects/3cda87e6f7ca42579fcee559b65965f0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:57:34.604468 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c51a11-211b-42e0-81ec-274346b8f381 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:34.604754 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c51a11-211b-42e0-81ec-274346b8f381 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:34.605029 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c51a11-211b-42e0-81ec-274346b8f381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:34.623583 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-63c51a11-211b-42e0-81ec-274346b8f381 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:34.624892 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-63c51a11-211b-42e0-81ec-274346b8f381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:34.639932 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7454df-bb32-40a5-97b3-f3f681c16f5c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:34.645118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd84779-7a42-4d6b-ad18-1c9573527898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:34.646069 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd84779-7a42-4d6b-ad18-1c9573527898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:34.647170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd84779-7a42-4d6b-ad18-1c9573527898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:34.647885 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd84779-7a42-4d6b-ad18-1c9573527898 admin admin] PATH_INFO: `/v3/users/fad5719000be4d199120d3fbf7915a3c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:34.649393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd84779-7a42-4d6b-ad18-1c9573527898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fad5719000be4d199120d3fbf7915a3c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:34.651768 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd84779-7a42-4d6b-ad18-1c9573527898 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:34.702728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1072/2170] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:34.705983 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94261d9-76e2-4818-92a2-36b1f22ca4b1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:34.705983 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94261d9-76e2-4818-92a2-36b1f22ca4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:34.706153 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8bd84779-7a42-4d6b-ad18-1c9573527898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fad5719000be4d199120d3fbf7915a3c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:34.706246 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94261d9-76e2-4818-92a2-36b1f22ca4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:34.726835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d94261d9-76e2-4818-92a2-36b1f22ca4b1 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:34.727818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8bd84779-7a42-4d6b-ad18-1c9573527898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fad5719000be4d199120d3fbf7915a3c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:34.728192 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d94261d9-76e2-4818-92a2-36b1f22ca4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:34.728632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8bd84779-7a42-4d6b-ad18-1c9573527898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fad5719000be4d199120d3fbf7915a3c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:34.729314 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8bd84779-7a42-4d6b-ad18-1c9573527898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fad5719000be4d199120d3fbf7915a3c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:34.736952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1073/2171] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:34.737748 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94261d9-76e2-4818-92a2-36b1f22ca4b1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:34.737971 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8bd84779-7a42-4d6b-ad18-1c9573527898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fad5719000be4d199120d3fbf7915a3c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:34.744147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d94261d9-76e2-4818-92a2-36b1f22ca4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:34.750909 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1099/2172] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:34 2022] DELETE /identity/v3/users/fad5719000be4d199120d3fbf7915a3c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:34.752176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb0f8f-8d58-4ffa-bc33-ce9934a78ab7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:34.752470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb0f8f-8d58-4ffa-bc33-ce9934a78ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:34.752748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb0f8f-8d58-4ffa-bc33-ce9934a78ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:34.769921 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0beb0f8f-8d58-4ffa-bc33-ce9934a78ab7 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:34.771162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0beb0f8f-8d58-4ffa-bc33-ce9934a78ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:34.807170 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94261d9-76e2-4818-92a2-36b1f22ca4b1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:34.830346 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1100/2173] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:34.831825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4453b7-72de-4770-8ed3-f5d26a370e41 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:34.832166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4453b7-72de-4770-8ed3-f5d26a370e41 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:34.832506 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4453b7-72de-4770-8ed3-f5d26a370e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:34.850723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0d4453b7-72de-4770-8ed3-f5d26a370e41 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:34.852048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0d4453b7-72de-4770-8ed3-f5d26a370e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:34.855480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd88a5b-ac64-4aae-b83f-e1746fd13e1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:34.856142 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd88a5b-ac64-4aae-b83f-e1746fd13e1f service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:34.856501 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd88a5b-ac64-4aae-b83f-e1746fd13e1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:34.856794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd88a5b-ac64-4aae-b83f-e1746fd13e1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:34.862026 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1bd88a5b-ac64-4aae-b83f-e1746fd13e1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:34.866595 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1101/2174] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:34.867540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4453b7-72de-4770-8ed3-f5d26a370e41 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:34.875141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd88a5b-ac64-4aae-b83f-e1746fd13e1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:34.876530 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd88a5b-ac64-4aae-b83f-e1746fd13e1f service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:34.876827 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4453b7-72de-4770-8ed3-f5d26a370e41 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:34.881417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91fce4-b83c-4f91-bc3e-b08dcf1a7cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:34.882100 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91fce4-b83c-4f91-bc3e-b08dcf1a7cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:34.882377 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91fce4-b83c-4f91-bc3e-b08dcf1a7cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:34.882649 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91fce4-b83c-4f91-bc3e-b08dcf1a7cc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:34.883405 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91fce4-b83c-4f91-bc3e-b08dcf1a7cc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:57:34.883706 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91fce4-b83c-4f91-bc3e-b08dcf1a7cc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:34.885305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91fce4-b83c-4f91-bc3e-b08dcf1a7cc6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:34.886255 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1074/2175] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:34.887103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd88a5b-ac64-4aae-b83f-e1746fd13e1f service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:34.894992 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd88a5b-ac64-4aae-b83f-e1746fd13e1f service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:34.897554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1102/2176] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:57:34.900318 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee287968-dc79-4cc7-a2b7-a14f43f319cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:34.900971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee287968-dc79-4cc7-a2b7-a14f43f319cc service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:34.901248 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee287968-dc79-4cc7-a2b7-a14f43f319cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:34.901519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee287968-dc79-4cc7-a2b7-a14f43f319cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:34.901768 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91fce4-b83c-4f91-bc3e-b08dcf1a7cc6 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:34.911569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee287968-dc79-4cc7-a2b7-a14f43f319cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:34.912370 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91fce4-b83c-4f91-bc3e-b08dcf1a7cc6 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:34.913107 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee287968-dc79-4cc7-a2b7-a14f43f319cc service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:34.917198 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2839b-879c-40d3-9a9a-adb5f3e3aa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:34.917865 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2839b-879c-40d3-9a9a-adb5f3e3aa5f admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:34.918735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2839b-879c-40d3-9a9a-adb5f3e3aa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:34.919062 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2839b-879c-40d3-9a9a-adb5f3e3aa5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:34.919932 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2839b-879c-40d3-9a9a-adb5f3e3aa5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:34.921849 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2839b-879c-40d3-9a9a-adb5f3e3aa5f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:34.922989 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1075/2177] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:34.951752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1103/2178] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:34 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:57:34.955860 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee287968-dc79-4cc7-a2b7-a14f43f319cc service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:34.966472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee287968-dc79-4cc7-a2b7-a14f43f319cc service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:35.030185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ecd58-ae51-4767-bc27-1a52532364a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:35.030862 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ecd58-ae51-4767-bc27-1a52532364a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:35.031170 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ecd58-ae51-4767-bc27-1a52532364a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:35.031441 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ecd58-ae51-4767-bc27-1a52532364a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:35.032134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ecd58-ae51-4767-bc27-1a52532364a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:35.034249 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ecd58-ae51-4767-bc27-1a52532364a9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:35.055234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1076/2179] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:34 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:57:35.059639 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2839b-879c-40d3-9a9a-adb5f3e3aa5f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:35.077222 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2839b-879c-40d3-9a9a-adb5f3e3aa5f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:35.093938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35c2e9-5c18-4035-bc72-2faffb900186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:35.095072 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35c2e9-5c18-4035-bc72-2faffb900186 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:35.095366 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35c2e9-5c18-4035-bc72-2faffb900186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:35.095656 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35c2e9-5c18-4035-bc72-2faffb900186 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:35.096612 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35c2e9-5c18-4035-bc72-2faffb900186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:35.098536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35c2e9-5c18-4035-bc72-2faffb900186 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:35.112466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1104/2180] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:35.116307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ecd58-ae51-4767-bc27-1a52532364a9 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:35.130171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ecd58-ae51-4767-bc27-1a52532364a9 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:35.135004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8930d-a8c0-4d61-a277-4adc53f6a938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:35.135728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8930d-a8c0-4d61-a277-4adc53f6a938 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:35.136007 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8930d-a8c0-4d61-a277-4adc53f6a938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:35.136273 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8930d-a8c0-4d61-a277-4adc53f6a938 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:35.136995 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8930d-a8c0-4d61-a277-4adc53f6a938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:35.141497 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8930d-a8c0-4d61-a277-4adc53f6a938 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:35.155638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1077/2181] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:57:35.159754 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35c2e9-5c18-4035-bc72-2faffb900186 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:35.170581 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35c2e9-5c18-4035-bc72-2faffb900186 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:35.175331 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d756f85-5286-4b8c-9d68-87c6afad6ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:35.176215 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d756f85-5286-4b8c-9d68-87c6afad6ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:35.176491 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d756f85-5286-4b8c-9d68-87c6afad6ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:35.176760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d756f85-5286-4b8c-9d68-87c6afad6ae4 admin admin] PATH_INFO: `/v3/projects/46adde8a20c04597972b01b605bbf20d/users/e79d709ab94b4ce9ac0dd3b6b1873257/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:35.192972 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d756f85-5286-4b8c-9d68-87c6afad6ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46adde8a20c04597972b01b605bbf20d, user_id=e79d709ab94b4ce9ac0dd3b6b1873257, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:35.201674 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d756f85-5286-4b8c-9d68-87c6afad6ae4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:35.223006 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1105/2182] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:35 2022] PUT /identity/v3/projects/46adde8a20c04597972b01b605bbf20d/users/e79d709ab94b4ce9ac0dd3b6b1873257/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:35.232474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52165ee4-2a8e-4d44-812c-a363850748a3 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:35.232474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52165ee4-2a8e-4d44-812c-a363850748a3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:35.232677 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52165ee4-2a8e-4d44-812c-a363850748a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:35.271118 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-52165ee4-2a8e-4d44-812c-a363850748a3 None None] MFA Rules not processed for user `e79d709ab94b4ce9ac0dd3b6b1873257`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:35.272642 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-52165ee4-2a8e-4d44-812c-a363850748a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:35.304075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d756f85-5286-4b8c-9d68-87c6afad6ae4 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:35.306093 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5d756f85-5286-4b8c-9d68-87c6afad6ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:35.376631 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1078/2183] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:35.388208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52165ee4-2a8e-4d44-812c-a363850748a3 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:35.390276 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-52165ee4-2a8e-4d44-812c-a363850748a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:35.407629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d756f85-5286-4b8c-9d68-87c6afad6ae4 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:35.412569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5111e76-41b2-4859-8387-5df6d199b43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:35.413693 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5111e76-41b2-4859-8387-5df6d199b43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:35.414734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5111e76-41b2-4859-8387-5df6d199b43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:35.414734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5111e76-41b2-4859-8387-5df6d199b43e admin admin] PATH_INFO: `/v3/projects/79cdf2f94daa4cceafccb76146db64f0` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:35.415792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5111e76-41b2-4859-8387-5df6d199b43e admin admin] RBAC: Authorizing `identity:delete_project(project_id=79cdf2f94daa4cceafccb76146db64f0)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:35.417640 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5111e76-41b2-4859-8387-5df6d199b43e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:35.480617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d5111e76-41b2-4859-8387-5df6d199b43e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79cdf2f94daa4cceafccb76146db64f0', 'request_id': 'req-d5111e76-41b2-4859-8387-5df6d199b43e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:35.493151 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d5111e76-41b2-4859-8387-5df6d199b43e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79cdf2f94daa4cceafccb76146db64f0', 'request_id': 'req-d5111e76-41b2-4859-8387-5df6d199b43e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:35.499250 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52165ee4-2a8e-4d44-812c-a363850748a3 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:35.508711 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d5111e76-41b2-4859-8387-5df6d199b43e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79cdf2f94daa4cceafccb76146db64f0', 'request_id': 'req-d5111e76-41b2-4859-8387-5df6d199b43e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:35.523785 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d5111e76-41b2-4859-8387-5df6d199b43e admin admin] The token cache is being invalidate because project 79cdf2f94daa4cceafccb76146db64f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:35.524071 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d5111e76-41b2-4859-8387-5df6d199b43e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:35.535362 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d5111e76-41b2-4859-8387-5df6d199b43e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:35.538654 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1106/2184] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:35 2022] DELETE /identity/v3/projects/79cdf2f94daa4cceafccb76146db64f0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:57:35.539582 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5111e76-41b2-4859-8387-5df6d199b43e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:35.541332 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d5111e76-41b2-4859-8387-5df6d199b43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:35.569580 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45098d9b-63b6-49a0-bf0d-215d107fd9ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:35.570307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45098d9b-63b6-49a0-bf0d-215d107fd9ae service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:35.570636 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45098d9b-63b6-49a0-bf0d-215d107fd9ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:35.570973 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45098d9b-63b6-49a0-bf0d-215d107fd9ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:35.573140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-45098d9b-63b6-49a0-bf0d-215d107fd9ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:35.645817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45098d9b-63b6-49a0-bf0d-215d107fd9ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:35.647303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45098d9b-63b6-49a0-bf0d-215d107fd9ae service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:35.648789 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5111e76-41b2-4859-8387-5df6d199b43e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:35.664359 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bd4d0-2729-485d-afa8-bad8eb45ab7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:35.665271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1079/2185] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:35.667092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bd4d0-2729-485d-afa8-bad8eb45ab7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:35.667092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bd4d0-2729-485d-afa8-bad8eb45ab7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:35.667305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bd4d0-2729-485d-afa8-bad8eb45ab7e admin admin] PATH_INFO: `/v3/projects/04b2d9f0e828402b83db7b2155660649` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:35.669358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d2d0a-d6b2-4761-a282-89fd976f8a06 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:35.669692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d2d0a-d6b2-4761-a282-89fd976f8a06 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:35.670031 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d2d0a-d6b2-4761-a282-89fd976f8a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:35.671816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bd4d0-2729-485d-afa8-bad8eb45ab7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=04b2d9f0e828402b83db7b2155660649)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:35.674822 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bd4d0-2729-485d-afa8-bad8eb45ab7e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:35.703103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-197d2d0a-d6b2-4761-a282-89fd976f8a06 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:35.704570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-197d2d0a-d6b2-4761-a282-89fd976f8a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:35.716154 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1080/2186] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:35.728329 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3c494-25f6-4f46-b314-87c4b8f0b52a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:35.728863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3c494-25f6-4f46-b314-87c4b8f0b52a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:35.729322 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3c494-25f6-4f46-b314-87c4b8f0b52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:35.749805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-87c3c494-25f6-4f46-b314-87c4b8f0b52a None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:35.751438 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-87c3c494-25f6-4f46-b314-87c4b8f0b52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:35.754185 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dc3bd4d0-2729-485d-afa8-bad8eb45ab7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04b2d9f0e828402b83db7b2155660649', 'request_id': 'req-dc3bd4d0-2729-485d-afa8-bad8eb45ab7e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:35.762138 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dc3bd4d0-2729-485d-afa8-bad8eb45ab7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04b2d9f0e828402b83db7b2155660649', 'request_id': 'req-dc3bd4d0-2729-485d-afa8-bad8eb45ab7e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:35.776631 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dc3bd4d0-2729-485d-afa8-bad8eb45ab7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04b2d9f0e828402b83db7b2155660649', 'request_id': 'req-dc3bd4d0-2729-485d-afa8-bad8eb45ab7e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:35.790324 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dc3bd4d0-2729-485d-afa8-bad8eb45ab7e admin admin] The token cache is being invalidate because project 04b2d9f0e828402b83db7b2155660649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:35.790779 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dc3bd4d0-2729-485d-afa8-bad8eb45ab7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:35.796099 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dc3bd4d0-2729-485d-afa8-bad8eb45ab7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:35.798056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1107/2187] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:35 2022] DELETE /identity/v3/projects/04b2d9f0e828402b83db7b2155660649 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:35.802752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e905a37-e53d-4c72-9ec4-c8e67e3fbb92 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:35.803071 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e905a37-e53d-4c72-9ec4-c8e67e3fbb92 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:35.803350 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e905a37-e53d-4c72-9ec4-c8e67e3fbb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:35.830721 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4e905a37-e53d-4c72-9ec4-c8e67e3fbb92 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:35.833038 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4e905a37-e53d-4c72-9ec4-c8e67e3fbb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:35.856988 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1081/2188] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:35.861447 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3c494-25f6-4f46-b314-87c4b8f0b52a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:35.871663 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3c494-25f6-4f46-b314-87c4b8f0b52a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:35.878750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcaa136-3ec5-4025-90e6-83b43b130e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:35.879461 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcaa136-3ec5-4025-90e6-83b43b130e36 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:35.879782 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcaa136-3ec5-4025-90e6-83b43b130e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:35.880305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcaa136-3ec5-4025-90e6-83b43b130e36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:35.881024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcaa136-3ec5-4025-90e6-83b43b130e36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:57:35.881350 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcaa136-3ec5-4025-90e6-83b43b130e36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:35.883285 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcaa136-3ec5-4025-90e6-83b43b130e36 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:35.898131 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1082/2189] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:57:35.902987 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcaa136-3ec5-4025-90e6-83b43b130e36 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:35.914371 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcaa136-3ec5-4025-90e6-83b43b130e36 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:35.919140 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1108/2190] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:57:35.919284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867b25c-bb5a-42bf-9de4-430cb1d538a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:35.919805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867b25c-bb5a-42bf-9de4-430cb1d538a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:35.920089 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867b25c-bb5a-42bf-9de4-430cb1d538a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:35.920365 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867b25c-bb5a-42bf-9de4-430cb1d538a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:35.921092 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867b25c-bb5a-42bf-9de4-430cb1d538a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:35.927015 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867b25c-bb5a-42bf-9de4-430cb1d538a5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:35.931023 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282bfd4-8823-45b7-953c-4b95f7ab48ee None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:35.931307 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282bfd4-8823-45b7-953c-4b95f7ab48ee None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:35.931579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282bfd4-8823-45b7-953c-4b95f7ab48ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:35.952546 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9282bfd4-8823-45b7-953c-4b95f7ab48ee None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:35.953736 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9282bfd4-8823-45b7-953c-4b95f7ab48ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:35.956771 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1083/2191] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:35 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:35.961285 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867b25c-bb5a-42bf-9de4-430cb1d538a5 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:36.041973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1109/2192] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:57:36.046284 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282bfd4-8823-45b7-953c-4b95f7ab48ee None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:36.059806 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867b25c-bb5a-42bf-9de4-430cb1d538a5 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:36.061195 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282bfd4-8823-45b7-953c-4b95f7ab48ee None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:36.071186 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86fca1-a493-4bae-863b-79a7fa855097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:36.071186 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86fca1-a493-4bae-863b-79a7fa855097 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:36.071186 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86fca1-a493-4bae-863b-79a7fa855097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:36.071186 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86fca1-a493-4bae-863b-79a7fa855097 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:36.071587 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86fca1-a493-4bae-863b-79a7fa855097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:36.071587 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86fca1-a493-4bae-863b-79a7fa855097 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:36.075078 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1953f-ca48-48a7-a3e1-c28bc72b325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:36.076197 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1953f-ca48-48a7-a3e1-c28bc72b325c admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:36.076660 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1953f-ca48-48a7-a3e1-c28bc72b325c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:36.077242 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1953f-ca48-48a7-a3e1-c28bc72b325c admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:36.078902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1953f-ca48-48a7-a3e1-c28bc72b325c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:57:36.079511 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1953f-ca48-48a7-a3e1-c28bc72b325c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:36.082178 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1953f-ca48-48a7-a3e1-c28bc72b325c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:36.101116 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1110/2193] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:57:36.102177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1953f-ca48-48a7-a3e1-c28bc72b325c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:36.103929 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1084/2194] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:35 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:36.106447 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86fca1-a493-4bae-863b-79a7fa855097 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:36.114781 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1953f-ca48-48a7-a3e1-c28bc72b325c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:36.116276 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86fca1-a493-4bae-863b-79a7fa855097 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:36.119978 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a9229-8965-41aa-b256-66e83b1a7b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:36.120670 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a9229-8965-41aa-b256-66e83b1a7b12 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:36.120833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e863f-6290-42cf-b249-ed984998b4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:36.120941 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a9229-8965-41aa-b256-66e83b1a7b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:36.121215 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a9229-8965-41aa-b256-66e83b1a7b12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:36.121489 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e863f-6290-42cf-b249-ed984998b4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:36.121925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e863f-6290-42cf-b249-ed984998b4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:36.122031 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a9229-8965-41aa-b256-66e83b1a7b12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:36.122122 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e863f-6290-42cf-b249-ed984998b4b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:36.122829 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e863f-6290-42cf-b249-ed984998b4b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:36.123969 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a9229-8965-41aa-b256-66e83b1a7b12 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:36.124517 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e863f-6290-42cf-b249-ed984998b4b2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:36.135013 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1085/2195] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:57:36.138509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e863f-6290-42cf-b249-ed984998b4b2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:36.149271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e863f-6290-42cf-b249-ed984998b4b2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:36.153588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1111/2196] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:36 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:57:36.154639 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a9229-8965-41aa-b256-66e83b1a7b12 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:36.207315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e7211-3b9e-42cb-8863-68562f6cdc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:36.207990 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e7211-3b9e-42cb-8863-68562f6cdc3d admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:36.208268 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e7211-3b9e-42cb-8863-68562f6cdc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:36.208536 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e7211-3b9e-42cb-8863-68562f6cdc3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:36.209260 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e7211-3b9e-42cb-8863-68562f6cdc3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:36.210928 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e7211-3b9e-42cb-8863-68562f6cdc3d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:36.214146 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a9229-8965-41aa-b256-66e83b1a7b12 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:36.220061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac0c8a-e86b-4389-8e93-f983ee01197e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:36.220734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac0c8a-e86b-4389-8e93-f983ee01197e admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:36.221038 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac0c8a-e86b-4389-8e93-f983ee01197e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:36.224414 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1086/2197] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:36.224551 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac0c8a-e86b-4389-8e93-f983ee01197e admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:36.224551 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac0c8a-e86b-4389-8e93-f983ee01197e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:36.224551 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac0c8a-e86b-4389-8e93-f983ee01197e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:36.225220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e7211-3b9e-42cb-8863-68562f6cdc3d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:36.234702 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e7211-3b9e-42cb-8863-68562f6cdc3d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:36.239672 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4398b7-7e80-4bfe-8900-882fb02c17d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:36.240506 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4398b7-7e80-4bfe-8900-882fb02c17d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:36.240818 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4398b7-7e80-4bfe-8900-882fb02c17d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:36.241090 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4398b7-7e80-4bfe-8900-882fb02c17d1 admin admin] PATH_INFO: `/v3/projects/76515aac5bf247ef8eef3986cc3ce75d/users/e50be91ec9bf4ad8ad6f876e2caec585/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:36.248348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1112/2198] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:36 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:57:36.252492 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac0c8a-e86b-4389-8e93-f983ee01197e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:36.256942 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4398b7-7e80-4bfe-8900-882fb02c17d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76515aac5bf247ef8eef3986cc3ce75d, user_id=e50be91ec9bf4ad8ad6f876e2caec585, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:36.259621 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4398b7-7e80-4bfe-8900-882fb02c17d1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:36.262256 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac0c8a-e86b-4389-8e93-f983ee01197e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:36.267685 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d163d-cd5f-49e6-8783-cfaa3ff78f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:36.268345 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d163d-cd5f-49e6-8783-cfaa3ff78f52 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:36.268622 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d163d-cd5f-49e6-8783-cfaa3ff78f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:36.268895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d163d-cd5f-49e6-8783-cfaa3ff78f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:36.269615 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d163d-cd5f-49e6-8783-cfaa3ff78f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:36.271233 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d163d-cd5f-49e6-8783-cfaa3ff78f52 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:36.273369 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1087/2199] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:36 2022] PUT /identity/v3/projects/76515aac5bf247ef8eef3986cc3ce75d/users/e50be91ec9bf4ad8ad6f876e2caec585/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:36.278373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483867b-a7fa-4bb0-ab2f-80c4f33ff24c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:36.278746 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483867b-a7fa-4bb0-ab2f-80c4f33ff24c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:36.279089 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483867b-a7fa-4bb0-ab2f-80c4f33ff24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:36.286298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1113/2200] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:36.286298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d163d-cd5f-49e6-8783-cfaa3ff78f52 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:36.296542 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d163d-cd5f-49e6-8783-cfaa3ff78f52 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:36.303975 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8483867b-a7fa-4bb0-ab2f-80c4f33ff24c None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:36.305195 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8483867b-a7fa-4bb0-ab2f-80c4f33ff24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:36.385941 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1088/2201] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:57:36.387202 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d718e9-375d-480f-9602-e378fa1087c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:36.387862 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d718e9-375d-480f-9602-e378fa1087c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:36.388150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d718e9-375d-480f-9602-e378fa1087c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:36.388435 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d718e9-375d-480f-9602-e378fa1087c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:36.389183 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d718e9-375d-480f-9602-e378fa1087c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:36.390818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d718e9-375d-480f-9602-e378fa1087c5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:36.395961 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483867b-a7fa-4bb0-ab2f-80c4f33ff24c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:36.397796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8483867b-a7fa-4bb0-ab2f-80c4f33ff24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:36.404119 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1114/2202] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:36.408327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d718e9-375d-480f-9602-e378fa1087c5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:36.419808 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d718e9-375d-480f-9602-e378fa1087c5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:36.424912 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f3f53-3c8d-474c-9c5f-a248b43a14d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:36.425958 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f3f53-3c8d-474c-9c5f-a248b43a14d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:36.426308 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f3f53-3c8d-474c-9c5f-a248b43a14d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:36.426668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f3f53-3c8d-474c-9c5f-a248b43a14d4 admin admin] PATH_INFO: `/v3/projects/e9c40e0855a64e759f1ce016e552ff5c/users/492297d3c73f400e8096f0f9ca49fc44/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:36.450121 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f3f53-3c8d-474c-9c5f-a248b43a14d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c40e0855a64e759f1ce016e552ff5c, user_id=492297d3c73f400e8096f0f9ca49fc44, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:36.453449 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f3f53-3c8d-474c-9c5f-a248b43a14d4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:36.466757 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483867b-a7fa-4bb0-ab2f-80c4f33ff24c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:36.469213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1115/2203] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:36 2022] PUT /identity/v3/projects/e9c40e0855a64e759f1ce016e552ff5c/users/492297d3c73f400e8096f0f9ca49fc44/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:57:36.480328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29eca5d-be6e-45dd-b327-27fed2517af8 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:36.480704 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29eca5d-be6e-45dd-b327-27fed2517af8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:36.481270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29eca5d-be6e-45dd-b327-27fed2517af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:36.513190 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a29eca5d-be6e-45dd-b327-27fed2517af8 None None] MFA Rules not processed for user `492297d3c73f400e8096f0f9ca49fc44`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:36.514517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a29eca5d-be6e-45dd-b327-27fed2517af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:36.532333 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04a11e-cb0e-4acf-8bc3-1bb7868e6f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:36.533248 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04a11e-cb0e-4acf-8bc3-1bb7868e6f49 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:36.533534 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04a11e-cb0e-4acf-8bc3-1bb7868e6f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:36.533812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04a11e-cb0e-4acf-8bc3-1bb7868e6f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:36.602343 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1116/2204] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:36.606885 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29eca5d-be6e-45dd-b327-27fed2517af8 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:36.619362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04a11e-cb0e-4acf-8bc3-1bb7868e6f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:36.620934 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04a11e-cb0e-4acf-8bc3-1bb7868e6f49 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:36.624873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29eca5d-be6e-45dd-b327-27fed2517af8 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:36.630346 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8432f1b-6dc1-4e3b-8210-5c37aef1eda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:36.631077 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8432f1b-6dc1-4e3b-8210-5c37aef1eda1 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:36.631497 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8432f1b-6dc1-4e3b-8210-5c37aef1eda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:36.631783 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8432f1b-6dc1-4e3b-8210-5c37aef1eda1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:36.632499 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8432f1b-6dc1-4e3b-8210-5c37aef1eda1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:36.634487 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8432f1b-6dc1-4e3b-8210-5c37aef1eda1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:36.641145 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1089/2205] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:57:36.661972 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1117/2206] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:36 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:36.665864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04a11e-cb0e-4acf-8bc3-1bb7868e6f49 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:36.677449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04a11e-cb0e-4acf-8bc3-1bb7868e6f49 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:36.750135 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76899caa-551b-43e4-b53b-4390d61007b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:36.750986 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76899caa-551b-43e4-b53b-4390d61007b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:36.751296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76899caa-551b-43e4-b53b-4390d61007b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:36.751571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76899caa-551b-43e4-b53b-4390d61007b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:36.752392 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76899caa-551b-43e4-b53b-4390d61007b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:36.754283 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76899caa-551b-43e4-b53b-4390d61007b1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:36.784007 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1090/2207] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:36 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:57:36.785426 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8432f1b-6dc1-4e3b-8210-5c37aef1eda1 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:36.799675 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8432f1b-6dc1-4e3b-8210-5c37aef1eda1 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:36.836037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7e360-6de5-4185-873e-5aa43aa8b4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:36.840190 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7e360-6de5-4185-873e-5aa43aa8b4ab admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:36.840487 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7e360-6de5-4185-873e-5aa43aa8b4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:36.843090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7e360-6de5-4185-873e-5aa43aa8b4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:36.847221 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7e360-6de5-4185-873e-5aa43aa8b4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:36.848905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7e360-6de5-4185-873e-5aa43aa8b4ab admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:36.869524 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1118/2208] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:36.870734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76899caa-551b-43e4-b53b-4390d61007b1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:36.884064 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76899caa-551b-43e4-b53b-4390d61007b1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:36.905246 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d411f96-7b82-47d4-972f-e1c1cbe5287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:36.905246 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d411f96-7b82-47d4-972f-e1c1cbe5287a admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:36.905246 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d411f96-7b82-47d4-972f-e1c1cbe5287a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:36.905246 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d411f96-7b82-47d4-972f-e1c1cbe5287a admin admin] PATH_INFO: `/v3/projects/58e5c344d9ed415a8aa8364d2213a34c/users/f92f5f21d82b48a2b15d984f74079024/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:36.918011 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d411f96-7b82-47d4-972f-e1c1cbe5287a admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e5c344d9ed415a8aa8364d2213a34c, user_id=f92f5f21d82b48a2b15d984f74079024, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:36.922379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d411f96-7b82-47d4-972f-e1c1cbe5287a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:36.962790 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1091/2209] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:36 2022] PUT /identity/v3/projects/58e5c344d9ed415a8aa8364d2213a34c/users/f92f5f21d82b48a2b15d984f74079024/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:36.964374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7e360-6de5-4185-873e-5aa43aa8b4ab admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:36.977304 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7e360-6de5-4185-873e-5aa43aa8b4ab admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:37.045989 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572bbde-87bb-40cb-8cdc-99e8ca40a747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:37.046774 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572bbde-87bb-40cb-8cdc-99e8ca40a747 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:37.047170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572bbde-87bb-40cb-8cdc-99e8ca40a747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:37.047515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572bbde-87bb-40cb-8cdc-99e8ca40a747 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:37.048333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572bbde-87bb-40cb-8cdc-99e8ca40a747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:37.050076 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572bbde-87bb-40cb-8cdc-99e8ca40a747 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:37.060844 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1119/2210] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:37.065079 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d411f96-7b82-47d4-972f-e1c1cbe5287a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:37.080554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d411f96-7b82-47d4-972f-e1c1cbe5287a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:37.089871 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a32ea8-813e-424c-854f-f161be25cc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:37.091032 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a32ea8-813e-424c-854f-f161be25cc52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:37.091484 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a32ea8-813e-424c-854f-f161be25cc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:37.091931 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a32ea8-813e-424c-854f-f161be25cc52 admin admin] PATH_INFO: `/v3/projects/58e5c344d9ed415a8aa8364d2213a34c/users/f92f5f21d82b48a2b15d984f74079024/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:37.093976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a32ea8-813e-424c-854f-f161be25cc52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e5c344d9ed415a8aa8364d2213a34c, user_id=f92f5f21d82b48a2b15d984f74079024, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:37.096820 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a32ea8-813e-424c-854f-f161be25cc52 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:37.112601 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1092/2211] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:37 2022] PUT /identity/v3/projects/58e5c344d9ed415a8aa8364d2213a34c/users/f92f5f21d82b48a2b15d984f74079024/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:37.125097 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76e0ec-8a93-43cf-8fd8-6f53173b2453 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:37.125480 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76e0ec-8a93-43cf-8fd8-6f53173b2453 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:37.125742 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76e0ec-8a93-43cf-8fd8-6f53173b2453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:37.160090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bb76e0ec-8a93-43cf-8fd8-6f53173b2453 None None] MFA Rules not processed for user `f92f5f21d82b48a2b15d984f74079024`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:37.161549 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bb76e0ec-8a93-43cf-8fd8-6f53173b2453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:37.272483 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1120/2212] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:37.304514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a32ea8-813e-424c-854f-f161be25cc52 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:37.307140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-27a32ea8-813e-424c-854f-f161be25cc52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:37.406719 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a32ea8-813e-424c-854f-f161be25cc52 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:37.413251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60eae9a-4924-4dde-a89c-cd81a62c9aeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:37.414077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eae9a-4924-4dde-a89c-cd81a62c9aeb service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:37.414389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eae9a-4924-4dde-a89c-cd81a62c9aeb service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:37.414751 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eae9a-4924-4dde-a89c-cd81a62c9aeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:37.426271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60eae9a-4924-4dde-a89c-cd81a62c9aeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:37.427747 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60eae9a-4924-4dde-a89c-cd81a62c9aeb service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:37.439536 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1093/2213] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:37.583238 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043895c7-3831-4ef0-850c-6d4440bca6da None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:37.584398 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043895c7-3831-4ef0-850c-6d4440bca6da None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:37.584658 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043895c7-3831-4ef0-850c-6d4440bca6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:37.637778 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-043895c7-3831-4ef0-850c-6d4440bca6da None None] MFA Rules not processed for user `e50be91ec9bf4ad8ad6f876e2caec585`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:37.639082 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-043895c7-3831-4ef0-850c-6d4440bca6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:37.722247 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1121/2214] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:57:37.734932 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60eae9a-4924-4dde-a89c-cd81a62c9aeb service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:37.747152 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60eae9a-4924-4dde-a89c-cd81a62c9aeb service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:37.750891 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360461e7-3326-4b55-8b76-94a7b432ad39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:37.751580 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360461e7-3326-4b55-8b76-94a7b432ad39 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:37.751865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360461e7-3326-4b55-8b76-94a7b432ad39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:37.752142 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360461e7-3326-4b55-8b76-94a7b432ad39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:37.761496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360461e7-3326-4b55-8b76-94a7b432ad39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:37.763320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360461e7-3326-4b55-8b76-94a7b432ad39 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:37.772695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1094/2215] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:37.888122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043895c7-3831-4ef0-850c-6d4440bca6da None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:37.969089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043895c7-3831-4ef0-850c-6d4440bca6da None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:37.973768 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1b810-b260-4211-881b-bd814e654e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:37.974658 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1b810-b260-4211-881b-bd814e654e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:37.974938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1b810-b260-4211-881b-bd814e654e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:37.975238 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1b810-b260-4211-881b-bd814e654e0e admin admin] PATH_INFO: `/v3/users/492297d3c73f400e8096f0f9ca49fc44` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:37.976535 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1b810-b260-4211-881b-bd814e654e0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=492297d3c73f400e8096f0f9ca49fc44)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:37.978456 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1b810-b260-4211-881b-bd814e654e0e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:38.031624 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f4c1b810-b260-4211-881b-bd814e654e0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '492297d3c73f400e8096f0f9ca49fc44'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:38.046504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f4c1b810-b260-4211-881b-bd814e654e0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '492297d3c73f400e8096f0f9ca49fc44'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:38.047361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f4c1b810-b260-4211-881b-bd814e654e0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '492297d3c73f400e8096f0f9ca49fc44'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:38.047971 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f4c1b810-b260-4211-881b-bd814e654e0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '492297d3c73f400e8096f0f9ca49fc44'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:38.057113 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f4c1b810-b260-4211-881b-bd814e654e0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '492297d3c73f400e8096f0f9ca49fc44'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:38.074333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1122/2216] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:37 2022] DELETE /identity/v3/users/492297d3c73f400e8096f0f9ca49fc44 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:38.077805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3fe97-feb3-4fd7-b645-27367d15e00b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:38.078709 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3fe97-feb3-4fd7-b645-27367d15e00b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:38.079078 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3fe97-feb3-4fd7-b645-27367d15e00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:38.098989 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b2f3fe97-feb3-4fd7-b645-27367d15e00b None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:38.100226 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b2f3fe97-feb3-4fd7-b645-27367d15e00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:38.164640 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1095/2217] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:57:38.177524 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1b810-b260-4211-881b-bd814e654e0e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:38.179416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f4c1b810-b260-4211-881b-bd814e654e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:38.237965 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1b810-b260-4211-881b-bd814e654e0e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:38.242452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d0142-255e-4f29-9bbc-b6407ba204d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:38.243139 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d0142-255e-4f29-9bbc-b6407ba204d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:38.243426 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d0142-255e-4f29-9bbc-b6407ba204d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:38.243712 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d0142-255e-4f29-9bbc-b6407ba204d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:38.253676 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d0142-255e-4f29-9bbc-b6407ba204d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:38.255169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d0142-255e-4f29-9bbc-b6407ba204d3 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:38.265523 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1123/2218] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:38.532335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3fe97-feb3-4fd7-b645-27367d15e00b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:38.533816 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b2f3fe97-feb3-4fd7-b645-27367d15e00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:38.545948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3fe97-feb3-4fd7-b645-27367d15e00b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:38.551426 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db467a-b9c5-4b93-b6ef-da085cd0d01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:38.552433 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db467a-b9c5-4b93-b6ef-da085cd0d01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:38.552707 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db467a-b9c5-4b93-b6ef-da085cd0d01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:38.552983 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db467a-b9c5-4b93-b6ef-da085cd0d01b admin admin] PATH_INFO: `/v3/projects/e9c40e0855a64e759f1ce016e552ff5c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:38.554700 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db467a-b9c5-4b93-b6ef-da085cd0d01b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9c40e0855a64e759f1ce016e552ff5c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:38.556680 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db467a-b9c5-4b93-b6ef-da085cd0d01b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:38.604158 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-53db467a-b9c5-4b93-b6ef-da085cd0d01b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9c40e0855a64e759f1ce016e552ff5c', 'request_id': 'req-53db467a-b9c5-4b93-b6ef-da085cd0d01b'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:38.610626 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-53db467a-b9c5-4b93-b6ef-da085cd0d01b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9c40e0855a64e759f1ce016e552ff5c', 'request_id': 'req-53db467a-b9c5-4b93-b6ef-da085cd0d01b'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:38.619412 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-53db467a-b9c5-4b93-b6ef-da085cd0d01b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9c40e0855a64e759f1ce016e552ff5c', 'request_id': 'req-53db467a-b9c5-4b93-b6ef-da085cd0d01b'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:38.631071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-53db467a-b9c5-4b93-b6ef-da085cd0d01b admin admin] The token cache is being invalidate because project e9c40e0855a64e759f1ce016e552ff5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:38.631398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-53db467a-b9c5-4b93-b6ef-da085cd0d01b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:38.632120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-53db467a-b9c5-4b93-b6ef-da085cd0d01b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:38.633709 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1096/2219] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:38 2022] DELETE /identity/v3/projects/e9c40e0855a64e759f1ce016e552ff5c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:38.637974 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d0142-255e-4f29-9bbc-b6407ba204d3 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:38.648173 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d0142-255e-4f29-9bbc-b6407ba204d3 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:38.709716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61ba40-cc2e-4dd7-95f7-e30f39f2bc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:38.710627 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61ba40-cc2e-4dd7-95f7-e30f39f2bc35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:38.710892 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61ba40-cc2e-4dd7-95f7-e30f39f2bc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:38.711205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61ba40-cc2e-4dd7-95f7-e30f39f2bc35 admin admin] PATH_INFO: `/v3/users/f92f5f21d82b48a2b15d984f74079024` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:38.712450 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61ba40-cc2e-4dd7-95f7-e30f39f2bc35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f92f5f21d82b48a2b15d984f74079024)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:38.714386 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61ba40-cc2e-4dd7-95f7-e30f39f2bc35 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:38.762490 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7b61ba40-cc2e-4dd7-95f7-e30f39f2bc35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f92f5f21d82b48a2b15d984f74079024'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:38.773688 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7b61ba40-cc2e-4dd7-95f7-e30f39f2bc35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f92f5f21d82b48a2b15d984f74079024'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:38.774397 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7b61ba40-cc2e-4dd7-95f7-e30f39f2bc35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f92f5f21d82b48a2b15d984f74079024'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:38.775148 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7b61ba40-cc2e-4dd7-95f7-e30f39f2bc35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f92f5f21d82b48a2b15d984f74079024'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:38.783847 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7b61ba40-cc2e-4dd7-95f7-e30f39f2bc35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f92f5f21d82b48a2b15d984f74079024'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:38.796672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1124/2220] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:38 2022] DELETE /identity/v3/users/f92f5f21d82b48a2b15d984f74079024 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:39.065457 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db467a-b9c5-4b93-b6ef-da085cd0d01b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:39.067145 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-53db467a-b9c5-4b93-b6ef-da085cd0d01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:39.082319 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db467a-b9c5-4b93-b6ef-da085cd0d01b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:39.141223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e093e02-c64d-4076-a047-f58414a33c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:39.142093 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e093e02-c64d-4076-a047-f58414a33c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:39.142377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e093e02-c64d-4076-a047-f58414a33c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:39.142654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e093e02-c64d-4076-a047-f58414a33c2f admin admin] PATH_INFO: `/v3/projects/58e5c344d9ed415a8aa8364d2213a34c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:39.143895 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e093e02-c64d-4076-a047-f58414a33c2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=58e5c344d9ed415a8aa8364d2213a34c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:39.145806 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e093e02-c64d-4076-a047-f58414a33c2f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:39.194801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3e093e02-c64d-4076-a047-f58414a33c2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58e5c344d9ed415a8aa8364d2213a34c', 'request_id': 'req-3e093e02-c64d-4076-a047-f58414a33c2f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:39.200814 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3e093e02-c64d-4076-a047-f58414a33c2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58e5c344d9ed415a8aa8364d2213a34c', 'request_id': 'req-3e093e02-c64d-4076-a047-f58414a33c2f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:39.209563 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3e093e02-c64d-4076-a047-f58414a33c2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58e5c344d9ed415a8aa8364d2213a34c', 'request_id': 'req-3e093e02-c64d-4076-a047-f58414a33c2f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:39.219721 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3e093e02-c64d-4076-a047-f58414a33c2f admin admin] The token cache is being invalidate because project 58e5c344d9ed415a8aa8364d2213a34c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:39.220009 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3e093e02-c64d-4076-a047-f58414a33c2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:39.220625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3e093e02-c64d-4076-a047-f58414a33c2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:39.222200 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1097/2221] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:39 2022] DELETE /identity/v3/projects/58e5c344d9ed415a8aa8364d2213a34c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:39.227296 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797f269-85b6-4ded-a404-f5daae94d4e3 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:39.227573 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797f269-85b6-4ded-a404-f5daae94d4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:39.227853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797f269-85b6-4ded-a404-f5daae94d4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:39.247177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6797f269-85b6-4ded-a404-f5daae94d4e3 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:39.248398 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6797f269-85b6-4ded-a404-f5daae94d4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:39.318678 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1125/2222] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:39.326987 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08bf50-ae8b-4a7a-a60e-3224c7d72fbc None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:39.327291 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08bf50-ae8b-4a7a-a60e-3224c7d72fbc None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:39.327566 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08bf50-ae8b-4a7a-a60e-3224c7d72fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:39.347004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8b08bf50-ae8b-4a7a-a60e-3224c7d72fbc None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:39.348274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8b08bf50-ae8b-4a7a-a60e-3224c7d72fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:39.356905 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1098/2223] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:39.361055 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797f269-85b6-4ded-a404-f5daae94d4e3 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:39.370859 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797f269-85b6-4ded-a404-f5daae94d4e3 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:39.375828 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed4f26-60bd-4b4e-986a-2ca9153285d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:39.376560 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed4f26-60bd-4b4e-986a-2ca9153285d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:39.376843 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed4f26-60bd-4b4e-986a-2ca9153285d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:39.377118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed4f26-60bd-4b4e-986a-2ca9153285d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:39.377844 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed4f26-60bd-4b4e-986a-2ca9153285d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:57:39.378157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed4f26-60bd-4b4e-986a-2ca9153285d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:39.379821 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed4f26-60bd-4b4e-986a-2ca9153285d2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:39.392294 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1126/2224] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:57:39.396739 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08bf50-ae8b-4a7a-a60e-3224c7d72fbc None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:39.406397 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08bf50-ae8b-4a7a-a60e-3224c7d72fbc None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:39.412413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599a3b3-997a-499a-a05d-fdac225ad817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:39.413070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599a3b3-997a-499a-a05d-fdac225ad817 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:39.413348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599a3b3-997a-499a-a05d-fdac225ad817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:39.413618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599a3b3-997a-499a-a05d-fdac225ad817 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:39.414308 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599a3b3-997a-499a-a05d-fdac225ad817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:39.416662 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599a3b3-997a-499a-a05d-fdac225ad817 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:39.445223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1099/2225] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:39 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:39.449524 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed4f26-60bd-4b4e-986a-2ca9153285d2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:39.461121 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed4f26-60bd-4b4e-986a-2ca9153285d2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:39.520427 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe750b3-01aa-4556-83e4-2b8f68c7c088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:39.521102 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe750b3-01aa-4556-83e4-2b8f68c7c088 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:39.521377 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe750b3-01aa-4556-83e4-2b8f68c7c088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:39.521645 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe750b3-01aa-4556-83e4-2b8f68c7c088 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:39.522341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe750b3-01aa-4556-83e4-2b8f68c7c088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:39.524315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe750b3-01aa-4556-83e4-2b8f68c7c088 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:39.544744 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1127/2226] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:39 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:39.549208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599a3b3-997a-499a-a05d-fdac225ad817 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:39.559556 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599a3b3-997a-499a-a05d-fdac225ad817 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:39.564103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff3aba-7e70-4049-b538-dbc135316478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:39.564769 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff3aba-7e70-4049-b538-dbc135316478 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:39.565052 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff3aba-7e70-4049-b538-dbc135316478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:39.565320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff3aba-7e70-4049-b538-dbc135316478 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:39.566041 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff3aba-7e70-4049-b538-dbc135316478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:39.567660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff3aba-7e70-4049-b538-dbc135316478 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:39.578738 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1100/2227] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:39.582848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe750b3-01aa-4556-83e4-2b8f68c7c088 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:39.592918 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe750b3-01aa-4556-83e4-2b8f68c7c088 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:39.597777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05c016-4fa3-43d4-a479-46c4ff981cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:39.598428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05c016-4fa3-43d4-a479-46c4ff981cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:39.598705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05c016-4fa3-43d4-a479-46c4ff981cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:39.599003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05c016-4fa3-43d4-a479-46c4ff981cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:39.599698 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05c016-4fa3-43d4-a479-46c4ff981cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:39.601291 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05c016-4fa3-43d4-a479-46c4ff981cf1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:39.611531 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1128/2228] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:39.615664 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff3aba-7e70-4049-b538-dbc135316478 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:39.625661 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff3aba-7e70-4049-b538-dbc135316478 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:39.630575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15d0f7-e5c7-478f-9aa7-0c1d8d36df38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:39.631508 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15d0f7-e5c7-478f-9aa7-0c1d8d36df38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:39.631794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15d0f7-e5c7-478f-9aa7-0c1d8d36df38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:39.632072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15d0f7-e5c7-478f-9aa7-0c1d8d36df38 admin admin] PATH_INFO: `/v3/projects/835c7be128394768899b2f102a3c696c/users/38291b1856074dcc92c3e40d4130a04e/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:39.647332 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15d0f7-e5c7-478f-9aa7-0c1d8d36df38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=835c7be128394768899b2f102a3c696c, user_id=38291b1856074dcc92c3e40d4130a04e, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:39.649993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15d0f7-e5c7-478f-9aa7-0c1d8d36df38 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:39.665551 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1101/2229] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:39 2022] PUT /identity/v3/projects/835c7be128394768899b2f102a3c696c/users/38291b1856074dcc92c3e40d4130a04e/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:57:39.677168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75ef41-cad2-4a23-b21a-1d7b363b326a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:39.677658 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75ef41-cad2-4a23-b21a-1d7b363b326a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:39.677658 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75ef41-cad2-4a23-b21a-1d7b363b326a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:39.703540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ac75ef41-cad2-4a23-b21a-1d7b363b326a None None] MFA Rules not processed for user `38291b1856074dcc92c3e40d4130a04e`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:39.704740 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ac75ef41-cad2-4a23-b21a-1d7b363b326a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:39.775701 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1129/2230] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:39.780533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15d0f7-e5c7-478f-9aa7-0c1d8d36df38 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:39.844298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15d0f7-e5c7-478f-9aa7-0c1d8d36df38 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:39.850281 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd84ad0-791e-4f32-a84e-cd9629f81e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:39.850954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd84ad0-791e-4f32-a84e-cd9629f81e8a admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:39.851255 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd84ad0-791e-4f32-a84e-cd9629f81e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:39.851530 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd84ad0-791e-4f32-a84e-cd9629f81e8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:39.852225 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd84ad0-791e-4f32-a84e-cd9629f81e8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:39.854202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd84ad0-791e-4f32-a84e-cd9629f81e8a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:39.881325 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1102/2231] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:39 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:39.885528 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75ef41-cad2-4a23-b21a-1d7b363b326a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:39.897061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75ef41-cad2-4a23-b21a-1d7b363b326a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:39.954940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78588818-40d4-480a-a208-a1485ab5fc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:39.955657 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78588818-40d4-480a-a208-a1485ab5fc65 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:39.955943 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78588818-40d4-480a-a208-a1485ab5fc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:39.956200 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78588818-40d4-480a-a208-a1485ab5fc65 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:39.956895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78588818-40d4-480a-a208-a1485ab5fc65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:39.958824 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78588818-40d4-480a-a208-a1485ab5fc65 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:39.984088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1130/2232] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:39 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:39.988158 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd84ad0-791e-4f32-a84e-cd9629f81e8a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:40.001316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd84ad0-791e-4f32-a84e-cd9629f81e8a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:40.006270 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc14183-8651-4f65-96a8-80ef99c112e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:40.007121 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc14183-8651-4f65-96a8-80ef99c112e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:40.007407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc14183-8651-4f65-96a8-80ef99c112e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:40.007681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc14183-8651-4f65-96a8-80ef99c112e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:40.008417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc14183-8651-4f65-96a8-80ef99c112e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:40.010013 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc14183-8651-4f65-96a8-80ef99c112e1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:40.021349 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1103/2233] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:40.025691 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78588818-40d4-480a-a208-a1485ab5fc65 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:40.036168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78588818-40d4-480a-a208-a1485ab5fc65 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:40.041389 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65122296-3d52-4366-a588-a0438f83b3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:40.042300 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65122296-3d52-4366-a588-a0438f83b3ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:40.042580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65122296-3d52-4366-a588-a0438f83b3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:40.042854 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65122296-3d52-4366-a588-a0438f83b3ec admin admin] PATH_INFO: `/v3/projects/b7df2487a8c7468b926606337e570498/users/88ec4f313a9c47c0a0b1da0c2796d550/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:40.058144 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65122296-3d52-4366-a588-a0438f83b3ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7df2487a8c7468b926606337e570498, user_id=88ec4f313a9c47c0a0b1da0c2796d550, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:40.060821 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65122296-3d52-4366-a588-a0438f83b3ec admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:40.075667 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1131/2234] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:40 2022] PUT /identity/v3/projects/b7df2487a8c7468b926606337e570498/users/88ec4f313a9c47c0a0b1da0c2796d550/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:40.081487 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc14183-8651-4f65-96a8-80ef99c112e1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:40.095614 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc14183-8651-4f65-96a8-80ef99c112e1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:40.156297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec61f5d-d175-4d01-9c60-574911573092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:40.156961 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec61f5d-d175-4d01-9c60-574911573092 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:40.157243 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec61f5d-d175-4d01-9c60-574911573092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:40.157516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec61f5d-d175-4d01-9c60-574911573092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:40.158248 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec61f5d-d175-4d01-9c60-574911573092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:40.159904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec61f5d-d175-4d01-9c60-574911573092 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:40.172962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1104/2235] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:40.174217 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65122296-3d52-4366-a588-a0438f83b3ec admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:40.185478 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65122296-3d52-4366-a588-a0438f83b3ec admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:40.190414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592c83d-78c2-4fff-9a4e-3c463b03b315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:40.191337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592c83d-78c2-4fff-9a4e-3c463b03b315 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:40.191642 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592c83d-78c2-4fff-9a4e-3c463b03b315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:40.191912 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592c83d-78c2-4fff-9a4e-3c463b03b315 admin admin] PATH_INFO: `/v3/projects/b7df2487a8c7468b926606337e570498/users/88ec4f313a9c47c0a0b1da0c2796d550/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:40.194004 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592c83d-78c2-4fff-9a4e-3c463b03b315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7df2487a8c7468b926606337e570498, user_id=88ec4f313a9c47c0a0b1da0c2796d550, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:40.196682 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592c83d-78c2-4fff-9a4e-3c463b03b315 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:40.206985 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1132/2236] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:40 2022] PUT /identity/v3/projects/b7df2487a8c7468b926606337e570498/users/88ec4f313a9c47c0a0b1da0c2796d550/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:40.217278 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6aa42d-6675-41b3-84db-0b781f04072c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:40.217570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6aa42d-6675-41b3-84db-0b781f04072c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:40.217848 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6aa42d-6675-41b3-84db-0b781f04072c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:40.243220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5f6aa42d-6675-41b3-84db-0b781f04072c None None] MFA Rules not processed for user `88ec4f313a9c47c0a0b1da0c2796d550`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:40.244410 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5f6aa42d-6675-41b3-84db-0b781f04072c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:40.315168 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1105/2237] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:40 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:57:40.327233 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592c83d-78c2-4fff-9a4e-3c463b03b315 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:40.329250 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c592c83d-78c2-4fff-9a4e-3c463b03b315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:40.388745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592c83d-78c2-4fff-9a4e-3c463b03b315 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:40.393006 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1c4c6-7485-4003-a38d-c423d688395a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:40.393663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1c4c6-7485-4003-a38d-c423d688395a service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:40.393948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1c4c6-7485-4003-a38d-c423d688395a service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:40.394231 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1c4c6-7485-4003-a38d-c423d688395a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:40.404126 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1c4c6-7485-4003-a38d-c423d688395a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:40.405576 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1c4c6-7485-4003-a38d-c423d688395a service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:40.415528 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1133/2238] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:40 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:40.507943 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6aa42d-6675-41b3-84db-0b781f04072c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:40.518265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6aa42d-6675-41b3-84db-0b781f04072c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:40.522299 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49228d7-1c8c-46be-ad8b-5f7c30f20471 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:40.522945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49228d7-1c8c-46be-ad8b-5f7c30f20471 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:40.523265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49228d7-1c8c-46be-ad8b-5f7c30f20471 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:40.523544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49228d7-1c8c-46be-ad8b-5f7c30f20471 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:40.587607 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49228d7-1c8c-46be-ad8b-5f7c30f20471 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:40.588782 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49228d7-1c8c-46be-ad8b-5f7c30f20471 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:40.598091 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1106/2239] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:44.391376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89c5d1-5a79-45c1-879c-d8fafd9b136c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:44.391925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89c5d1-5a79-45c1-879c-d8fafd9b136c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:44.392106 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89c5d1-5a79-45c1-879c-d8fafd9b136c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:44.412153 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0a89c5d1-5a79-45c1-879c-d8fafd9b136c None None] MFA Rules not processed for user `e50be91ec9bf4ad8ad6f876e2caec585`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:44.413384 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0a89c5d1-5a79-45c1-879c-d8fafd9b136c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:44.481487 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1134/2240] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:47.435507 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49228d7-1c8c-46be-ad8b-5f7c30f20471 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:47.437261 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e49228d7-1c8c-46be-ad8b-5f7c30f20471 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:47.525179 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49228d7-1c8c-46be-ad8b-5f7c30f20471 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:47.529924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37be9f-9230-4fd7-8f69-dfacf1565bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:47.530811 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37be9f-9230-4fd7-8f69-dfacf1565bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:47.531124 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37be9f-9230-4fd7-8f69-dfacf1565bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:47.531401 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37be9f-9230-4fd7-8f69-dfacf1565bd9 admin admin] PATH_INFO: `/v3/users/e79d709ab94b4ce9ac0dd3b6b1873257` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:47.532606 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37be9f-9230-4fd7-8f69-dfacf1565bd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e79d709ab94b4ce9ac0dd3b6b1873257)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:47.534543 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37be9f-9230-4fd7-8f69-dfacf1565bd9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:47.599800 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3d37be9f-9230-4fd7-8f69-dfacf1565bd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e79d709ab94b4ce9ac0dd3b6b1873257'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:47.617744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3d37be9f-9230-4fd7-8f69-dfacf1565bd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e79d709ab94b4ce9ac0dd3b6b1873257'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:47.618649 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3d37be9f-9230-4fd7-8f69-dfacf1565bd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e79d709ab94b4ce9ac0dd3b6b1873257'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:47.620739 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3d37be9f-9230-4fd7-8f69-dfacf1565bd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e79d709ab94b4ce9ac0dd3b6b1873257'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:47.643084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3d37be9f-9230-4fd7-8f69-dfacf1565bd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e79d709ab94b4ce9ac0dd3b6b1873257'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:47.664062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1107/2241] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:47 2022] DELETE /identity/v3/users/e79d709ab94b4ce9ac0dd3b6b1873257 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:47.666169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33978b58-e825-476a-b4c4-524783aa468f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:47.666630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33978b58-e825-476a-b4c4-524783aa468f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:47.666746 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33978b58-e825-476a-b4c4-524783aa468f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:47.687895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-33978b58-e825-476a-b4c4-524783aa468f None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:47.689478 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-33978b58-e825-476a-b4c4-524783aa468f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:47.767082 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1135/2242] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:47.783117 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37be9f-9230-4fd7-8f69-dfacf1565bd9 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:47.784024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3d37be9f-9230-4fd7-8f69-dfacf1565bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:47.872581 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37be9f-9230-4fd7-8f69-dfacf1565bd9 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:47.880073 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a27fae-c754-4730-b482-5b7f18ddba4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:47.880918 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a27fae-c754-4730-b482-5b7f18ddba4e service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:47.881283 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a27fae-c754-4730-b482-5b7f18ddba4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:47.881614 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a27fae-c754-4730-b482-5b7f18ddba4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:47.892333 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a27fae-c754-4730-b482-5b7f18ddba4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:47.893912 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a27fae-c754-4730-b482-5b7f18ddba4e service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:47.904969 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1108/2243] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:48.507329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33978b58-e825-476a-b4c4-524783aa468f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:48.508997 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-33978b58-e825-476a-b4c4-524783aa468f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:48.529645 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33978b58-e825-476a-b4c4-524783aa468f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:48.543870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d999e8-bf3d-4c9e-9326-f68c3868d1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:48.545807 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d999e8-bf3d-4c9e-9326-f68c3868d1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:48.546165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d999e8-bf3d-4c9e-9326-f68c3868d1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:48.546544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d999e8-bf3d-4c9e-9326-f68c3868d1fd admin admin] PATH_INFO: `/v3/projects/46adde8a20c04597972b01b605bbf20d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:48.548069 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d999e8-bf3d-4c9e-9326-f68c3868d1fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=46adde8a20c04597972b01b605bbf20d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:48.560491 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d999e8-bf3d-4c9e-9326-f68c3868d1fd admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:48.612853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-44d999e8-bf3d-4c9e-9326-f68c3868d1fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46adde8a20c04597972b01b605bbf20d', 'request_id': 'req-44d999e8-bf3d-4c9e-9326-f68c3868d1fd'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:48.619158 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-44d999e8-bf3d-4c9e-9326-f68c3868d1fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46adde8a20c04597972b01b605bbf20d', 'request_id': 'req-44d999e8-bf3d-4c9e-9326-f68c3868d1fd'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:48.632770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-44d999e8-bf3d-4c9e-9326-f68c3868d1fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46adde8a20c04597972b01b605bbf20d', 'request_id': 'req-44d999e8-bf3d-4c9e-9326-f68c3868d1fd'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:48.647732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-44d999e8-bf3d-4c9e-9326-f68c3868d1fd admin admin] The token cache is being invalidate because project 46adde8a20c04597972b01b605bbf20d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:48.648377 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-44d999e8-bf3d-4c9e-9326-f68c3868d1fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:48.649073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-44d999e8-bf3d-4c9e-9326-f68c3868d1fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:48.650692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1136/2244] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:48 2022] DELETE /identity/v3/projects/46adde8a20c04597972b01b605bbf20d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:48.655960 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e2398-8237-4c99-b641-49ef77f61b3e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:48.656539 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e2398-8237-4c99-b641-49ef77f61b3e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:48.656539 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e2398-8237-4c99-b641-49ef77f61b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:48.675097 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-821e2398-8237-4c99-b641-49ef77f61b3e None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:48.676566 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-821e2398-8237-4c99-b641-49ef77f61b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:48.754897 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1109/2245] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:48.762563 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c300351-7d9f-4959-ac32-5cc828bd6170 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:48.763144 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c300351-7d9f-4959-ac32-5cc828bd6170 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:48.763468 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c300351-7d9f-4959-ac32-5cc828bd6170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:48.799745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9c300351-7d9f-4959-ac32-5cc828bd6170 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:48.801123 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9c300351-7d9f-4959-ac32-5cc828bd6170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:48.818265 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1137/2246] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:48.823064 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e2398-8237-4c99-b641-49ef77f61b3e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:48.833496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e2398-8237-4c99-b641-49ef77f61b3e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:48.838265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee873e70-5bcb-42f4-8ff2-aedd48af7b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:48.839009 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee873e70-5bcb-42f4-8ff2-aedd48af7b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:48.839333 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee873e70-5bcb-42f4-8ff2-aedd48af7b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:48.839613 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee873e70-5bcb-42f4-8ff2-aedd48af7b42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:48.840373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee873e70-5bcb-42f4-8ff2-aedd48af7b42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:57:48.840729 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee873e70-5bcb-42f4-8ff2-aedd48af7b42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:48.842459 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee873e70-5bcb-42f4-8ff2-aedd48af7b42 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:48.853983 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1110/2247] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:57:48.858630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c300351-7d9f-4959-ac32-5cc828bd6170 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:48.868199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c300351-7d9f-4959-ac32-5cc828bd6170 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:48.882085 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8d3e5-1690-4e52-bd50-e3b354dc0191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:48.882823 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8d3e5-1690-4e52-bd50-e3b354dc0191 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:48.883160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8d3e5-1690-4e52-bd50-e3b354dc0191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:48.883434 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8d3e5-1690-4e52-bd50-e3b354dc0191 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:48.884139 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8d3e5-1690-4e52-bd50-e3b354dc0191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:48.886063 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8d3e5-1690-4e52-bd50-e3b354dc0191 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:48.913711 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1138/2248] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:48 2022] POST /identity/v3/projects => generated 361 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:48.918304 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee873e70-5bcb-42f4-8ff2-aedd48af7b42 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:48.929290 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee873e70-5bcb-42f4-8ff2-aedd48af7b42 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:48.997044 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a9e41-21e4-4509-b337-3f28c93b2211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:48.997926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a9e41-21e4-4509-b337-3f28c93b2211 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:48.998208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a9e41-21e4-4509-b337-3f28c93b2211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:48.998482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a9e41-21e4-4509-b337-3f28c93b2211 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:48.999231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a9e41-21e4-4509-b337-3f28c93b2211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:49.001240 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a9e41-21e4-4509-b337-3f28c93b2211 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:49.022742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1111/2249] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:48 2022] POST /identity/v3/users => generated 281 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:49.036559 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8d3e5-1690-4e52-bd50-e3b354dc0191 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:49.052514 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8d3e5-1690-4e52-bd50-e3b354dc0191 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:49.057747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c499f8-1587-48d9-9ea7-081110ae1d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:49.058491 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c499f8-1587-48d9-9ea7-081110ae1d51 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:49.058843 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c499f8-1587-48d9-9ea7-081110ae1d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:49.059214 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c499f8-1587-48d9-9ea7-081110ae1d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:49.060094 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c499f8-1587-48d9-9ea7-081110ae1d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:49.061709 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c499f8-1587-48d9-9ea7-081110ae1d51 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:49.075274 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1139/2250] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:49.078106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a9e41-21e4-4509-b337-3f28c93b2211 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:49.092650 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a9e41-21e4-4509-b337-3f28c93b2211 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:49.099303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007375d6-51b9-4d21-9d1a-9aa421ade29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:49.099982 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007375d6-51b9-4d21-9d1a-9aa421ade29b admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:49.100257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007375d6-51b9-4d21-9d1a-9aa421ade29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:49.100529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007375d6-51b9-4d21-9d1a-9aa421ade29b admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:49.101543 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007375d6-51b9-4d21-9d1a-9aa421ade29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:49.103165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007375d6-51b9-4d21-9d1a-9aa421ade29b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:49.116538 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1112/2251] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:57:49.120781 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c499f8-1587-48d9-9ea7-081110ae1d51 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:49.131237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c499f8-1587-48d9-9ea7-081110ae1d51 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:49.136578 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5820046-cba3-4016-8863-713393693a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:49.137517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5820046-cba3-4016-8863-713393693a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:49.137814 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5820046-cba3-4016-8863-713393693a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:49.138094 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5820046-cba3-4016-8863-713393693a35 admin admin] PATH_INFO: `/v3/projects/e0cf1f59136146bcbe743c00074fcf85/users/0a3ab78e2dda427a89a8af786a5d813c/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:49.153788 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5820046-cba3-4016-8863-713393693a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0cf1f59136146bcbe743c00074fcf85, user_id=0a3ab78e2dda427a89a8af786a5d813c, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:49.156806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5820046-cba3-4016-8863-713393693a35 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:49.171828 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1140/2252] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:49 2022] PUT /identity/v3/projects/e0cf1f59136146bcbe743c00074fcf85/users/0a3ab78e2dda427a89a8af786a5d813c/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:49.182343 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b4d2b-fcd4-42fb-981a-b0c61cd4e006 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:49.182665 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b4d2b-fcd4-42fb-981a-b0c61cd4e006 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:49.183089 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b4d2b-fcd4-42fb-981a-b0c61cd4e006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:49.213612 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f41b4d2b-fcd4-42fb-981a-b0c61cd4e006 None None] MFA Rules not processed for user `0a3ab78e2dda427a89a8af786a5d813c`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:49.214857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f41b4d2b-fcd4-42fb-981a-b0c61cd4e006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:49.283499 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1113/2253] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:49.317222 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5820046-cba3-4016-8863-713393693a35 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:49.319545 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b5820046-cba3-4016-8863-713393693a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:49.399463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5820046-cba3-4016-8863-713393693a35 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:49.403409 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6198f4-dfa8-48ca-93aa-0e6fcbe1f134 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:49.404217 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6198f4-dfa8-48ca-93aa-0e6fcbe1f134 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:49.404498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6198f4-dfa8-48ca-93aa-0e6fcbe1f134 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:49.404769 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6198f4-dfa8-48ca-93aa-0e6fcbe1f134 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:49.414432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6198f4-dfa8-48ca-93aa-0e6fcbe1f134 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:49.415984 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6198f4-dfa8-48ca-93aa-0e6fcbe1f134 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:49.426837 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1141/2254] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:49.441913 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b4d2b-fcd4-42fb-981a-b0c61cd4e006 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:49.522159 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b4d2b-fcd4-42fb-981a-b0c61cd4e006 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:49.533231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4987d6e-912e-410c-8ef3-f0e271bf4270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:49.533770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4987d6e-912e-410c-8ef3-f0e271bf4270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:49.534186 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4987d6e-912e-410c-8ef3-f0e271bf4270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:49.534474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4987d6e-912e-410c-8ef3-f0e271bf4270 admin admin] PATH_INFO: `/v3/users/0a3ab78e2dda427a89a8af786a5d813c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:49.535714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4987d6e-912e-410c-8ef3-f0e271bf4270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a3ab78e2dda427a89a8af786a5d813c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:49.537933 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4987d6e-912e-410c-8ef3-f0e271bf4270 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:49.621610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d4987d6e-912e-410c-8ef3-f0e271bf4270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a3ab78e2dda427a89a8af786a5d813c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:49.637962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d4987d6e-912e-410c-8ef3-f0e271bf4270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a3ab78e2dda427a89a8af786a5d813c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:49.639526 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d4987d6e-912e-410c-8ef3-f0e271bf4270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a3ab78e2dda427a89a8af786a5d813c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:49.640463 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d4987d6e-912e-410c-8ef3-f0e271bf4270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a3ab78e2dda427a89a8af786a5d813c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:49.649366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d4987d6e-912e-410c-8ef3-f0e271bf4270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a3ab78e2dda427a89a8af786a5d813c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:49.666488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1114/2255] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:49 2022] DELETE /identity/v3/users/0a3ab78e2dda427a89a8af786a5d813c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:49.672336 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82c0ed-dfd2-44ff-861c-8bbed59ed6ad None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:49.672867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82c0ed-dfd2-44ff-861c-8bbed59ed6ad None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:49.673325 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82c0ed-dfd2-44ff-861c-8bbed59ed6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:49.708023 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-eb82c0ed-dfd2-44ff-861c-8bbed59ed6ad None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:49.710426 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-eb82c0ed-dfd2-44ff-861c-8bbed59ed6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:49.790812 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1142/2256] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:49.801210 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4987d6e-912e-410c-8ef3-f0e271bf4270 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:49.802705 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d4987d6e-912e-410c-8ef3-f0e271bf4270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:49.869562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4987d6e-912e-410c-8ef3-f0e271bf4270 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:49.876246 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ec041-8fe6-4fd0-a534-cb037a5b7b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:49.877422 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ec041-8fe6-4fd0-a534-cb037a5b7b66 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:49.877710 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ec041-8fe6-4fd0-a534-cb037a5b7b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:49.878063 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ec041-8fe6-4fd0-a534-cb037a5b7b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:49.895276 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ec041-8fe6-4fd0-a534-cb037a5b7b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:49.897763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ec041-8fe6-4fd0-a534-cb037a5b7b66 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:49.909688 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1115/2257] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:50.010154 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82c0ed-dfd2-44ff-861c-8bbed59ed6ad None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:50.012058 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-eb82c0ed-dfd2-44ff-861c-8bbed59ed6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:50.026061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82c0ed-dfd2-44ff-861c-8bbed59ed6ad None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:50.032516 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad9d5b-edca-479b-b82d-83d17ea1545f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:50.033726 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad9d5b-edca-479b-b82d-83d17ea1545f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:50.034258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad9d5b-edca-479b-b82d-83d17ea1545f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:50.034782 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad9d5b-edca-479b-b82d-83d17ea1545f admin admin] PATH_INFO: `/v3/users/38291b1856074dcc92c3e40d4130a04e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:50.036271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad9d5b-edca-479b-b82d-83d17ea1545f admin admin] RBAC: Authorizing `identity:delete_user(user_id=38291b1856074dcc92c3e40d4130a04e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:50.038490 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad9d5b-edca-479b-b82d-83d17ea1545f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:50.112977 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ddad9d5b-edca-479b-b82d-83d17ea1545f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38291b1856074dcc92c3e40d4130a04e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:50.151408 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ddad9d5b-edca-479b-b82d-83d17ea1545f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38291b1856074dcc92c3e40d4130a04e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:50.152159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ddad9d5b-edca-479b-b82d-83d17ea1545f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38291b1856074dcc92c3e40d4130a04e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:50.153907 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ddad9d5b-edca-479b-b82d-83d17ea1545f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38291b1856074dcc92c3e40d4130a04e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:50.167112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ddad9d5b-edca-479b-b82d-83d17ea1545f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38291b1856074dcc92c3e40d4130a04e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:50.183082 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1143/2258] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:50 2022] DELETE /identity/v3/users/38291b1856074dcc92c3e40d4130a04e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:50.188052 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec6fb5-afbe-4bc6-8333-6b741755e31f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:50.188376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec6fb5-afbe-4bc6-8333-6b741755e31f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:50.190836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec6fb5-afbe-4bc6-8333-6b741755e31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:50.220886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-49ec6fb5-afbe-4bc6-8333-6b741755e31f None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:50.223068 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-49ec6fb5-afbe-4bc6-8333-6b741755e31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:50.255383 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad9d5b-edca-479b-b82d-83d17ea1545f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:50.257271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ddad9d5b-edca-479b-b82d-83d17ea1545f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:50.310644 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1116/2259] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:50.321937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec6fb5-afbe-4bc6-8333-6b741755e31f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:50.324350 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-49ec6fb5-afbe-4bc6-8333-6b741755e31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:50.405617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad9d5b-edca-479b-b82d-83d17ea1545f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:50.407394 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec6fb5-afbe-4bc6-8333-6b741755e31f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:50.423189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e80ecf-bbc9-4522-b520-5e0c363a4af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:50.424553 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e80ecf-bbc9-4522-b520-5e0c363a4af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:50.424911 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e80ecf-bbc9-4522-b520-5e0c363a4af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:50.426578 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e80ecf-bbc9-4522-b520-5e0c363a4af0 admin admin] PATH_INFO: `/v3/projects/e0cf1f59136146bcbe743c00074fcf85` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:50.428735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e80ecf-bbc9-4522-b520-5e0c363a4af0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0cf1f59136146bcbe743c00074fcf85)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:50.431841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e80ecf-bbc9-4522-b520-5e0c363a4af0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:50.432940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89d4bf-4053-4f65-837c-c60671600f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:50.433682 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89d4bf-4053-4f65-837c-c60671600f15 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:50.434031 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89d4bf-4053-4f65-837c-c60671600f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:50.434435 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89d4bf-4053-4f65-837c-c60671600f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:50.446594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89d4bf-4053-4f65-837c-c60671600f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:50.448147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89d4bf-4053-4f65-837c-c60671600f15 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:50.458701 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1117/2260] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:50.507148 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-78e80ecf-bbc9-4522-b520-5e0c363a4af0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0cf1f59136146bcbe743c00074fcf85', 'request_id': 'req-78e80ecf-bbc9-4522-b520-5e0c363a4af0'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:50.513322 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-78e80ecf-bbc9-4522-b520-5e0c363a4af0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0cf1f59136146bcbe743c00074fcf85', 'request_id': 'req-78e80ecf-bbc9-4522-b520-5e0c363a4af0'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:50.524606 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-78e80ecf-bbc9-4522-b520-5e0c363a4af0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0cf1f59136146bcbe743c00074fcf85', 'request_id': 'req-78e80ecf-bbc9-4522-b520-5e0c363a4af0'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:50.540032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-78e80ecf-bbc9-4522-b520-5e0c363a4af0 admin admin] The token cache is being invalidate because project e0cf1f59136146bcbe743c00074fcf85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:50.540383 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-78e80ecf-bbc9-4522-b520-5e0c363a4af0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:50.541322 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-78e80ecf-bbc9-4522-b520-5e0c363a4af0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:50.543132 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1144/2261] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:50 2022] DELETE /identity/v3/projects/e0cf1f59136146bcbe743c00074fcf85 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:57:50.551902 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaabdce-8cfe-433f-87ef-c29a7d81500e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:50.551902 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaabdce-8cfe-433f-87ef-c29a7d81500e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:50.551902 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaabdce-8cfe-433f-87ef-c29a7d81500e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:50.569189 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-baaabdce-8cfe-433f-87ef-c29a7d81500e None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:50.570437 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-baaabdce-8cfe-433f-87ef-c29a7d81500e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:50.636734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1118/2262] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:50.645047 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cb8dc-5452-467c-ae84-a69973a07a97 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:50.645337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cb8dc-5452-467c-ae84-a69973a07a97 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:50.645624 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cb8dc-5452-467c-ae84-a69973a07a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:50.668165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-851cb8dc-5452-467c-ae84-a69973a07a97 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:50.672703 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-851cb8dc-5452-467c-ae84-a69973a07a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:50.679402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1145/2263] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:50.684092 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaabdce-8cfe-433f-87ef-c29a7d81500e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:50.700922 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaabdce-8cfe-433f-87ef-c29a7d81500e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:50.706351 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ed9e1-8c91-47f4-8ecd-5e723fc7a459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:50.706611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ed9e1-8c91-47f4-8ecd-5e723fc7a459 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:50.706921 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ed9e1-8c91-47f4-8ecd-5e723fc7a459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:50.707246 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ed9e1-8c91-47f4-8ecd-5e723fc7a459 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:50.707946 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ed9e1-8c91-47f4-8ecd-5e723fc7a459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:57:50.708249 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ed9e1-8c91-47f4-8ecd-5e723fc7a459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:50.709839 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ed9e1-8c91-47f4-8ecd-5e723fc7a459 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:50.725534 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1119/2264] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:57:50.732496 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851cb8dc-5452-467c-ae84-a69973a07a97 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:50.744485 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851cb8dc-5452-467c-ae84-a69973a07a97 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:50.749741 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0d76a-f25d-427f-b76b-dd6427a6d841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:50.750491 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0d76a-f25d-427f-b76b-dd6427a6d841 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:50.750837 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0d76a-f25d-427f-b76b-dd6427a6d841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:50.751228 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0d76a-f25d-427f-b76b-dd6427a6d841 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:50.752002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0d76a-f25d-427f-b76b-dd6427a6d841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:50.753921 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0d76a-f25d-427f-b76b-dd6427a6d841 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:50.785124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1146/2265] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:50 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:50.789701 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ed9e1-8c91-47f4-8ecd-5e723fc7a459 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:50.802808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ed9e1-8c91-47f4-8ecd-5e723fc7a459 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:50.885383 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83af643-bfaf-4133-93b3-bde8d233da4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:50.886361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0d76a-f25d-427f-b76b-dd6427a6d841 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:50.887404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83af643-bfaf-4133-93b3-bde8d233da4a admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:50.887863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83af643-bfaf-4133-93b3-bde8d233da4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:50.888392 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83af643-bfaf-4133-93b3-bde8d233da4a admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:50.889660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83af643-bfaf-4133-93b3-bde8d233da4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:50.890391 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e2c0d76a-f25d-427f-b76b-dd6427a6d841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:50.893268 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83af643-bfaf-4133-93b3-bde8d233da4a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:50.913400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0d76a-f25d-427f-b76b-dd6427a6d841 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:50.924995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb75d7-6f70-44fe-936e-fa796ecd984c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:50.925309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1120/2266] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:50 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:50.925994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb75d7-6f70-44fe-936e-fa796ecd984c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:50.927107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb75d7-6f70-44fe-936e-fa796ecd984c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:50.927248 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb75d7-6f70-44fe-936e-fa796ecd984c admin admin] PATH_INFO: `/v3/projects/835c7be128394768899b2f102a3c696c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:50.929724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb75d7-6f70-44fe-936e-fa796ecd984c admin admin] RBAC: Authorizing `identity:delete_project(project_id=835c7be128394768899b2f102a3c696c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:50.931107 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83af643-bfaf-4133-93b3-bde8d233da4a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:50.932315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb75d7-6f70-44fe-936e-fa796ecd984c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:50.942597 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83af643-bfaf-4133-93b3-bde8d233da4a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:50.949297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c224be-99a0-4912-8818-b62b9f57750f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:50.950703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c224be-99a0-4912-8818-b62b9f57750f admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:50.951503 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c224be-99a0-4912-8818-b62b9f57750f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:50.951926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c224be-99a0-4912-8818-b62b9f57750f admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:50.952800 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c224be-99a0-4912-8818-b62b9f57750f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:50.955196 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c224be-99a0-4912-8818-b62b9f57750f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:50.971826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1121/2267] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:50.972969 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c224be-99a0-4912-8818-b62b9f57750f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:50.985848 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c224be-99a0-4912-8818-b62b9f57750f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:51.005408 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6bdb75d7-6f70-44fe-936e-fa796ecd984c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '835c7be128394768899b2f102a3c696c', 'request_id': 'req-6bdb75d7-6f70-44fe-936e-fa796ecd984c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:51.012642 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6bdb75d7-6f70-44fe-936e-fa796ecd984c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '835c7be128394768899b2f102a3c696c', 'request_id': 'req-6bdb75d7-6f70-44fe-936e-fa796ecd984c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:51.021897 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6bdb75d7-6f70-44fe-936e-fa796ecd984c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '835c7be128394768899b2f102a3c696c', 'request_id': 'req-6bdb75d7-6f70-44fe-936e-fa796ecd984c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:51.035715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6bdb75d7-6f70-44fe-936e-fa796ecd984c admin admin] The token cache is being invalidate because project 835c7be128394768899b2f102a3c696c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:51.036003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6bdb75d7-6f70-44fe-936e-fa796ecd984c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:51.037297 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6bdb75d7-6f70-44fe-936e-fa796ecd984c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:51.039008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1147/2268] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:50 2022] DELETE /identity/v3/projects/835c7be128394768899b2f102a3c696c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:51.042922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb75d7-6f70-44fe-936e-fa796ecd984c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:51.044693 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6bdb75d7-6f70-44fe-936e-fa796ecd984c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:51.054446 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181d23a-c11a-4ea8-b467-23fd96fe14ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:51.055142 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181d23a-c11a-4ea8-b467-23fd96fe14ef admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:51.055394 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181d23a-c11a-4ea8-b467-23fd96fe14ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:51.056223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181d23a-c11a-4ea8-b467-23fd96fe14ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:51.056966 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181d23a-c11a-4ea8-b467-23fd96fe14ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:51.058586 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181d23a-c11a-4ea8-b467-23fd96fe14ef admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:51.075993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1122/2269] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:51.077459 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181d23a-c11a-4ea8-b467-23fd96fe14ef admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:51.082184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7181d23a-c11a-4ea8-b467-23fd96fe14ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:51.093840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181d23a-c11a-4ea8-b467-23fd96fe14ef admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:51.098787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1edd4-b452-49da-ad71-ea38658f4f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:51.099724 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1edd4-b452-49da-ad71-ea38658f4f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:51.100004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1edd4-b452-49da-ad71-ea38658f4f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:51.100546 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1edd4-b452-49da-ad71-ea38658f4f2f admin admin] PATH_INFO: `/v3/projects/1b9c5af7cbd140d0a1b13b77f53eb9d3/users/35c313dff3de48a4921c039937812aab/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:51.118689 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1edd4-b452-49da-ad71-ea38658f4f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b9c5af7cbd140d0a1b13b77f53eb9d3, user_id=35c313dff3de48a4921c039937812aab, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:51.121689 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1edd4-b452-49da-ad71-ea38658f4f2f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:51.129691 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb75d7-6f70-44fe-936e-fa796ecd984c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:51.136379 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b71c5-1d36-4c6d-a73c-bc3b14d69418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:51.136976 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1123/2270] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:51 2022] PUT /identity/v3/projects/1b9c5af7cbd140d0a1b13b77f53eb9d3/users/35c313dff3de48a4921c039937812aab/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:51.138014 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b71c5-1d36-4c6d-a73c-bc3b14d69418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:51.138302 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b71c5-1d36-4c6d-a73c-bc3b14d69418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:51.138596 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b71c5-1d36-4c6d-a73c-bc3b14d69418 admin admin] PATH_INFO: `/v3/users/88ec4f313a9c47c0a0b1da0c2796d550` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:51.140814 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b71c5-1d36-4c6d-a73c-bc3b14d69418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88ec4f313a9c47c0a0b1da0c2796d550)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:51.142322 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918be209-ce9b-4c69-9462-4e5ca8373a5d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:51.142712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918be209-ce9b-4c69-9462-4e5ca8373a5d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:51.142846 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b71c5-1d36-4c6d-a73c-bc3b14d69418 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:51.143250 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918be209-ce9b-4c69-9462-4e5ca8373a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:51.164742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-918be209-ce9b-4c69-9462-4e5ca8373a5d None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:51.166693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-918be209-ce9b-4c69-9462-4e5ca8373a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:51.198478 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d50b71c5-1d36-4c6d-a73c-bc3b14d69418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88ec4f313a9c47c0a0b1da0c2796d550'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:51.212683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d50b71c5-1d36-4c6d-a73c-bc3b14d69418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88ec4f313a9c47c0a0b1da0c2796d550'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:51.213450 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d50b71c5-1d36-4c6d-a73c-bc3b14d69418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88ec4f313a9c47c0a0b1da0c2796d550'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:51.214069 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d50b71c5-1d36-4c6d-a73c-bc3b14d69418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88ec4f313a9c47c0a0b1da0c2796d550'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:51.224765 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d50b71c5-1d36-4c6d-a73c-bc3b14d69418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88ec4f313a9c47c0a0b1da0c2796d550'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:51.236819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1124/2271] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:57:51.243770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918be209-ce9b-4c69-9462-4e5ca8373a5d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:51.245722 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1148/2272] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:51 2022] DELETE /identity/v3/users/88ec4f313a9c47c0a0b1da0c2796d550 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:57:51.247244 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-918be209-ce9b-4c69-9462-4e5ca8373a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:51.316919 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918be209-ce9b-4c69-9462-4e5ca8373a5d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:51.376049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfab8a-2c38-4c1e-809e-76ae4fe1377d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:51.377095 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfab8a-2c38-4c1e-809e-76ae4fe1377d service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:51.377447 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfab8a-2c38-4c1e-809e-76ae4fe1377d service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:51.377797 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfab8a-2c38-4c1e-809e-76ae4fe1377d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:51.451263 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfab8a-2c38-4c1e-809e-76ae4fe1377d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:51.453664 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfab8a-2c38-4c1e-809e-76ae4fe1377d service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:51.463620 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1125/2273] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:57:51.578323 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b71c5-1d36-4c6d-a73c-bc3b14d69418 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:51.580090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d50b71c5-1d36-4c6d-a73c-bc3b14d69418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:51.600339 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b71c5-1d36-4c6d-a73c-bc3b14d69418 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:51.623138 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f50e09-ed85-4eba-ab45-f877c08dcb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:51.624294 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f50e09-ed85-4eba-ab45-f877c08dcb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:51.624644 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f50e09-ed85-4eba-ab45-f877c08dcb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:51.625137 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f50e09-ed85-4eba-ab45-f877c08dcb77 admin admin] PATH_INFO: `/v3/projects/b7df2487a8c7468b926606337e570498` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:51.627784 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f50e09-ed85-4eba-ab45-f877c08dcb77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7df2487a8c7468b926606337e570498)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:51.632727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f50e09-ed85-4eba-ab45-f877c08dcb77 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:51.696662 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a1f50e09-ed85-4eba-ab45-f877c08dcb77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7df2487a8c7468b926606337e570498', 'request_id': 'req-a1f50e09-ed85-4eba-ab45-f877c08dcb77'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:51.704947 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a1f50e09-ed85-4eba-ab45-f877c08dcb77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7df2487a8c7468b926606337e570498', 'request_id': 'req-a1f50e09-ed85-4eba-ab45-f877c08dcb77'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:51.716386 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a1f50e09-ed85-4eba-ab45-f877c08dcb77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7df2487a8c7468b926606337e570498', 'request_id': 'req-a1f50e09-ed85-4eba-ab45-f877c08dcb77'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:51.729475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a1f50e09-ed85-4eba-ab45-f877c08dcb77 admin admin] The token cache is being invalidate because project b7df2487a8c7468b926606337e570498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:51.730534 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a1f50e09-ed85-4eba-ab45-f877c08dcb77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:51.731385 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a1f50e09-ed85-4eba-ab45-f877c08dcb77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:51.733242 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1149/2274] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:51 2022] DELETE /identity/v3/projects/b7df2487a8c7468b926606337e570498 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:51.738231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a8a74-9eba-4164-875f-6be9af6d3ad4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:51.738770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a8a74-9eba-4164-875f-6be9af6d3ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:51.738770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a8a74-9eba-4164-875f-6be9af6d3ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:51.757717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a83a8a74-9eba-4164-875f-6be9af6d3ad4 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:51.758983 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a83a8a74-9eba-4164-875f-6be9af6d3ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:51.828855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1126/2275] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:51.836860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a5a2b-5e95-4a02-8f91-af52adb8e502 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:51.837229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a5a2b-5e95-4a02-8f91-af52adb8e502 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:51.837623 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a5a2b-5e95-4a02-8f91-af52adb8e502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:51.856538 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ea8a5a2b-5e95-4a02-8f91-af52adb8e502 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:51.858198 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ea8a5a2b-5e95-4a02-8f91-af52adb8e502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:51.868269 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1150/2276] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:57:51.872568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a8a74-9eba-4164-875f-6be9af6d3ad4 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:51.907703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a8a74-9eba-4164-875f-6be9af6d3ad4 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:51.916142 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623495b6-9f2a-49c1-91a7-db548727effe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:51.917383 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623495b6-9f2a-49c1-91a7-db548727effe admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:51.917383 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623495b6-9f2a-49c1-91a7-db548727effe admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:51.917383 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623495b6-9f2a-49c1-91a7-db548727effe admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:51.919940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623495b6-9f2a-49c1-91a7-db548727effe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:57:51.920661 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623495b6-9f2a-49c1-91a7-db548727effe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:51.922323 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623495b6-9f2a-49c1-91a7-db548727effe admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:51.941592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1127/2277] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:57:51.942783 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a5a2b-5e95-4a02-8f91-af52adb8e502 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:51.952877 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a5a2b-5e95-4a02-8f91-af52adb8e502 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:51.960454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6254a-8a33-41fa-8a7a-095952776cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:51.961797 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6254a-8a33-41fa-8a7a-095952776cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:51.962253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6254a-8a33-41fa-8a7a-095952776cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:51.962681 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6254a-8a33-41fa-8a7a-095952776cc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:51.964034 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6254a-8a33-41fa-8a7a-095952776cc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:51.966980 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6254a-8a33-41fa-8a7a-095952776cc8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:52.007921 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4729b-1747-42d6-8dcc-30cd712e767a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:52.008209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4729b-1747-42d6-8dcc-30cd712e767a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:52.008482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4729b-1747-42d6-8dcc-30cd712e767a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:52.015005 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1151/2278] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:51 2022] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:52.019745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6254a-8a33-41fa-8a7a-095952776cc8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:52.036300 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8ab4729b-1747-42d6-8dcc-30cd712e767a None None] MFA Rules not processed for user `63548f8706214c4e9b116dfd89fc0372`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:52.038075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8ab4729b-1747-42d6-8dcc-30cd712e767a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:52.121326 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1128/2279] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:57:52.128530 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6254a-8a33-41fa-8a7a-095952776cc8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:52.137626 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44082c9-508f-4ba6-b464-319ef52bb92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:52.138316 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44082c9-508f-4ba6-b464-319ef52bb92a admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:52.138599 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44082c9-508f-4ba6-b464-319ef52bb92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:52.138874 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44082c9-508f-4ba6-b464-319ef52bb92a admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:52.139647 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44082c9-508f-4ba6-b464-319ef52bb92a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:52.142044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44082c9-508f-4ba6-b464-319ef52bb92a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:52.165319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1152/2280] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:52 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:52.169671 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4729b-1747-42d6-8dcc-30cd712e767a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:52.183765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4729b-1747-42d6-8dcc-30cd712e767a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:52.188997 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0232caa-1ce9-498f-96ba-3199d3b9d3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:52.189669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0232caa-1ce9-498f-96ba-3199d3b9d3ce admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:52.189949 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0232caa-1ce9-498f-96ba-3199d3b9d3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:52.190225 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0232caa-1ce9-498f-96ba-3199d3b9d3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:52.190949 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0232caa-1ce9-498f-96ba-3199d3b9d3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:52.192614 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0232caa-1ce9-498f-96ba-3199d3b9d3ce admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:52.206214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1129/2281] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:57:52.207706 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44082c9-508f-4ba6-b464-319ef52bb92a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:52.218700 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44082c9-508f-4ba6-b464-319ef52bb92a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:52.224218 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f144121-4e01-442d-b1d4-76ad4a4f03b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:52.224898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f144121-4e01-442d-b1d4-76ad4a4f03b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:52.225185 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f144121-4e01-442d-b1d4-76ad4a4f03b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:52.225465 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f144121-4e01-442d-b1d4-76ad4a4f03b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:52.227109 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f144121-4e01-442d-b1d4-76ad4a4f03b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:52.227831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f144121-4e01-442d-b1d4-76ad4a4f03b4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:52.243341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1153/2282] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:52.247984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0232caa-1ce9-498f-96ba-3199d3b9d3ce admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:52.261404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0232caa-1ce9-498f-96ba-3199d3b9d3ce admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:52.267753 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9c546-92e5-406c-97d3-29f955e942be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:52.268909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9c546-92e5-406c-97d3-29f955e942be admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:52.269195 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9c546-92e5-406c-97d3-29f955e942be admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:52.269500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9c546-92e5-406c-97d3-29f955e942be admin admin] PATH_INFO: `/v3/projects/cbde714313604766b67e29c1f84a5b9c/users/bdf8cd4b978b4dc7bb110c84fa80cdb8/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:52.293935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9c546-92e5-406c-97d3-29f955e942be admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbde714313604766b67e29c1f84a5b9c, user_id=bdf8cd4b978b4dc7bb110c84fa80cdb8, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:52.297596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9c546-92e5-406c-97d3-29f955e942be admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:52.315165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1130/2283] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:52 2022] PUT /identity/v3/projects/cbde714313604766b67e29c1f84a5b9c/users/bdf8cd4b978b4dc7bb110c84fa80cdb8/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:57:52.326265 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae6478-e20e-4c5e-9aa9-fed8a4dd7ddc None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:52.326814 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae6478-e20e-4c5e-9aa9-fed8a4dd7ddc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:52.327238 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae6478-e20e-4c5e-9aa9-fed8a4dd7ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:52.365907 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-76ae6478-e20e-4c5e-9aa9-fed8a4dd7ddc None None] MFA Rules not processed for user `bdf8cd4b978b4dc7bb110c84fa80cdb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:52.367254 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-76ae6478-e20e-4c5e-9aa9-fed8a4dd7ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:52.462898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1154/2284] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:52.463911 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9c546-92e5-406c-97d3-29f955e942be admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:52.567987 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9c546-92e5-406c-97d3-29f955e942be admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:52.575854 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ac0a6-bf3b-4ab6-8bd4-5ef8c4cb0922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:52.576706 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ac0a6-bf3b-4ab6-8bd4-5ef8c4cb0922 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:52.577063 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ac0a6-bf3b-4ab6-8bd4-5ef8c4cb0922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:52.577437 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ac0a6-bf3b-4ab6-8bd4-5ef8c4cb0922 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:52.578233 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ac0a6-bf3b-4ab6-8bd4-5ef8c4cb0922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:52.580406 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ac0a6-bf3b-4ab6-8bd4-5ef8c4cb0922 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:52.619010 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1131/2285] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:52 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:52.620678 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae6478-e20e-4c5e-9aa9-fed8a4dd7ddc None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:52.636992 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae6478-e20e-4c5e-9aa9-fed8a4dd7ddc None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:52.703588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad0c7e-3328-472d-9308-37c028f490ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:52.704554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad0c7e-3328-472d-9308-37c028f490ef admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:52.704554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad0c7e-3328-472d-9308-37c028f490ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:52.704834 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad0c7e-3328-472d-9308-37c028f490ef admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:52.705549 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad0c7e-3328-472d-9308-37c028f490ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:52.708659 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad0c7e-3328-472d-9308-37c028f490ef admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:52.734720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1155/2286] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:52 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:57:52.739501 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ac0a6-bf3b-4ab6-8bd4-5ef8c4cb0922 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:52.752070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ac0a6-bf3b-4ab6-8bd4-5ef8c4cb0922 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:52.757252 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a720c-46dd-4569-b2c6-dc6829784937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:52.758039 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a720c-46dd-4569-b2c6-dc6829784937 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:52.758389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a720c-46dd-4569-b2c6-dc6829784937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:52.758781 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a720c-46dd-4569-b2c6-dc6829784937 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:52.759782 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a720c-46dd-4569-b2c6-dc6829784937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:52.761654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a720c-46dd-4569-b2c6-dc6829784937 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:52.775833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1132/2287] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:52.780114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad0c7e-3328-472d-9308-37c028f490ef admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:52.795936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad0c7e-3328-472d-9308-37c028f490ef admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:52.812201 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89ae59-ac39-48ef-8df0-c19393a0cc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:52.813310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89ae59-ac39-48ef-8df0-c19393a0cc86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:52.814192 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89ae59-ac39-48ef-8df0-c19393a0cc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:52.814617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89ae59-ac39-48ef-8df0-c19393a0cc86 admin admin] PATH_INFO: `/v3/projects/3eda1dd58b4e464cb633c9cdb8919128/users/c28f75dcadd346c3807973b64a012828/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:52.837927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89ae59-ac39-48ef-8df0-c19393a0cc86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eda1dd58b4e464cb633c9cdb8919128, user_id=c28f75dcadd346c3807973b64a012828, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:52.840849 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89ae59-ac39-48ef-8df0-c19393a0cc86 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:52.860254 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1156/2288] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:52 2022] PUT /identity/v3/projects/3eda1dd58b4e464cb633c9cdb8919128/users/c28f75dcadd346c3807973b64a012828/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:57:52.863910 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a720c-46dd-4569-b2c6-dc6829784937 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:52.875568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a720c-46dd-4569-b2c6-dc6829784937 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:52.966704 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48f7b8-3c5c-4f46-b042-bc993cdf00cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:52.967825 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48f7b8-3c5c-4f46-b042-bc993cdf00cf admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:52.967825 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48f7b8-3c5c-4f46-b042-bc993cdf00cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:52.968126 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48f7b8-3c5c-4f46-b042-bc993cdf00cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:52.969335 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48f7b8-3c5c-4f46-b042-bc993cdf00cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:52.971508 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48f7b8-3c5c-4f46-b042-bc993cdf00cf admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:52.988191 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1133/2289] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:52.989434 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89ae59-ac39-48ef-8df0-c19393a0cc86 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:53.002630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89ae59-ac39-48ef-8df0-c19393a0cc86 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:53.009181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc5b5e-1479-4cca-a7c0-3bc0dd99b040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:53.010125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc5b5e-1479-4cca-a7c0-3bc0dd99b040 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:53.010409 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc5b5e-1479-4cca-a7c0-3bc0dd99b040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:53.010687 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc5b5e-1479-4cca-a7c0-3bc0dd99b040 admin admin] PATH_INFO: `/v3/projects/3eda1dd58b4e464cb633c9cdb8919128/users/c28f75dcadd346c3807973b64a012828/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:53.012847 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc5b5e-1479-4cca-a7c0-3bc0dd99b040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eda1dd58b4e464cb633c9cdb8919128, user_id=c28f75dcadd346c3807973b64a012828, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:53.015713 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc5b5e-1479-4cca-a7c0-3bc0dd99b040 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:53.030690 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1157/2290] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:52 2022] PUT /identity/v3/projects/3eda1dd58b4e464cb633c9cdb8919128/users/c28f75dcadd346c3807973b64a012828/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:53.042313 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfae6d-8383-40ad-aa04-814266a32193 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:53.042602 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfae6d-8383-40ad-aa04-814266a32193 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:53.042881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfae6d-8383-40ad-aa04-814266a32193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:53.089126 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a6dfae6d-8383-40ad-aa04-814266a32193 None None] MFA Rules not processed for user `c28f75dcadd346c3807973b64a012828`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:53.090819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a6dfae6d-8383-40ad-aa04-814266a32193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:53.214406 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1134/2291] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:53.225897 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc5b5e-1479-4cca-a7c0-3bc0dd99b040 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:53.227510 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2acc5b5e-1479-4cca-a7c0-3bc0dd99b040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:53.308959 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc5b5e-1479-4cca-a7c0-3bc0dd99b040 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:53.314513 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bde241-d979-4110-afba-3ed29724aeef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:53.315264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bde241-d979-4110-afba-3ed29724aeef service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:53.316169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bde241-d979-4110-afba-3ed29724aeef service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:53.316169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bde241-d979-4110-afba-3ed29724aeef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:53.329777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bde241-d979-4110-afba-3ed29724aeef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:53.331318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bde241-d979-4110-afba-3ed29724aeef service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:53.352407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1158/2292] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:54.114397 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfae6d-8383-40ad-aa04-814266a32193 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:54.194352 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfae6d-8383-40ad-aa04-814266a32193 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:54.199243 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1523bee-24c3-4131-a63a-329c75b1d718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:54.206718 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1523bee-24c3-4131-a63a-329c75b1d718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:54.207408 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1523bee-24c3-4131-a63a-329c75b1d718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:54.214436 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1523bee-24c3-4131-a63a-329c75b1d718 admin admin] PATH_INFO: `/v3/users/bdf8cd4b978b4dc7bb110c84fa80cdb8` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:54.217997 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1523bee-24c3-4131-a63a-329c75b1d718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdf8cd4b978b4dc7bb110c84fa80cdb8)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:54.220008 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1523bee-24c3-4131-a63a-329c75b1d718 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:54.295985 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e1523bee-24c3-4131-a63a-329c75b1d718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdf8cd4b978b4dc7bb110c84fa80cdb8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:54.309636 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e1523bee-24c3-4131-a63a-329c75b1d718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdf8cd4b978b4dc7bb110c84fa80cdb8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:54.310239 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e1523bee-24c3-4131-a63a-329c75b1d718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdf8cd4b978b4dc7bb110c84fa80cdb8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:54.310931 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e1523bee-24c3-4131-a63a-329c75b1d718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdf8cd4b978b4dc7bb110c84fa80cdb8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:54.320429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e1523bee-24c3-4131-a63a-329c75b1d718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdf8cd4b978b4dc7bb110c84fa80cdb8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:54.336044 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1135/2293] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:54 2022] DELETE /identity/v3/users/bdf8cd4b978b4dc7bb110c84fa80cdb8 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:54.340773 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5689a-e51d-43d8-aa3d-5372e729dcb3 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:54.341270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5689a-e51d-43d8-aa3d-5372e729dcb3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:54.341363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5689a-e51d-43d8-aa3d-5372e729dcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:54.359495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-74d5689a-e51d-43d8-aa3d-5372e729dcb3 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:54.360741 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-74d5689a-e51d-43d8-aa3d-5372e729dcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:54.422256 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1159/2294] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:54.432554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1523bee-24c3-4131-a63a-329c75b1d718 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:54.434453 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e1523bee-24c3-4131-a63a-329c75b1d718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:54.504400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1523bee-24c3-4131-a63a-329c75b1d718 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:54.509021 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca5885-501b-4152-88a5-6389297c7ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:54.509829 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca5885-501b-4152-88a5-6389297c7ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:54.510220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca5885-501b-4152-88a5-6389297c7ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:54.511209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca5885-501b-4152-88a5-6389297c7ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:54.568319 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca5885-501b-4152-88a5-6389297c7ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:54.575390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca5885-501b-4152-88a5-6389297c7ff6 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:54.604743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1136/2295] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:55.099314 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5689a-e51d-43d8-aa3d-5372e729dcb3 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:55.101130 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-74d5689a-e51d-43d8-aa3d-5372e729dcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:55.117975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5689a-e51d-43d8-aa3d-5372e729dcb3 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:55.134677 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7ffeb-673c-462e-bf33-7ca7dff10e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:55.135763 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7ffeb-673c-462e-bf33-7ca7dff10e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:55.136116 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7ffeb-673c-462e-bf33-7ca7dff10e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:55.136451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7ffeb-673c-462e-bf33-7ca7dff10e26 admin admin] PATH_INFO: `/v3/projects/cbde714313604766b67e29c1f84a5b9c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:55.138719 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7ffeb-673c-462e-bf33-7ca7dff10e26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbde714313604766b67e29c1f84a5b9c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:55.147392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7ffeb-673c-462e-bf33-7ca7dff10e26 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:55.220450 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-daa7ffeb-673c-462e-bf33-7ca7dff10e26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbde714313604766b67e29c1f84a5b9c', 'request_id': 'req-daa7ffeb-673c-462e-bf33-7ca7dff10e26'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:55.234998 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-daa7ffeb-673c-462e-bf33-7ca7dff10e26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbde714313604766b67e29c1f84a5b9c', 'request_id': 'req-daa7ffeb-673c-462e-bf33-7ca7dff10e26'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:55.245656 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-daa7ffeb-673c-462e-bf33-7ca7dff10e26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbde714313604766b67e29c1f84a5b9c', 'request_id': 'req-daa7ffeb-673c-462e-bf33-7ca7dff10e26'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:55.258560 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-daa7ffeb-673c-462e-bf33-7ca7dff10e26 admin admin] The token cache is being invalidate because project cbde714313604766b67e29c1f84a5b9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:55.258857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-daa7ffeb-673c-462e-bf33-7ca7dff10e26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:55.259606 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-daa7ffeb-673c-462e-bf33-7ca7dff10e26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:55.261178 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1160/2296] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:55 2022] DELETE /identity/v3/projects/cbde714313604766b67e29c1f84a5b9c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:55.265394 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca5885-501b-4152-88a5-6389297c7ff6 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:55.277319 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca5885-501b-4152-88a5-6389297c7ff6 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:55.386189 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03d71d-dfe8-4f42-8b0a-30fac07a7611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:55.387825 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03d71d-dfe8-4f42-8b0a-30fac07a7611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:55.388879 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03d71d-dfe8-4f42-8b0a-30fac07a7611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:55.389156 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03d71d-dfe8-4f42-8b0a-30fac07a7611 admin admin] PATH_INFO: `/v3/users/c28f75dcadd346c3807973b64a012828` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:55.390495 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03d71d-dfe8-4f42-8b0a-30fac07a7611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c28f75dcadd346c3807973b64a012828)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:55.395226 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03d71d-dfe8-4f42-8b0a-30fac07a7611 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:55.450946 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5d03d71d-dfe8-4f42-8b0a-30fac07a7611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c28f75dcadd346c3807973b64a012828'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:55.464011 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5d03d71d-dfe8-4f42-8b0a-30fac07a7611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c28f75dcadd346c3807973b64a012828'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:55.467753 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5d03d71d-dfe8-4f42-8b0a-30fac07a7611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c28f75dcadd346c3807973b64a012828'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:55.468572 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5d03d71d-dfe8-4f42-8b0a-30fac07a7611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c28f75dcadd346c3807973b64a012828'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:55.477548 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5d03d71d-dfe8-4f42-8b0a-30fac07a7611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c28f75dcadd346c3807973b64a012828'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:55.490646 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1137/2297] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:55 2022] DELETE /identity/v3/users/c28f75dcadd346c3807973b64a012828 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:55.917299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7ffeb-673c-462e-bf33-7ca7dff10e26 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:55.918844 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-daa7ffeb-673c-462e-bf33-7ca7dff10e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:55.934308 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7ffeb-673c-462e-bf33-7ca7dff10e26 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:56.065346 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e0fb6-5404-4360-9467-ec67c5addbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:56.066516 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e0fb6-5404-4360-9467-ec67c5addbc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:56.068219 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e0fb6-5404-4360-9467-ec67c5addbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:56.068585 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e0fb6-5404-4360-9467-ec67c5addbc6 admin admin] PATH_INFO: `/v3/projects/3eda1dd58b4e464cb633c9cdb8919128` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:56.069941 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e0fb6-5404-4360-9467-ec67c5addbc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eda1dd58b4e464cb633c9cdb8919128)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:56.072197 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e0fb6-5404-4360-9467-ec67c5addbc6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:56.126069 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-126e0fb6-5404-4360-9467-ec67c5addbc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eda1dd58b4e464cb633c9cdb8919128', 'request_id': 'req-126e0fb6-5404-4360-9467-ec67c5addbc6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:56.136578 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-126e0fb6-5404-4360-9467-ec67c5addbc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eda1dd58b4e464cb633c9cdb8919128', 'request_id': 'req-126e0fb6-5404-4360-9467-ec67c5addbc6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:56.147739 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-126e0fb6-5404-4360-9467-ec67c5addbc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eda1dd58b4e464cb633c9cdb8919128', 'request_id': 'req-126e0fb6-5404-4360-9467-ec67c5addbc6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:56.163355 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-126e0fb6-5404-4360-9467-ec67c5addbc6 admin admin] The token cache is being invalidate because project 3eda1dd58b4e464cb633c9cdb8919128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:56.163747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-126e0fb6-5404-4360-9467-ec67c5addbc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:56.164484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-126e0fb6-5404-4360-9467-ec67c5addbc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:56.166177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1161/2298] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:55 2022] DELETE /identity/v3/projects/3eda1dd58b4e464cb633c9cdb8919128 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:56.172305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7d6df-9830-4d69-81a3-3aa157c0c3f5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:56.172731 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7d6df-9830-4d69-81a3-3aa157c0c3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:56.173917 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7d6df-9830-4d69-81a3-3aa157c0c3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:56.193290 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2fc7d6df-9830-4d69-81a3-3aa157c0c3f5 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:56.194632 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2fc7d6df-9830-4d69-81a3-3aa157c0c3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:56.259724 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1138/2299] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:57:56.267461 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dd8c8-d00d-4019-b5c9-b0bb0080a78e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:56.267850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dd8c8-d00d-4019-b5c9-b0bb0080a78e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:56.268205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dd8c8-d00d-4019-b5c9-b0bb0080a78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:56.304743 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a97dd8c8-d00d-4019-b5c9-b0bb0080a78e None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:56.306159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a97dd8c8-d00d-4019-b5c9-b0bb0080a78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:56.314613 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1162/2300] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:56.318733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7d6df-9830-4d69-81a3-3aa157c0c3f5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:56.329334 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7d6df-9830-4d69-81a3-3aa157c0c3f5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:56.334717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b634d2-3040-4966-858b-41b2470032f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:56.335562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b634d2-3040-4966-858b-41b2470032f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:56.335809 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b634d2-3040-4966-858b-41b2470032f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:56.336152 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b634d2-3040-4966-858b-41b2470032f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:56.336973 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b634d2-3040-4966-858b-41b2470032f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:57:56.337328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b634d2-3040-4966-858b-41b2470032f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:56.339107 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b634d2-3040-4966-858b-41b2470032f7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:56.352238 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1139/2301] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:57:56.371222 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dd8c8-d00d-4019-b5c9-b0bb0080a78e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:56.386378 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dd8c8-d00d-4019-b5c9-b0bb0080a78e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:56.391066 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41d29b-a703-44db-b24c-ee83bccc6149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:56.391733 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41d29b-a703-44db-b24c-ee83bccc6149 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:56.392010 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41d29b-a703-44db-b24c-ee83bccc6149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:56.392280 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41d29b-a703-44db-b24c-ee83bccc6149 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:56.392970 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41d29b-a703-44db-b24c-ee83bccc6149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:56.394868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41d29b-a703-44db-b24c-ee83bccc6149 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:56.458433 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1163/2302] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:56 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:56.462680 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b634d2-3040-4966-858b-41b2470032f7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:56.484545 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b634d2-3040-4966-858b-41b2470032f7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:56.576467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a67c23-2f44-431b-93f3-109640d9da75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:56.577566 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a67c23-2f44-431b-93f3-109640d9da75 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:56.578037 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a67c23-2f44-431b-93f3-109640d9da75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:56.578497 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a67c23-2f44-431b-93f3-109640d9da75 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:56.579457 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a67c23-2f44-431b-93f3-109640d9da75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:56.581681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a67c23-2f44-431b-93f3-109640d9da75 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:56.610191 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1140/2303] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:56 2022] POST /identity/v3/users => generated 291 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:57:56.611902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41d29b-a703-44db-b24c-ee83bccc6149 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:56.646797 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41d29b-a703-44db-b24c-ee83bccc6149 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:56.658346 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84df1c-7537-4edd-8151-48ea3a156d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:56.659163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84df1c-7537-4edd-8151-48ea3a156d44 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:56.659433 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84df1c-7537-4edd-8151-48ea3a156d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:56.659901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84df1c-7537-4edd-8151-48ea3a156d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:56.660592 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84df1c-7537-4edd-8151-48ea3a156d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:56.662194 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84df1c-7537-4edd-8151-48ea3a156d44 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:56.677032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1164/2304] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:56.680680 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a67c23-2f44-431b-93f3-109640d9da75 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:56.691203 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a67c23-2f44-431b-93f3-109640d9da75 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:56.696280 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd88034-7ab6-4e51-a1b8-a8988753e7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:56.697809 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd88034-7ab6-4e51-a1b8-a8988753e7ef admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:56.698167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd88034-7ab6-4e51-a1b8-a8988753e7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:56.698508 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd88034-7ab6-4e51-a1b8-a8988753e7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:56.699347 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd88034-7ab6-4e51-a1b8-a8988753e7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:56.701202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd88034-7ab6-4e51-a1b8-a8988753e7ef admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:56.714677 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1141/2305] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:56.718813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84df1c-7537-4edd-8151-48ea3a156d44 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:56.729451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84df1c-7537-4edd-8151-48ea3a156d44 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:56.734268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc88585-1bf1-4ab6-8a25-7849bf648625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:56.735217 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc88585-1bf1-4ab6-8a25-7849bf648625 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:56.735495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc88585-1bf1-4ab6-8a25-7849bf648625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:56.735766 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc88585-1bf1-4ab6-8a25-7849bf648625 admin admin] PATH_INFO: `/v3/projects/b6dfa8fbf10d4157ba9df306430e4de9/users/4dde123e0e1441c58c4e43ba8bdb343c/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:56.753426 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc88585-1bf1-4ab6-8a25-7849bf648625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6dfa8fbf10d4157ba9df306430e4de9, user_id=4dde123e0e1441c58c4e43ba8bdb343c, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:56.756205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc88585-1bf1-4ab6-8a25-7849bf648625 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:56.771580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1165/2306] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:56 2022] PUT /identity/v3/projects/b6dfa8fbf10d4157ba9df306430e4de9/users/4dde123e0e1441c58c4e43ba8bdb343c/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:56.783284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25ee9c-2eb1-482d-888c-fad0866fc91c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:56.783572 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25ee9c-2eb1-482d-888c-fad0866fc91c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:56.784027 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25ee9c-2eb1-482d-888c-fad0866fc91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:56.818195 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecf4f9-ba34-45a1-bc90-d8fe06de7770 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:56.818464 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecf4f9-ba34-45a1-bc90-d8fe06de7770 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:56.818737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecf4f9-ba34-45a1-bc90-d8fe06de7770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:56.826309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5e25ee9c-2eb1-482d-888c-fad0866fc91c None None] MFA Rules not processed for user `4dde123e0e1441c58c4e43ba8bdb343c`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:56.827660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5e25ee9c-2eb1-482d-888c-fad0866fc91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:56.845881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d2ecf4f9-ba34-45a1-bc90-d8fe06de7770 None None] MFA Rules not processed for user `35c313dff3de48a4921c039937812aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:56.847151 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d2ecf4f9-ba34-45a1-bc90-d8fe06de7770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:56.896887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1142/2307] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:56.901500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25ee9c-2eb1-482d-888c-fad0866fc91c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:56.922135 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1166/2308] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:57:56.926468 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecf4f9-ba34-45a1-bc90-d8fe06de7770 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:56.928336 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d2ecf4f9-ba34-45a1-bc90-d8fe06de7770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:56.969218 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25ee9c-2eb1-482d-888c-fad0866fc91c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:56.982888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c5f31-aeaf-4b8f-aa7b-4a7d8507a4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:56.984226 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c5f31-aeaf-4b8f-aa7b-4a7d8507a4ab admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:56.985144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c5f31-aeaf-4b8f-aa7b-4a7d8507a4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:56.985429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c5f31-aeaf-4b8f-aa7b-4a7d8507a4ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:56.986582 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c5f31-aeaf-4b8f-aa7b-4a7d8507a4ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:56.988950 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c5f31-aeaf-4b8f-aa7b-4a7d8507a4ab admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:57.004676 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecf4f9-ba34-45a1-bc90-d8fe06de7770 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:57.010319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224f4d2-ad74-40f0-af56-89cac24d2458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:57.011139 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224f4d2-ad74-40f0-af56-89cac24d2458 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:57.011454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224f4d2-ad74-40f0-af56-89cac24d2458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:57.011741 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224f4d2-ad74-40f0-af56-89cac24d2458 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:57.012541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224f4d2-ad74-40f0-af56-89cac24d2458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:57.014450 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224f4d2-ad74-40f0-af56-89cac24d2458 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:57.017398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1143/2309] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:56 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:57:57.021436 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c5f31-aeaf-4b8f-aa7b-4a7d8507a4ab admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:57.045195 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1167/2310] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:57:56 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:57:57.049087 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224f4d2-ad74-40f0-af56-89cac24d2458 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:57.126250 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c5f31-aeaf-4b8f-aa7b-4a7d8507a4ab admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:57.136176 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749db03-4714-4702-ae8f-0b4819ad3b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:57.137315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749db03-4714-4702-ae8f-0b4819ad3b91 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:57.137798 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749db03-4714-4702-ae8f-0b4819ad3b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:57.138246 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749db03-4714-4702-ae8f-0b4819ad3b91 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:57.138352 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224f4d2-ad74-40f0-af56-89cac24d2458 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:57.139250 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749db03-4714-4702-ae8f-0b4819ad3b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:57.141379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749db03-4714-4702-ae8f-0b4819ad3b91 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:57.143383 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411ac7d-b537-44b5-928b-d505fc3c2a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:57.144064 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411ac7d-b537-44b5-928b-d505fc3c2a3b admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:57.144348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411ac7d-b537-44b5-928b-d505fc3c2a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:57.144625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411ac7d-b537-44b5-928b-d505fc3c2a3b admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:57.145325 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411ac7d-b537-44b5-928b-d505fc3c2a3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:57.147325 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411ac7d-b537-44b5-928b-d505fc3c2a3b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:57.165200 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1144/2311] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:57 2022] POST /identity/v3/users => generated 298 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:57:57.169403 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749db03-4714-4702-ae8f-0b4819ad3b91 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:57.182646 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749db03-4714-4702-ae8f-0b4819ad3b91 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:57.183929 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1168/2312] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:57:57 2022] POST /identity/v3/users => generated 299 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:57:57.186642 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411ac7d-b537-44b5-928b-d505fc3c2a3b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:57.188347 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543987c-f58d-4098-971c-b324b8a25af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:57.189037 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543987c-f58d-4098-971c-b324b8a25af9 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:57.189315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543987c-f58d-4098-971c-b324b8a25af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:57.189585 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543987c-f58d-4098-971c-b324b8a25af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:57.190365 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543987c-f58d-4098-971c-b324b8a25af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:57.192050 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543987c-f58d-4098-971c-b324b8a25af9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:57.204819 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411ac7d-b537-44b5-928b-d505fc3c2a3b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:57.205950 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1145/2313] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:57.213219 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed572275-123d-465c-910f-630efc8caf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:57.213834 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543987c-f58d-4098-971c-b324b8a25af9 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:57.214228 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed572275-123d-465c-910f-630efc8caf19 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:57.214617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed572275-123d-465c-910f-630efc8caf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:57.214943 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed572275-123d-465c-910f-630efc8caf19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:57.216116 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed572275-123d-465c-910f-630efc8caf19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:57.217936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed572275-123d-465c-910f-630efc8caf19 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:57.226111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543987c-f58d-4098-971c-b324b8a25af9 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:57.231887 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1169/2314] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:57:57.234691 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb30564-b46c-491a-a966-94d8221d22e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:57.235777 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb30564-b46c-491a-a966-94d8221d22e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:57.236060 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb30564-b46c-491a-a966-94d8221d22e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:57.236340 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb30564-b46c-491a-a966-94d8221d22e2 admin admin] PATH_INFO: `/v3/projects/e337e66d588643ef9eb9c436b0564856/users/694d92d94eed476996718b45488b0a66/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:57.236875 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed572275-123d-465c-910f-630efc8caf19 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:57.248727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed572275-123d-465c-910f-630efc8caf19 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:57.252667 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb30564-b46c-491a-a966-94d8221d22e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e337e66d588643ef9eb9c436b0564856, user_id=694d92d94eed476996718b45488b0a66, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:57.254258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b01f15-ee58-4d1b-93a4-15fa50e8311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:57.256659 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b01f15-ee58-4d1b-93a4-15fa50e8311d admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:57.257675 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b01f15-ee58-4d1b-93a4-15fa50e8311d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:57.257921 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb30564-b46c-491a-a966-94d8221d22e2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:57.258341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b01f15-ee58-4d1b-93a4-15fa50e8311d admin admin] PATH_INFO: `/v3/projects/4b705ad8bfbc4e66b747a82996bb3c50/users/40f3a246f4734aa785bea6ad63325e50/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:57.278154 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b01f15-ee58-4d1b-93a4-15fa50e8311d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b705ad8bfbc4e66b747a82996bb3c50, user_id=40f3a246f4734aa785bea6ad63325e50, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:57.284748 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1146/2315] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:57 2022] PUT /identity/v3/projects/e337e66d588643ef9eb9c436b0564856/users/694d92d94eed476996718b45488b0a66/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:57.285907 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb30564-b46c-491a-a966-94d8221d22e2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:57.288326 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b01f15-ee58-4d1b-93a4-15fa50e8311d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:57.310319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1170/2316] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:57 2022] PUT /identity/v3/projects/4b705ad8bfbc4e66b747a82996bb3c50/users/40f3a246f4734aa785bea6ad63325e50/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:57.314278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b01f15-ee58-4d1b-93a4-15fa50e8311d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:57.360708 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb30564-b46c-491a-a966-94d8221d22e2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:57.391038 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b01f15-ee58-4d1b-93a4-15fa50e8311d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:57.395797 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe7e26-30d9-4a8c-bff3-642180426c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:57.397056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe7e26-30d9-4a8c-bff3-642180426c40 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:57.397981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe7e26-30d9-4a8c-bff3-642180426c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:57.398272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe7e26-30d9-4a8c-bff3-642180426c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:57.399040 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe7e26-30d9-4a8c-bff3-642180426c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:57.400680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe7e26-30d9-4a8c-bff3-642180426c40 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:57.414999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1171/2317] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:57:57.419440 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe7e26-30d9-4a8c-bff3-642180426c40 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:57.428514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0398f4b-e32d-4b5d-b121-ae5a4e0a8516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:57.429229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0398f4b-e32d-4b5d-b121-ae5a4e0a8516 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:57.429465 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0398f4b-e32d-4b5d-b121-ae5a4e0a8516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:57.429735 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0398f4b-e32d-4b5d-b121-ae5a4e0a8516 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:57.429967 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe7e26-30d9-4a8c-bff3-642180426c40 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:57.430460 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0398f4b-e32d-4b5d-b121-ae5a4e0a8516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:57.432216 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0398f4b-e32d-4b5d-b121-ae5a4e0a8516 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:57.436491 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d205eb2-b28d-4a39-a3ce-d663c66542ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:57.437894 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d205eb2-b28d-4a39-a3ce-d663c66542ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:57.438638 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d205eb2-b28d-4a39-a3ce-d663c66542ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:57.439204 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d205eb2-b28d-4a39-a3ce-d663c66542ff admin admin] PATH_INFO: `/v3/projects/4b705ad8bfbc4e66b747a82996bb3c50/users/40f3a246f4734aa785bea6ad63325e50/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:57.443015 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1147/2318] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:57:57.443988 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d205eb2-b28d-4a39-a3ce-d663c66542ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b705ad8bfbc4e66b747a82996bb3c50, user_id=40f3a246f4734aa785bea6ad63325e50, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:57.446815 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d205eb2-b28d-4a39-a3ce-d663c66542ff admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:57.447065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0398f4b-e32d-4b5d-b121-ae5a4e0a8516 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:57.457390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0398f4b-e32d-4b5d-b121-ae5a4e0a8516 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:57.459674 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1172/2319] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:57 2022] PUT /identity/v3/projects/4b705ad8bfbc4e66b747a82996bb3c50/users/40f3a246f4734aa785bea6ad63325e50/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:57.519099 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783922a6-467c-44dd-b492-56699ce90337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:57.519994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783922a6-467c-44dd-b492-56699ce90337 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:57.520271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783922a6-467c-44dd-b492-56699ce90337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:57.520544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783922a6-467c-44dd-b492-56699ce90337 admin admin] PATH_INFO: `/v3/projects/e337e66d588643ef9eb9c436b0564856/users/694d92d94eed476996718b45488b0a66/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:57.522533 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783922a6-467c-44dd-b492-56699ce90337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e337e66d588643ef9eb9c436b0564856, user_id=694d92d94eed476996718b45488b0a66, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:57.525242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783922a6-467c-44dd-b492-56699ce90337 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:57.537142 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1148/2320] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:57:57 2022] PUT /identity/v3/projects/e337e66d588643ef9eb9c436b0564856/users/694d92d94eed476996718b45488b0a66/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:57:57.547443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb3ae1-60f2-4950-8a5b-b65c11e5978d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:57.547725 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb3ae1-60f2-4950-8a5b-b65c11e5978d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:57.548046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb3ae1-60f2-4950-8a5b-b65c11e5978d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:57.578285 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-49fb3ae1-60f2-4950-8a5b-b65c11e5978d None None] MFA Rules not processed for user `694d92d94eed476996718b45488b0a66`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:57.579564 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-49fb3ae1-60f2-4950-8a5b-b65c11e5978d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:57.668100 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1173/2321] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:57.676596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783922a6-467c-44dd-b492-56699ce90337 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:57.680164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-783922a6-467c-44dd-b492-56699ce90337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:57.739965 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783922a6-467c-44dd-b492-56699ce90337 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:57.744036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df02c44-23f5-4ec2-b3c6-e424d1597c1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:57.744767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df02c44-23f5-4ec2-b3c6-e424d1597c1f service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:57.745118 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df02c44-23f5-4ec2-b3c6-e424d1597c1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:57.745466 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df02c44-23f5-4ec2-b3c6-e424d1597c1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:57.760995 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df02c44-23f5-4ec2-b3c6-e424d1597c1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:57.762312 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df02c44-23f5-4ec2-b3c6-e424d1597c1f service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:57.778534 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1149/2322] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:57.888935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb3ae1-60f2-4950-8a5b-b65c11e5978d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:57.898746 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb3ae1-60f2-4950-8a5b-b65c11e5978d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:57.902528 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e0d0f-1e95-43d1-9990-57b3f27bc417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:57.903374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e0d0f-1e95-43d1-9990-57b3f27bc417 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:57.903726 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e0d0f-1e95-43d1-9990-57b3f27bc417 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:57.904068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e0d0f-1e95-43d1-9990-57b3f27bc417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:57.981578 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e0d0f-1e95-43d1-9990-57b3f27bc417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:57.983075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e0d0f-1e95-43d1-9990-57b3f27bc417 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:57.992807 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1174/2323] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:58.314942 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df02c44-23f5-4ec2-b3c6-e424d1597c1f service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:58.382219 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df02c44-23f5-4ec2-b3c6-e424d1597c1f service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:58.387611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb736a-7283-4892-b414-d8f0589b7879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:58.388562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb736a-7283-4892-b414-d8f0589b7879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:58.388927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb736a-7283-4892-b414-d8f0589b7879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:58.389265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb736a-7283-4892-b414-d8f0589b7879 admin admin] PATH_INFO: `/v3/users/4dde123e0e1441c58c4e43ba8bdb343c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:58.390526 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb736a-7283-4892-b414-d8f0589b7879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dde123e0e1441c58c4e43ba8bdb343c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:58.392752 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb736a-7283-4892-b414-d8f0589b7879 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:58.454314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-04bb736a-7283-4892-b414-d8f0589b7879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dde123e0e1441c58c4e43ba8bdb343c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:58.475826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-04bb736a-7283-4892-b414-d8f0589b7879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dde123e0e1441c58c4e43ba8bdb343c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:58.476601 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-04bb736a-7283-4892-b414-d8f0589b7879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dde123e0e1441c58c4e43ba8bdb343c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:58.478131 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-04bb736a-7283-4892-b414-d8f0589b7879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dde123e0e1441c58c4e43ba8bdb343c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:58.492129 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-04bb736a-7283-4892-b414-d8f0589b7879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dde123e0e1441c58c4e43ba8bdb343c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:58.510362 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac4c69-9152-41a1-9c56-beb74d9f10b5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:58.511109 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac4c69-9152-41a1-9c56-beb74d9f10b5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:58.511641 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac4c69-9152-41a1-9c56-beb74d9f10b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:58.513087 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1150/2324] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:58 2022] DELETE /identity/v3/users/4dde123e0e1441c58c4e43ba8bdb343c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:58.518590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55482990-68a7-4a28-8c41-4dd7da0642a5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:58.519472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55482990-68a7-4a28-8c41-4dd7da0642a5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:58.523331 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55482990-68a7-4a28-8c41-4dd7da0642a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:58.546984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-55482990-68a7-4a28-8c41-4dd7da0642a5 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:58.549404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-55482990-68a7-4a28-8c41-4dd7da0642a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:58.603121 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5eac4c69-9152-41a1-9c56-beb74d9f10b5 None None] MFA Rules not processed for user `99cbf80fc74c4183a6eed3e97f7196f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:57:58.604249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5eac4c69-9152-41a1-9c56-beb74d9f10b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:58.645581 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1151/2325] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:57:58.653289 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55482990-68a7-4a28-8c41-4dd7da0642a5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:58.655956 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-55482990-68a7-4a28-8c41-4dd7da0642a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:58.726117 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1175/2326] 10.222.0.77 () {58 vars in 1009 bytes} [Wed May 11 06:57:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:57:58.760925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55482990-68a7-4a28-8c41-4dd7da0642a5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:58.766465 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45865f87-c500-402e-a2e7-19cf54cac0d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:58.767181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45865f87-c500-402e-a2e7-19cf54cac0d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:58.767467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45865f87-c500-402e-a2e7-19cf54cac0d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:58.767747 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45865f87-c500-402e-a2e7-19cf54cac0d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:58.779003 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45865f87-c500-402e-a2e7-19cf54cac0d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:58.780220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45865f87-c500-402e-a2e7-19cf54cac0d2 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:58.792505 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac4c69-9152-41a1-9c56-beb74d9f10b5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:58.794028 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5eac4c69-9152-41a1-9c56-beb74d9f10b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:58.797161 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1152/2327] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:57:58.936284 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac4c69-9152-41a1-9c56-beb74d9f10b5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:58.944669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7e207-41b0-48ba-849e-d56227e55d39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f726f58d30734be7abf15400bff89533', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:58.945595 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7e207-41b0-48ba-849e-d56227e55d39 service swift] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:58.946153 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7e207-41b0-48ba-849e-d56227e55d39 service swift] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:58.946877 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7e207-41b0-48ba-849e-d56227e55d39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:58.970878 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7e207-41b0-48ba-849e-d56227e55d39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:58.973145 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7e207-41b0-48ba-849e-d56227e55d39 service swift] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:58.993226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1176/2328] 10.222.0.77 () {60 vars in 1384 bytes} [Wed May 11 06:57:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 06:57:59.399934 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45865f87-c500-402e-a2e7-19cf54cac0d2 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:59.401602 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-45865f87-c500-402e-a2e7-19cf54cac0d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:59.428367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45865f87-c500-402e-a2e7-19cf54cac0d2 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:59.442579 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bfd65-7244-48bd-ae5f-694b872ddf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:59.443603 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bfd65-7244-48bd-ae5f-694b872ddf50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:59.443889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bfd65-7244-48bd-ae5f-694b872ddf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:59.444167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bfd65-7244-48bd-ae5f-694b872ddf50 admin admin] PATH_INFO: `/v3/projects/b6dfa8fbf10d4157ba9df306430e4de9` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:59.448742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bfd65-7244-48bd-ae5f-694b872ddf50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6dfa8fbf10d4157ba9df306430e4de9)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:59.453276 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bfd65-7244-48bd-ae5f-694b872ddf50 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:59.562528 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-252bfd65-7244-48bd-ae5f-694b872ddf50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6dfa8fbf10d4157ba9df306430e4de9', 'request_id': 'req-252bfd65-7244-48bd-ae5f-694b872ddf50'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:59.575490 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-252bfd65-7244-48bd-ae5f-694b872ddf50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6dfa8fbf10d4157ba9df306430e4de9', 'request_id': 'req-252bfd65-7244-48bd-ae5f-694b872ddf50'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:59.610841 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-252bfd65-7244-48bd-ae5f-694b872ddf50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6dfa8fbf10d4157ba9df306430e4de9', 'request_id': 'req-252bfd65-7244-48bd-ae5f-694b872ddf50'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:59.650376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-252bfd65-7244-48bd-ae5f-694b872ddf50 admin admin] The token cache is being invalidate because project b6dfa8fbf10d4157ba9df306430e4de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:57:59.650811 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-252bfd65-7244-48bd-ae5f-694b872ddf50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:59.653640 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-252bfd65-7244-48bd-ae5f-694b872ddf50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:57:59.663521 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1153/2329] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:57:59 2022] DELETE /identity/v3/projects/b6dfa8fbf10d4157ba9df306430e4de9 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:59.668029 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7e207-41b0-48ba-849e-d56227e55d39 service swift] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:59.684820 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7e207-41b0-48ba-849e-d56227e55d39 service swift] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:59.846209 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a25e4a-5388-48e0-8f4e-6c7156b8a975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:59.847501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a25e4a-5388-48e0-8f4e-6c7156b8a975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:59.849459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a25e4a-5388-48e0-8f4e-6c7156b8a975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:59.849910 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a25e4a-5388-48e0-8f4e-6c7156b8a975 admin admin] PATH_INFO: `/v3/users/694d92d94eed476996718b45488b0a66` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:59.864708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a25e4a-5388-48e0-8f4e-6c7156b8a975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=694d92d94eed476996718b45488b0a66)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:59.869952 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a25e4a-5388-48e0-8f4e-6c7156b8a975 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:00.010026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-35a25e4a-5388-48e0-8f4e-6c7156b8a975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '694d92d94eed476996718b45488b0a66'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:00.056005 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-35a25e4a-5388-48e0-8f4e-6c7156b8a975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '694d92d94eed476996718b45488b0a66'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:00.059438 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-35a25e4a-5388-48e0-8f4e-6c7156b8a975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '694d92d94eed476996718b45488b0a66'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:00.062150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-35a25e4a-5388-48e0-8f4e-6c7156b8a975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '694d92d94eed476996718b45488b0a66'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:00.083857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-35a25e4a-5388-48e0-8f4e-6c7156b8a975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '694d92d94eed476996718b45488b0a66'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:00.190268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1177/2330] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:57:59 2022] DELETE /identity/v3/users/694d92d94eed476996718b45488b0a66 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:58:01.157140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bfd65-7244-48bd-ae5f-694b872ddf50 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:01.160244 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-252bfd65-7244-48bd-ae5f-694b872ddf50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:01.206509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bfd65-7244-48bd-ae5f-694b872ddf50 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:01.391479 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09f816-dca5-487d-b081-5e1a38ab19ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:01.393071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09f816-dca5-487d-b081-5e1a38ab19ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:01.394274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09f816-dca5-487d-b081-5e1a38ab19ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:01.394742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09f816-dca5-487d-b081-5e1a38ab19ce admin admin] PATH_INFO: `/v3/projects/e337e66d588643ef9eb9c436b0564856` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:01.398379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09f816-dca5-487d-b081-5e1a38ab19ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=e337e66d588643ef9eb9c436b0564856)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:01.402585 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09f816-dca5-487d-b081-5e1a38ab19ce admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:01.486020 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2d09f816-dca5-487d-b081-5e1a38ab19ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e337e66d588643ef9eb9c436b0564856', 'request_id': 'req-2d09f816-dca5-487d-b081-5e1a38ab19ce'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:01.500578 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2d09f816-dca5-487d-b081-5e1a38ab19ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e337e66d588643ef9eb9c436b0564856', 'request_id': 'req-2d09f816-dca5-487d-b081-5e1a38ab19ce'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:01.518730 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2d09f816-dca5-487d-b081-5e1a38ab19ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e337e66d588643ef9eb9c436b0564856', 'request_id': 'req-2d09f816-dca5-487d-b081-5e1a38ab19ce'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:01.547761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2d09f816-dca5-487d-b081-5e1a38ab19ce admin admin] The token cache is being invalidate because project e337e66d588643ef9eb9c436b0564856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:58:01.548045 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2d09f816-dca5-487d-b081-5e1a38ab19ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:01.550580 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2d09f816-dca5-487d-b081-5e1a38ab19ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:01.558489 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1154/2331] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:58:01 2022] DELETE /identity/v3/projects/e337e66d588643ef9eb9c436b0564856 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:58:01.564679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0c21a-76b1-45d8-835e-23a76783e7e7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:01.565237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0c21a-76b1-45d8-835e-23a76783e7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:01.565237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0c21a-76b1-45d8-835e-23a76783e7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:01.604456 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-38f0c21a-76b1-45d8-835e-23a76783e7e7 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:58:01.606002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-38f0c21a-76b1-45d8-835e-23a76783e7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:01.776844 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1178/2332] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:58:01.779547 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fffc4-7354-47b5-8aed-1f2321dd48ed None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:01.779840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fffc4-7354-47b5-8aed-1f2321dd48ed None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:01.780117 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fffc4-7354-47b5-8aed-1f2321dd48ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:01.813627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-da5fffc4-7354-47b5-8aed-1f2321dd48ed None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:58:01.814865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-da5fffc4-7354-47b5-8aed-1f2321dd48ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:01.831006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1155/2333] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:58:01.832448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0c21a-76b1-45d8-835e-23a76783e7e7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:01.843641 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0c21a-76b1-45d8-835e-23a76783e7e7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:01.856498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc067fc-c4ea-462a-8379-8ddbc9f9eba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:01.857494 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc067fc-c4ea-462a-8379-8ddbc9f9eba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:01.858907 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc067fc-c4ea-462a-8379-8ddbc9f9eba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:01.859568 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc067fc-c4ea-462a-8379-8ddbc9f9eba9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:01.860775 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc067fc-c4ea-462a-8379-8ddbc9f9eba9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:58:01.861901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc067fc-c4ea-462a-8379-8ddbc9f9eba9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:01.863906 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc067fc-c4ea-462a-8379-8ddbc9f9eba9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:01.881343 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1179/2334] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:58:01.885682 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fffc4-7354-47b5-8aed-1f2321dd48ed None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:01.904154 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fffc4-7354-47b5-8aed-1f2321dd48ed None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:01.918191 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57b48a-6966-4f75-abaa-9a419e908d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:01.925204 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57b48a-6966-4f75-abaa-9a419e908d76 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:01.925887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57b48a-6966-4f75-abaa-9a419e908d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:01.927432 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57b48a-6966-4f75-abaa-9a419e908d76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:01.928721 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57b48a-6966-4f75-abaa-9a419e908d76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:01.932895 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57b48a-6966-4f75-abaa-9a419e908d76 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:01.989684 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1156/2335] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:58:01 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:58:01.993867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc067fc-c4ea-462a-8379-8ddbc9f9eba9 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:02.028744 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc067fc-c4ea-462a-8379-8ddbc9f9eba9 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:02.137002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f626e-4ef9-4637-ac48-3757abfc8293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:02.137991 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f626e-4ef9-4637-ac48-3757abfc8293 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:02.138366 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f626e-4ef9-4637-ac48-3757abfc8293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:02.139274 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f626e-4ef9-4637-ac48-3757abfc8293 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:02.142021 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f626e-4ef9-4637-ac48-3757abfc8293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:02.145533 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f626e-4ef9-4637-ac48-3757abfc8293 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:02.201672 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1180/2336] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:58:01 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:58:02.205227 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57b48a-6966-4f75-abaa-9a419e908d76 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:02.232071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57b48a-6966-4f75-abaa-9a419e908d76 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:02.249504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cdd10-774a-4af5-af42-293d45a89c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:02.250214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cdd10-774a-4af5-af42-293d45a89c41 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:02.250493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cdd10-774a-4af5-af42-293d45a89c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:02.250763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cdd10-774a-4af5-af42-293d45a89c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:02.252394 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467cdd10-774a-4af5-af42-293d45a89c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:02.257784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467cdd10-774a-4af5-af42-293d45a89c41 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:02.304192 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f626e-4ef9-4637-ac48-3757abfc8293 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:02.315340 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1157/2337] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:58:02.323716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f626e-4ef9-4637-ac48-3757abfc8293 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:02.342380 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc91f0-d702-40cf-a104-b654e51f4fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:02.346991 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc91f0-d702-40cf-a104-b654e51f4fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:02.347375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc91f0-d702-40cf-a104-b654e51f4fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:02.347662 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc91f0-d702-40cf-a104-b654e51f4fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:02.349577 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc91f0-d702-40cf-a104-b654e51f4fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:02.353967 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc91f0-d702-40cf-a104-b654e51f4fc0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:02.404725 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1181/2338] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:58:02.412770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cdd10-774a-4af5-af42-293d45a89c41 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:02.442789 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cdd10-774a-4af5-af42-293d45a89c41 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:02.456164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3813f-3650-4a74-842e-84939e9e561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:02.459236 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3813f-3650-4a74-842e-84939e9e561e admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:02.462154 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3813f-3650-4a74-842e-84939e9e561e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:02.463024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3813f-3650-4a74-842e-84939e9e561e admin admin] PATH_INFO: `/v3/projects/41b43f2a3fbc4b9b9a932781a9839d6d/users/0c3d49b35b7c43eeb43127511f7eb549/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:02.498357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3813f-3650-4a74-842e-84939e9e561e admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b43f2a3fbc4b9b9a932781a9839d6d, user_id=0c3d49b35b7c43eeb43127511f7eb549, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:02.502951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3813f-3650-4a74-842e-84939e9e561e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:02.551033 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1158/2339] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:58:02 2022] PUT /identity/v3/projects/41b43f2a3fbc4b9b9a932781a9839d6d/users/0c3d49b35b7c43eeb43127511f7eb549/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:58:02.559741 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2223e9-9537-483a-a401-8f9758cd3c8b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:02.560326 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2223e9-9537-483a-a401-8f9758cd3c8b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:02.562455 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2223e9-9537-483a-a401-8f9758cd3c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:02.745594 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6b2223e9-9537-483a-a401-8f9758cd3c8b None None] MFA Rules not processed for user `0c3d49b35b7c43eeb43127511f7eb549`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:58:02.746889 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6b2223e9-9537-483a-a401-8f9758cd3c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:02.983809 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1182/2340] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:58:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:58:02.988126 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3813f-3650-4a74-842e-84939e9e561e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:03.155531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3813f-3650-4a74-842e-84939e9e561e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:03.161287 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e50b3-8c33-41f6-b2b1-5cf55dae5e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:03.162852 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e50b3-8c33-41f6-b2b1-5cf55dae5e14 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:03.163207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e50b3-8c33-41f6-b2b1-5cf55dae5e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:03.163614 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e50b3-8c33-41f6-b2b1-5cf55dae5e14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:03.164944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e50b3-8c33-41f6-b2b1-5cf55dae5e14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:03.169396 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e50b3-8c33-41f6-b2b1-5cf55dae5e14 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:03.223537 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1159/2341] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:58:02 2022] POST /identity/v3/projects => generated 385 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:58:03.226394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2223e9-9537-483a-a401-8f9758cd3c8b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:03.239832 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2223e9-9537-483a-a401-8f9758cd3c8b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:03.548368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49538c88-9739-4f56-8e9e-7b9ca8ce3584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:03.549000 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49538c88-9739-4f56-8e9e-7b9ca8ce3584 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:03.549285 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49538c88-9739-4f56-8e9e-7b9ca8ce3584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:03.549562 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49538c88-9739-4f56-8e9e-7b9ca8ce3584 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:03.550298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49538c88-9739-4f56-8e9e-7b9ca8ce3584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:03.552267 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49538c88-9739-4f56-8e9e-7b9ca8ce3584 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:03.628777 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e50b3-8c33-41f6-b2b1-5cf55dae5e14 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:03.631638 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-310e50b3-8c33-41f6-b2b1-5cf55dae5e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:03.668459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1183/2342] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:58:03 2022] POST /identity/v3/users => generated 293 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:58:03.669512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49538c88-9739-4f56-8e9e-7b9ca8ce3584 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:03.714710 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49538c88-9739-4f56-8e9e-7b9ca8ce3584 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:03.764865 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc793e-19cf-4c6e-a695-60e8d42c2750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:03.765581 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc793e-19cf-4c6e-a695-60e8d42c2750 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:03.765708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc793e-19cf-4c6e-a695-60e8d42c2750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:03.765966 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc793e-19cf-4c6e-a695-60e8d42c2750 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:03.766751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc793e-19cf-4c6e-a695-60e8d42c2750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:03.768443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc793e-19cf-4c6e-a695-60e8d42c2750 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:03.784072 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1184/2343] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:58:03.790933 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc793e-19cf-4c6e-a695-60e8d42c2750 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:03.847488 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc793e-19cf-4c6e-a695-60e8d42c2750 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:03.872768 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f21f68-9872-44d3-8b6e-a70914fa1b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:03.873691 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f21f68-9872-44d3-8b6e-a70914fa1b6d admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:03.873976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f21f68-9872-44d3-8b6e-a70914fa1b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:03.874262 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f21f68-9872-44d3-8b6e-a70914fa1b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:03.875077 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f21f68-9872-44d3-8b6e-a70914fa1b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:03.882713 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f21f68-9872-44d3-8b6e-a70914fa1b6d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:03.920778 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1185/2344] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:58:03.923196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f21f68-9872-44d3-8b6e-a70914fa1b6d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:03.957279 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f21f68-9872-44d3-8b6e-a70914fa1b6d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:03.982825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb7f6f-f96a-4255-b3a2-ed77dd6618bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:03.983770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb7f6f-f96a-4255-b3a2-ed77dd6618bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:03.984050 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb7f6f-f96a-4255-b3a2-ed77dd6618bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:03.984326 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb7f6f-f96a-4255-b3a2-ed77dd6618bd admin admin] PATH_INFO: `/v3/projects/2efd02e4c22d44e89d2eef1fcdb1111d/users/ecf1e13044374ef8bebba44f192d9ea3/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:03.991980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e50b3-8c33-41f6-b2b1-5cf55dae5e14 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:04.008966 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9450a-ae83-4808-8de0-d4d02f6b671f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46e2703839e498da8f3e2c3fda1d61c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:04.009648 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9450a-ae83-4808-8de0-d4d02f6b671f service placement] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:04.009930 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9450a-ae83-4808-8de0-d4d02f6b671f service placement] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:04.010206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9450a-ae83-4808-8de0-d4d02f6b671f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:04.016595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c0f9450a-ae83-4808-8de0-d4d02f6b671f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:04.045330 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb7f6f-f96a-4255-b3a2-ed77dd6618bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2efd02e4c22d44e89d2eef1fcdb1111d, user_id=ecf1e13044374ef8bebba44f192d9ea3, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:04.048183 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb7f6f-f96a-4255-b3a2-ed77dd6618bd admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:04.051945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9450a-ae83-4808-8de0-d4d02f6b671f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:04.053897 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9450a-ae83-4808-8de0-d4d02f6b671f service placement] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:04.099951 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1186/2345] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:58:03 2022] PUT /identity/v3/projects/2efd02e4c22d44e89d2eef1fcdb1111d/users/ecf1e13044374ef8bebba44f192d9ea3/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:58:04.103410 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1160/2346] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:58:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:58:04.110667 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134f58f-d06d-4d0b-aa2a-72a21b0f7e71 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:04.111225 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134f58f-d06d-4d0b-aa2a-72a21b0f7e71 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:04.111646 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134f58f-d06d-4d0b-aa2a-72a21b0f7e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:04.184114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7134f58f-d06d-4d0b-aa2a-72a21b0f7e71 None None] MFA Rules not processed for user `ecf1e13044374ef8bebba44f192d9ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:58:04.185742 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7134f58f-d06d-4d0b-aa2a-72a21b0f7e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:04.432100 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1187/2347] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:58:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:58:04.436601 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9450a-ae83-4808-8de0-d4d02f6b671f service placement] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:04.448215 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9450a-ae83-4808-8de0-d4d02f6b671f service placement] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:04.708962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee0121-915b-4780-9f72-30eb890ba648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:04.709669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee0121-915b-4780-9f72-30eb890ba648 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:04.709957 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee0121-915b-4780-9f72-30eb890ba648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:04.710235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee0121-915b-4780-9f72-30eb890ba648 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:04.711052 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee0121-915b-4780-9f72-30eb890ba648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:04.712972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee0121-915b-4780-9f72-30eb890ba648 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:04.831541 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1161/2348] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:58:04 2022] POST /identity/v3/projects => generated 385 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:58:04.836496 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134f58f-d06d-4d0b-aa2a-72a21b0f7e71 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:04.862313 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134f58f-d06d-4d0b-aa2a-72a21b0f7e71 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:05.051963 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96980c95-017b-4a4f-83e7-212a15ad77a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:05.053164 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96980c95-017b-4a4f-83e7-212a15ad77a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:05.058361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96980c95-017b-4a4f-83e7-212a15ad77a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:05.058802 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96980c95-017b-4a4f-83e7-212a15ad77a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:05.059755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96980c95-017b-4a4f-83e7-212a15ad77a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:05.068428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96980c95-017b-4a4f-83e7-212a15ad77a7 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:05.140608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee0121-915b-4780-9f72-30eb890ba648 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:05.152971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee0121-915b-4780-9f72-30eb890ba648 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:05.156008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1188/2349] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:58:04 2022] POST /identity/v3/users => generated 299 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:58:05.173829 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec9dad-6011-4e7a-b334-709bcc84e6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:05.174537 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec9dad-6011-4e7a-b334-709bcc84e6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:05.180486 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec9dad-6011-4e7a-b334-709bcc84e6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:05.180768 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec9dad-6011-4e7a-b334-709bcc84e6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:05.181566 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec9dad-6011-4e7a-b334-709bcc84e6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:05.193693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec9dad-6011-4e7a-b334-709bcc84e6c4 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:05.295641 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96980c95-017b-4a4f-83e7-212a15ad77a7 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:05.299909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1162/2350] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:58:05.308152 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96980c95-017b-4a4f-83e7-212a15ad77a7 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:05.332300 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a41bd-0ba9-40be-9880-e20e59f60084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:05.341775 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a41bd-0ba9-40be-9880-e20e59f60084 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:05.342142 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a41bd-0ba9-40be-9880-e20e59f60084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:05.342443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a41bd-0ba9-40be-9880-e20e59f60084 admin admin] PATH_INFO: `/v3/projects/9c02e7dcdf244ee4a7e5821c8409c5cc/users/d94b2fa3195f4769b96bd472c4077097/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:05.385245 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a41bd-0ba9-40be-9880-e20e59f60084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c02e7dcdf244ee4a7e5821c8409c5cc, user_id=d94b2fa3195f4769b96bd472c4077097, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:05.392585 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a41bd-0ba9-40be-9880-e20e59f60084 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:05.450709 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1189/2351] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:58:05 2022] PUT /identity/v3/projects/9c02e7dcdf244ee4a7e5821c8409c5cc/users/d94b2fa3195f4769b96bd472c4077097/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:58:05.454996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec9dad-6011-4e7a-b334-709bcc84e6c4 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:05.466362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec9dad-6011-4e7a-b334-709bcc84e6c4 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:05.567390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b2f4a-6229-4e00-afc0-52cc3e77ee73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:05.568082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b2f4a-6229-4e00-afc0-52cc3e77ee73 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:05.568355 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b2f4a-6229-4e00-afc0-52cc3e77ee73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:05.568801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b2f4a-6229-4e00-afc0-52cc3e77ee73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:05.569698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b2f4a-6229-4e00-afc0-52cc3e77ee73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:05.571496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b2f4a-6229-4e00-afc0-52cc3e77ee73 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:05.582198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1163/2352] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:58:05.586490 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a41bd-0ba9-40be-9880-e20e59f60084 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:05.602615 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a41bd-0ba9-40be-9880-e20e59f60084 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:05.615269 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9f033-44e4-4259-834b-6c4fb4f9561a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:05.618640 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9f033-44e4-4259-834b-6c4fb4f9561a admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:05.628323 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9f033-44e4-4259-834b-6c4fb4f9561a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:05.629420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9f033-44e4-4259-834b-6c4fb4f9561a admin admin] PATH_INFO: `/v3/projects/9c02e7dcdf244ee4a7e5821c8409c5cc/users/d94b2fa3195f4769b96bd472c4077097/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:05.634673 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9f033-44e4-4259-834b-6c4fb4f9561a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c02e7dcdf244ee4a7e5821c8409c5cc, user_id=d94b2fa3195f4769b96bd472c4077097, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:05.644465 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9f033-44e4-4259-834b-6c4fb4f9561a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:05.691888 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1190/2353] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:58:05 2022] PUT /identity/v3/projects/9c02e7dcdf244ee4a7e5821c8409c5cc/users/d94b2fa3195f4769b96bd472c4077097/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:58:05.715084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f116048-895b-49ab-9493-01aa837071a9 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:05.717446 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f116048-895b-49ab-9493-01aa837071a9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:05.717925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f116048-895b-49ab-9493-01aa837071a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:05.774644 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7f116048-895b-49ab-9493-01aa837071a9 None None] MFA Rules not processed for user `d94b2fa3195f4769b96bd472c4077097`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:58:05.776979 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7f116048-895b-49ab-9493-01aa837071a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:05.943295 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1164/2354] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:58:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:58:05.944347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9f033-44e4-4259-834b-6c4fb4f9561a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:05.947729 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3ee9f033-44e4-4259-834b-6c4fb4f9561a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:06.062868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9f033-44e4-4259-834b-6c4fb4f9561a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:06.075189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd3655-71c1-407e-8a7a-c37863393d2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:06.076257 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd3655-71c1-407e-8a7a-c37863393d2a service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:06.076748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd3655-71c1-407e-8a7a-c37863393d2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:06.077237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd3655-71c1-407e-8a7a-c37863393d2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:06.257698 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd3655-71c1-407e-8a7a-c37863393d2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:06.259130 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd3655-71c1-407e-8a7a-c37863393d2a service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:06.297455 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1191/2355] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:58:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:58:07.929990 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b98e44-bec3-4b73-9e49-44fca654a9aa None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:07.931104 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b98e44-bec3-4b73-9e49-44fca654a9aa None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:07.931587 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b98e44-bec3-4b73-9e49-44fca654a9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:07.968972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-16b98e44-bec3-4b73-9e49-44fca654a9aa None None] MFA Rules not processed for user `40f3a246f4734aa785bea6ad63325e50`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:58:07.971288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-16b98e44-bec3-4b73-9e49-44fca654a9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:08.056057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1165/2356] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:58:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:58:08.076565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd3655-71c1-407e-8a7a-c37863393d2a service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:08.078774 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-94bd3655-71c1-407e-8a7a-c37863393d2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:08.182936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd3655-71c1-407e-8a7a-c37863393d2a service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:08.187828 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3986371-50eb-450e-86d4-e4c91fcf511b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '281c923b01a143dbb79d8c0ea04f55b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:08.188867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3986371-50eb-450e-86d4-e4c91fcf511b service glance] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:08.189319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3986371-50eb-450e-86d4-e4c91fcf511b service glance] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:08.189758 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3986371-50eb-450e-86d4-e4c91fcf511b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:08.192333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a3986371-50eb-450e-86d4-e4c91fcf511b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:08.271526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3986371-50eb-450e-86d4-e4c91fcf511b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:08.273182 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3986371-50eb-450e-86d4-e4c91fcf511b service glance] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:08.307439 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1192/2357] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:58:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:58:08.475634 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaea90-cc0b-47e7-b07a-05131af2471a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:08.475927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaea90-cc0b-47e7-b07a-05131af2471a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:08.476205 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaea90-cc0b-47e7-b07a-05131af2471a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:08.493813 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3dfaea90-cc0b-47e7-b07a-05131af2471a None None] MFA Rules not processed for user `99cbf80fc74c4183a6eed3e97f7196f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:58:08.495035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3dfaea90-cc0b-47e7-b07a-05131af2471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:08.564825 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1166/2358] 10.222.0.77 () {58 vars in 1009 bytes} [Wed May 11 06:58:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:58:08.590287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3986371-50eb-450e-86d4-e4c91fcf511b service glance] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:08.591860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a3986371-50eb-450e-86d4-e4c91fcf511b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:08.675404 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3986371-50eb-450e-86d4-e4c91fcf511b service glance] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:08.684872 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7cf9f-ab59-4495-a107-75acf65ba8f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f726f58d30734be7abf15400bff89533', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:08.685637 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7cf9f-ab59-4495-a107-75acf65ba8f4 service swift] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:08.685982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7cf9f-ab59-4495-a107-75acf65ba8f4 service swift] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:08.686258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7cf9f-ab59-4495-a107-75acf65ba8f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:08.697400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7cf9f-ab59-4495-a107-75acf65ba8f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:08.699038 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7cf9f-ab59-4495-a107-75acf65ba8f4 service swift] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:08.710460 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1193/2359] 10.222.0.77 () {60 vars in 1384 bytes} [Wed May 11 06:58:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:58:09.427365 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfaea90-cc0b-47e7-b07a-05131af2471a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:09.429122 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3dfaea90-cc0b-47e7-b07a-05131af2471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:09.462173 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfaea90-cc0b-47e7-b07a-05131af2471a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:09.482249 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3969fd-d3c4-41b1-802b-2e2d211f312e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:09.482928 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3969fd-d3c4-41b1-802b-2e2d211f312e service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:09.483235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3969fd-d3c4-41b1-802b-2e2d211f312e service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:09.483506 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3969fd-d3c4-41b1-802b-2e2d211f312e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:09.640937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3969fd-d3c4-41b1-802b-2e2d211f312e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:09.642680 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3969fd-d3c4-41b1-802b-2e2d211f312e service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:09.681324 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1167/2360] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:58:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:58:11.452062 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7cf9f-ab59-4495-a107-75acf65ba8f4 service swift] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:11.469170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7cf9f-ab59-4495-a107-75acf65ba8f4 service swift] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:11.488602 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524d5af-2e34-4a7b-aa50-799db89ba210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:11.489335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524d5af-2e34-4a7b-aa50-799db89ba210 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:11.489904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524d5af-2e34-4a7b-aa50-799db89ba210 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:11.490186 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524d5af-2e34-4a7b-aa50-799db89ba210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:11.529616 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524d5af-2e34-4a7b-aa50-799db89ba210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:11.532661 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524d5af-2e34-4a7b-aa50-799db89ba210 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:11.578014 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1194/2361] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:58:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:58:20.682431 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3969fd-d3c4-41b1-802b-2e2d211f312e service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:20.788408 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3969fd-d3c4-41b1-802b-2e2d211f312e service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:20.794035 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eca87e-0d46-4aac-b320-2a8907bab72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:20.794930 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eca87e-0d46-4aac-b320-2a8907bab72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:20.795225 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eca87e-0d46-4aac-b320-2a8907bab72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:20.795498 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eca87e-0d46-4aac-b320-2a8907bab72f admin admin] PATH_INFO: `/v3/users/0c3d49b35b7c43eeb43127511f7eb549` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:20.796713 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eca87e-0d46-4aac-b320-2a8907bab72f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c3d49b35b7c43eeb43127511f7eb549)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:20.799483 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eca87e-0d46-4aac-b320-2a8907bab72f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:20.876537 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-04eca87e-0d46-4aac-b320-2a8907bab72f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c3d49b35b7c43eeb43127511f7eb549'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:20.909466 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-04eca87e-0d46-4aac-b320-2a8907bab72f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c3d49b35b7c43eeb43127511f7eb549'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:20.911037 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-04eca87e-0d46-4aac-b320-2a8907bab72f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c3d49b35b7c43eeb43127511f7eb549'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:20.912287 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-04eca87e-0d46-4aac-b320-2a8907bab72f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c3d49b35b7c43eeb43127511f7eb549'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:20.929362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-04eca87e-0d46-4aac-b320-2a8907bab72f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c3d49b35b7c43eeb43127511f7eb549'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:20.956356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1168/2362] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:58:20 2022] DELETE /identity/v3/users/0c3d49b35b7c43eeb43127511f7eb549 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:58:20.962101 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b317d69-2808-4368-bac4-e72b5f7334bf None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:20.962688 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b317d69-2808-4368-bac4-e72b5f7334bf None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:20.962688 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b317d69-2808-4368-bac4-e72b5f7334bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:20.994356 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3b317d69-2808-4368-bac4-e72b5f7334bf None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:58:20.999465 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3b317d69-2808-4368-bac4-e72b5f7334bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:21.142841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1195/2363] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:58:21.157055 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eca87e-0d46-4aac-b320-2a8907bab72f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:21.159182 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-04eca87e-0d46-4aac-b320-2a8907bab72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:21.301284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eca87e-0d46-4aac-b320-2a8907bab72f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:21.308643 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db13ba1-04de-49c6-aa17-b6809a922812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:21.309807 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db13ba1-04de-49c6-aa17-b6809a922812 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:21.310315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db13ba1-04de-49c6-aa17-b6809a922812 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:21.310786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db13ba1-04de-49c6-aa17-b6809a922812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:21.327661 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db13ba1-04de-49c6-aa17-b6809a922812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:21.329465 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db13ba1-04de-49c6-aa17-b6809a922812 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:21.357867 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1169/2364] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:58:21.575474 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23ad7a-760c-43f0-b936-937c3b5e2bd6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:21.576359 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23ad7a-760c-43f0-b936-937c3b5e2bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:21.576992 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23ad7a-760c-43f0-b936-937c3b5e2bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:21.605495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-fc23ad7a-760c-43f0-b936-937c3b5e2bd6 None None] MFA Rules not processed for user `35c313dff3de48a4921c039937812aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:58:21.607113 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fc23ad7a-760c-43f0-b936-937c3b5e2bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:21.707034 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1196/2365] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:58:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:58:22.325858 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db13ba1-04de-49c6-aa17-b6809a922812 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:22.327554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8db13ba1-04de-49c6-aa17-b6809a922812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:22.347206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db13ba1-04de-49c6-aa17-b6809a922812 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:22.352971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400de4c-edc2-40a6-8da8-f73ef90b2ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:22.354507 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400de4c-edc2-40a6-8da8-f73ef90b2ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:22.355885 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400de4c-edc2-40a6-8da8-f73ef90b2ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:22.356574 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400de4c-edc2-40a6-8da8-f73ef90b2ea0 admin admin] PATH_INFO: `/v3/projects/41b43f2a3fbc4b9b9a932781a9839d6d` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:22.358359 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400de4c-edc2-40a6-8da8-f73ef90b2ea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41b43f2a3fbc4b9b9a932781a9839d6d)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:22.361966 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400de4c-edc2-40a6-8da8-f73ef90b2ea0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:22.440186 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1400de4c-edc2-40a6-8da8-f73ef90b2ea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41b43f2a3fbc4b9b9a932781a9839d6d', 'request_id': 'req-1400de4c-edc2-40a6-8da8-f73ef90b2ea0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:22.447100 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1400de4c-edc2-40a6-8da8-f73ef90b2ea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41b43f2a3fbc4b9b9a932781a9839d6d', 'request_id': 'req-1400de4c-edc2-40a6-8da8-f73ef90b2ea0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:22.463015 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1400de4c-edc2-40a6-8da8-f73ef90b2ea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41b43f2a3fbc4b9b9a932781a9839d6d', 'request_id': 'req-1400de4c-edc2-40a6-8da8-f73ef90b2ea0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:22.479888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1400de4c-edc2-40a6-8da8-f73ef90b2ea0 admin admin] The token cache is being invalidate because project 41b43f2a3fbc4b9b9a932781a9839d6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:58:22.480330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1400de4c-edc2-40a6-8da8-f73ef90b2ea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:22.481261 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1400de4c-edc2-40a6-8da8-f73ef90b2ea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:22.487374 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1170/2366] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:58:22 2022] DELETE /identity/v3/projects/41b43f2a3fbc4b9b9a932781a9839d6d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:58:22.490716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23ad7a-760c-43f0-b936-937c3b5e2bd6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:22.502770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23ad7a-760c-43f0-b936-937c3b5e2bd6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:22.610129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635a599-ad5e-4648-afe9-62e1de690193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:22.611169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635a599-ad5e-4648-afe9-62e1de690193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:22.611460 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635a599-ad5e-4648-afe9-62e1de690193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:22.611747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635a599-ad5e-4648-afe9-62e1de690193 admin admin] PATH_INFO: `/v3/users/ecf1e13044374ef8bebba44f192d9ea3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:22.612957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635a599-ad5e-4648-afe9-62e1de690193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecf1e13044374ef8bebba44f192d9ea3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:22.615486 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635a599-ad5e-4648-afe9-62e1de690193 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:22.718128 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7635a599-ad5e-4648-afe9-62e1de690193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecf1e13044374ef8bebba44f192d9ea3'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:22.742485 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7635a599-ad5e-4648-afe9-62e1de690193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecf1e13044374ef8bebba44f192d9ea3'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:22.743495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7635a599-ad5e-4648-afe9-62e1de690193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecf1e13044374ef8bebba44f192d9ea3'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:22.744277 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7635a599-ad5e-4648-afe9-62e1de690193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecf1e13044374ef8bebba44f192d9ea3'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:22.756773 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7635a599-ad5e-4648-afe9-62e1de690193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecf1e13044374ef8bebba44f192d9ea3'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:22.799810 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1197/2367] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:58:22 2022] DELETE /identity/v3/users/ecf1e13044374ef8bebba44f192d9ea3 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:58:23.417582 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400de4c-edc2-40a6-8da8-f73ef90b2ea0 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:23.419378 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1400de4c-edc2-40a6-8da8-f73ef90b2ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:23.435886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400de4c-edc2-40a6-8da8-f73ef90b2ea0 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:23.567595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08510d0-fe50-4785-b71a-f07386de4110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:23.572576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08510d0-fe50-4785-b71a-f07386de4110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:23.572932 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08510d0-fe50-4785-b71a-f07386de4110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:23.574098 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08510d0-fe50-4785-b71a-f07386de4110 admin admin] PATH_INFO: `/v3/projects/2efd02e4c22d44e89d2eef1fcdb1111d` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:23.576280 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08510d0-fe50-4785-b71a-f07386de4110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2efd02e4c22d44e89d2eef1fcdb1111d)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:23.583505 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08510d0-fe50-4785-b71a-f07386de4110 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:23.676298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d08510d0-fe50-4785-b71a-f07386de4110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2efd02e4c22d44e89d2eef1fcdb1111d', 'request_id': 'req-d08510d0-fe50-4785-b71a-f07386de4110'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:23.684968 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d08510d0-fe50-4785-b71a-f07386de4110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2efd02e4c22d44e89d2eef1fcdb1111d', 'request_id': 'req-d08510d0-fe50-4785-b71a-f07386de4110'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:23.700531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d08510d0-fe50-4785-b71a-f07386de4110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2efd02e4c22d44e89d2eef1fcdb1111d', 'request_id': 'req-d08510d0-fe50-4785-b71a-f07386de4110'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:23.716305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d08510d0-fe50-4785-b71a-f07386de4110 admin admin] The token cache is being invalidate because project 2efd02e4c22d44e89d2eef1fcdb1111d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:58:23.716941 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d08510d0-fe50-4785-b71a-f07386de4110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:23.717887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d08510d0-fe50-4785-b71a-f07386de4110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:23.720869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1171/2368] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:58:23 2022] DELETE /identity/v3/projects/2efd02e4c22d44e89d2eef1fcdb1111d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:58:23.725434 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635a599-ad5e-4648-afe9-62e1de690193 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:23.729065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7635a599-ad5e-4648-afe9-62e1de690193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:23.763591 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635a599-ad5e-4648-afe9-62e1de690193 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:23.888225 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba60415-2925-4b9b-a2d7-c68cee195a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:23.913997 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba60415-2925-4b9b-a2d7-c68cee195a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:23.914372 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba60415-2925-4b9b-a2d7-c68cee195a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:23.928115 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba60415-2925-4b9b-a2d7-c68cee195a7f admin admin] PATH_INFO: `/v3/users/d94b2fa3195f4769b96bd472c4077097` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:23.929797 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba60415-2925-4b9b-a2d7-c68cee195a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94b2fa3195f4769b96bd472c4077097)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:23.931885 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba60415-2925-4b9b-a2d7-c68cee195a7f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:24.021229 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2ba60415-2925-4b9b-a2d7-c68cee195a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94b2fa3195f4769b96bd472c4077097'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:24.036467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2ba60415-2925-4b9b-a2d7-c68cee195a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94b2fa3195f4769b96bd472c4077097'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:24.037376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2ba60415-2925-4b9b-a2d7-c68cee195a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94b2fa3195f4769b96bd472c4077097'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:24.038202 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2ba60415-2925-4b9b-a2d7-c68cee195a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94b2fa3195f4769b96bd472c4077097'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:24.046684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2ba60415-2925-4b9b-a2d7-c68cee195a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94b2fa3195f4769b96bd472c4077097'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:24.060057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1198/2369] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:58:23 2022] DELETE /identity/v3/users/d94b2fa3195f4769b96bd472c4077097 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:58:24.673412 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08510d0-fe50-4785-b71a-f07386de4110 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:24.674853 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d08510d0-fe50-4785-b71a-f07386de4110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:24.699572 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08510d0-fe50-4785-b71a-f07386de4110 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:24.833059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669cf53e-f837-4534-8a8b-a40bf237779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:24.833968 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cf53e-f837-4534-8a8b-a40bf237779f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:24.834254 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cf53e-f837-4534-8a8b-a40bf237779f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:24.834536 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cf53e-f837-4534-8a8b-a40bf237779f admin admin] PATH_INFO: `/v3/projects/9c02e7dcdf244ee4a7e5821c8409c5cc` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:24.837794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669cf53e-f837-4534-8a8b-a40bf237779f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c02e7dcdf244ee4a7e5821c8409c5cc)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:24.839865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669cf53e-f837-4534-8a8b-a40bf237779f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:24.925741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-669cf53e-f837-4534-8a8b-a40bf237779f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c02e7dcdf244ee4a7e5821c8409c5cc', 'request_id': 'req-669cf53e-f837-4534-8a8b-a40bf237779f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:24.934681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-669cf53e-f837-4534-8a8b-a40bf237779f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c02e7dcdf244ee4a7e5821c8409c5cc', 'request_id': 'req-669cf53e-f837-4534-8a8b-a40bf237779f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:24.946520 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-669cf53e-f837-4534-8a8b-a40bf237779f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c02e7dcdf244ee4a7e5821c8409c5cc', 'request_id': 'req-669cf53e-f837-4534-8a8b-a40bf237779f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:24.959713 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-669cf53e-f837-4534-8a8b-a40bf237779f admin admin] The token cache is being invalidate because project 9c02e7dcdf244ee4a7e5821c8409c5cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:58:24.960208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-669cf53e-f837-4534-8a8b-a40bf237779f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:24.960983 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-669cf53e-f837-4534-8a8b-a40bf237779f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:24.962888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1172/2370] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:58:24 2022] DELETE /identity/v3/projects/9c02e7dcdf244ee4a7e5821c8409c5cc => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:58:24.970605 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d6a30-065c-4367-ad77-b64b0161caee None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:24.972088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d6a30-065c-4367-ad77-b64b0161caee None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:24.972733 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d6a30-065c-4367-ad77-b64b0161caee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:25.000000 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e63d6a30-065c-4367-ad77-b64b0161caee None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:58:25.002476 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e63d6a30-065c-4367-ad77-b64b0161caee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:25.215366 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1199/2371] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:58:25.217415 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879523ef-ab0f-4bc3-9abe-c81041ee05bb None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:25.217835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879523ef-ab0f-4bc3-9abe-c81041ee05bb None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:25.218256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879523ef-ab0f-4bc3-9abe-c81041ee05bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:25.251970 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-879523ef-ab0f-4bc3-9abe-c81041ee05bb None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:58:25.254155 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-879523ef-ab0f-4bc3-9abe-c81041ee05bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:25.285673 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1173/2372] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:58:25.286370 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d6a30-065c-4367-ad77-b64b0161caee None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:25.306827 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d6a30-065c-4367-ad77-b64b0161caee None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:25.320047 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a9e82-4489-4194-a9bf-6f5fc13e7b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:25.321599 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a9e82-4489-4194-a9bf-6f5fc13e7b8a admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:25.322944 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a9e82-4489-4194-a9bf-6f5fc13e7b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:25.323903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a9e82-4489-4194-a9bf-6f5fc13e7b8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:25.324748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a9e82-4489-4194-a9bf-6f5fc13e7b8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:58:25.325189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a9e82-4489-4194-a9bf-6f5fc13e7b8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:25.328211 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a9e82-4489-4194-a9bf-6f5fc13e7b8a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:25.355020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1200/2373] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:58:25.357948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879523ef-ab0f-4bc3-9abe-c81041ee05bb None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:25.368544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879523ef-ab0f-4bc3-9abe-c81041ee05bb None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:25.374661 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9250aa-798a-427c-8f79-9c9549d33c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:25.375768 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9250aa-798a-427c-8f79-9c9549d33c6c admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:25.376327 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9250aa-798a-427c-8f79-9c9549d33c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:25.376797 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9250aa-798a-427c-8f79-9c9549d33c6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:25.378022 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9250aa-798a-427c-8f79-9c9549d33c6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:25.380627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9250aa-798a-427c-8f79-9c9549d33c6c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:25.436660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1174/2374] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:58:25 2022] POST /identity/v3/projects => generated 369 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:58:25.438843 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a9e82-4489-4194-a9bf-6f5fc13e7b8a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:25.467873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a9e82-4489-4194-a9bf-6f5fc13e7b8a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:25.574228 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5d064-d079-4322-8379-5b2f6cfcea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:25.575127 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5d064-d079-4322-8379-5b2f6cfcea4b admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:25.575508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5d064-d079-4322-8379-5b2f6cfcea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:25.575965 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5d064-d079-4322-8379-5b2f6cfcea4b admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:25.576892 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5d064-d079-4322-8379-5b2f6cfcea4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:25.579157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5d064-d079-4322-8379-5b2f6cfcea4b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:25.613800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1201/2375] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:58:25 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:58:25.617644 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9250aa-798a-427c-8f79-9c9549d33c6c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:25.653164 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9250aa-798a-427c-8f79-9c9549d33c6c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:25.674557 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c50bbb-98e2-486a-bbab-5530449f799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:25.675948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c50bbb-98e2-486a-bbab-5530449f799a admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:25.676578 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c50bbb-98e2-486a-bbab-5530449f799a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:25.678642 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c50bbb-98e2-486a-bbab-5530449f799a admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:25.680729 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c50bbb-98e2-486a-bbab-5530449f799a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:25.685267 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c50bbb-98e2-486a-bbab-5530449f799a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:25.730262 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1175/2376] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:58:25.735180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5d064-d079-4322-8379-5b2f6cfcea4b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:25.749667 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5d064-d079-4322-8379-5b2f6cfcea4b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:25.761470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9373ff6-81a9-40b6-a437-66875f149fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:25.763778 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9373ff6-81a9-40b6-a437-66875f149fdc admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:25.764310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9373ff6-81a9-40b6-a437-66875f149fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:25.765075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9373ff6-81a9-40b6-a437-66875f149fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:25.771287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9373ff6-81a9-40b6-a437-66875f149fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:25.773211 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9373ff6-81a9-40b6-a437-66875f149fdc admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:25.799179 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1202/2377] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:58:25.803670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c50bbb-98e2-486a-bbab-5530449f799a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:25.827767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c50bbb-98e2-486a-bbab-5530449f799a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:25.838352 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f0302-963e-4eff-8714-81c24cf2cdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:25.839323 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f0302-963e-4eff-8714-81c24cf2cdcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:25.839605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f0302-963e-4eff-8714-81c24cf2cdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:25.840138 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f0302-963e-4eff-8714-81c24cf2cdcf admin admin] PATH_INFO: `/v3/projects/d6f5e54830ef491aaf74e752ff1ab77e/users/1c075b20a7a949fcb5943ec1107a3f58/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:25.890989 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f0302-963e-4eff-8714-81c24cf2cdcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6f5e54830ef491aaf74e752ff1ab77e, user_id=1c075b20a7a949fcb5943ec1107a3f58, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:25.894287 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f0302-963e-4eff-8714-81c24cf2cdcf admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:25.921804 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1176/2378] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:58:25 2022] PUT /identity/v3/projects/d6f5e54830ef491aaf74e752ff1ab77e/users/1c075b20a7a949fcb5943ec1107a3f58/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:58:25.933936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a79f43-ef01-488a-b5df-7cf3fd16e567 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:25.934227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a79f43-ef01-488a-b5df-7cf3fd16e567 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:25.935252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a79f43-ef01-488a-b5df-7cf3fd16e567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:25.964380 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f0302-963e-4eff-8714-81c24cf2cdcf admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:25.966179 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-414f0302-963e-4eff-8714-81c24cf2cdcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:25.993502 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a3a79f43-ef01-488a-b5df-7cf3fd16e567 None None] MFA Rules not processed for user `1c075b20a7a949fcb5943ec1107a3f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:58:25.996178 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a3a79f43-ef01-488a-b5df-7cf3fd16e567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:26.124762 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f0302-963e-4eff-8714-81c24cf2cdcf admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:26.138910 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5b8e7-0cf0-4504-8a5d-f3fc4246cfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:26.139958 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5b8e7-0cf0-4504-8a5d-f3fc4246cfce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:26.140297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5b8e7-0cf0-4504-8a5d-f3fc4246cfce admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:26.141102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5b8e7-0cf0-4504-8a5d-f3fc4246cfce admin admin] PATH_INFO: `/v3/users/145e5a44e4ff43948f2c4d603e750a8c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:26.144745 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5b8e7-0cf0-4504-8a5d-f3fc4246cfce admin admin] RBAC: Authorizing `identity:delete_user(user_id=145e5a44e4ff43948f2c4d603e750a8c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:26.149098 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5b8e7-0cf0-4504-8a5d-f3fc4246cfce admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:26.182442 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1203/2379] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:58:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:58:26.195621 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a79f43-ef01-488a-b5df-7cf3fd16e567 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:26.197458 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a3a79f43-ef01-488a-b5df-7cf3fd16e567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:26.265355 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6bf5b8e7-0cf0-4504-8a5d-f3fc4246cfce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '145e5a44e4ff43948f2c4d603e750a8c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:26.289917 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6bf5b8e7-0cf0-4504-8a5d-f3fc4246cfce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '145e5a44e4ff43948f2c4d603e750a8c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:26.289917 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6bf5b8e7-0cf0-4504-8a5d-f3fc4246cfce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '145e5a44e4ff43948f2c4d603e750a8c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:26.289917 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6bf5b8e7-0cf0-4504-8a5d-f3fc4246cfce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '145e5a44e4ff43948f2c4d603e750a8c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:26.304236 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6bf5b8e7-0cf0-4504-8a5d-f3fc4246cfce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '145e5a44e4ff43948f2c4d603e750a8c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:26.333412 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1177/2380] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:58:25 2022] DELETE /identity/v3/users/145e5a44e4ff43948f2c4d603e750a8c => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:58:26.346521 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a79f43-ef01-488a-b5df-7cf3fd16e567 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:26.347798 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8227d07-fd84-47f5-ae19-4d6240aeec51 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:26.348305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8227d07-fd84-47f5-ae19-4d6240aeec51 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:26.348694 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8227d07-fd84-47f5-ae19-4d6240aeec51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:26.401628 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d8227d07-fd84-47f5-ae19-4d6240aeec51 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:58:26.405253 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d8227d07-fd84-47f5-ae19-4d6240aeec51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:26.446073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36e739-b739-47e4-9b41-bd367b480504 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '281c923b01a143dbb79d8c0ea04f55b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:26.447547 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36e739-b739-47e4-9b41-bd367b480504 service glance] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:26.447839 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36e739-b739-47e4-9b41-bd367b480504 service glance] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:26.448115 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36e739-b739-47e4-9b41-bd367b480504 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:26.453213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2d36e739-b739-47e4-9b41-bd367b480504 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:26.508696 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1178/2381] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:58:26.518234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8227d07-fd84-47f5-ae19-4d6240aeec51 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:26.519893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d8227d07-fd84-47f5-ae19-4d6240aeec51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:26.528159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36e739-b739-47e4-9b41-bd367b480504 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:26.529724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36e739-b739-47e4-9b41-bd367b480504 service glance] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:26.548173 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1204/2382] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:58:26 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:58:26.623915 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8227d07-fd84-47f5-ae19-4d6240aeec51 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:26.628593 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9b47-4b12-4098-988f-85b0cc4f7262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:26.629431 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9b47-4b12-4098-988f-85b0cc4f7262 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:26.629869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9b47-4b12-4098-988f-85b0cc4f7262 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:26.630358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9b47-4b12-4098-988f-85b0cc4f7262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:26.643046 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f9b47-4b12-4098-988f-85b0cc4f7262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:26.644773 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f9b47-4b12-4098-988f-85b0cc4f7262 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:26.665389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1179/2383] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:58:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:58:26.695150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba4b71-5442-479c-ba9f-a5373c5bd37c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:26.695441 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba4b71-5442-479c-ba9f-a5373c5bd37c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:26.695719 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba4b71-5442-479c-ba9f-a5373c5bd37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:26.725449 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-25ba4b71-5442-479c-ba9f-a5373c5bd37c None None] MFA Rules not processed for user `99cbf80fc74c4183a6eed3e97f7196f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:58:26.726699 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-25ba4b71-5442-479c-ba9f-a5373c5bd37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:26.804097 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1205/2384] 10.222.0.77 () {58 vars in 1009 bytes} [Wed May 11 06:58:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:58:26.824979 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9b47-4b12-4098-988f-85b0cc4f7262 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:26.826376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-805f9b47-4b12-4098-988f-85b0cc4f7262 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:26.967173 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9b47-4b12-4098-988f-85b0cc4f7262 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:26.983096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6d56a-96ba-43f0-be65-6a30ce5dcf0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f726f58d30734be7abf15400bff89533', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:26.983791 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6d56a-96ba-43f0-be65-6a30ce5dcf0e service swift] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:26.984073 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6d56a-96ba-43f0-be65-6a30ce5dcf0e service swift] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:26.984349 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6d56a-96ba-43f0-be65-6a30ce5dcf0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:26.994300 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6d56a-96ba-43f0-be65-6a30ce5dcf0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:26.996116 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6d56a-96ba-43f0-be65-6a30ce5dcf0e service swift] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:27.006246 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1180/2385] 10.222.0.77 () {60 vars in 1384 bytes} [Wed May 11 06:58:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:58:27.130321 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba4b71-5442-479c-ba9f-a5373c5bd37c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:27.131938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-25ba4b71-5442-479c-ba9f-a5373c5bd37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:27.179236 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba4b71-5442-479c-ba9f-a5373c5bd37c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:27.186597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa79f34-177a-410b-adf1-f2633c4f2e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:27.210946 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa79f34-177a-410b-adf1-f2633c4f2e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:27.212318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa79f34-177a-410b-adf1-f2633c4f2e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:27.212752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa79f34-177a-410b-adf1-f2633c4f2e66 admin admin] PATH_INFO: `/v3/projects/051e9b54c55f4892af26a760aab09b57` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:27.218512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa79f34-177a-410b-adf1-f2633c4f2e66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=051e9b54c55f4892af26a760aab09b57)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:27.242353 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa79f34-177a-410b-adf1-f2633c4f2e66 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:27.387784 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6fa79f34-177a-410b-adf1-f2633c4f2e66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '051e9b54c55f4892af26a760aab09b57', 'request_id': 'req-6fa79f34-177a-410b-adf1-f2633c4f2e66'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:27.396530 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6fa79f34-177a-410b-adf1-f2633c4f2e66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '051e9b54c55f4892af26a760aab09b57', 'request_id': 'req-6fa79f34-177a-410b-adf1-f2633c4f2e66'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:27.408201 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6fa79f34-177a-410b-adf1-f2633c4f2e66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '051e9b54c55f4892af26a760aab09b57', 'request_id': 'req-6fa79f34-177a-410b-adf1-f2633c4f2e66'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:27.439122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6fa79f34-177a-410b-adf1-f2633c4f2e66 admin admin] The token cache is being invalidate because project 051e9b54c55f4892af26a760aab09b57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:58:27.439351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6fa79f34-177a-410b-adf1-f2633c4f2e66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:27.440139 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6fa79f34-177a-410b-adf1-f2633c4f2e66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:27.442315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1206/2386] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:58:27 2022] DELETE /identity/v3/projects/051e9b54c55f4892af26a760aab09b57 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:58:27.447363 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300878c-8b99-4682-b0a2-74a5545190cf None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:27.447661 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300878c-8b99-4682-b0a2-74a5545190cf None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:27.447936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300878c-8b99-4682-b0a2-74a5545190cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:27.482730 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-4300878c-8b99-4682-b0a2-74a5545190cf None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:58:27.484381 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4300878c-8b99-4682-b0a2-74a5545190cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:27.623047 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1181/2387] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:58:27.630984 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b261350-ea7d-491a-9583-f9359e2b2892 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:27.631773 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b261350-ea7d-491a-9583-f9359e2b2892 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:27.632274 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b261350-ea7d-491a-9583-f9359e2b2892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:27.676080 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8b261350-ea7d-491a-9583-f9359e2b2892 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:58:27.680096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8b261350-ea7d-491a-9583-f9359e2b2892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:27.709986 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1207/2388] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:58:27.710989 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300878c-8b99-4682-b0a2-74a5545190cf None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:27.722423 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300878c-8b99-4682-b0a2-74a5545190cf None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:27.728130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8bfa8-b29e-414b-a2e2-6ad6446f9ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:27.729631 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8bfa8-b29e-414b-a2e2-6ad6446f9ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:27.730201 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8bfa8-b29e-414b-a2e2-6ad6446f9ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:27.730656 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8bfa8-b29e-414b-a2e2-6ad6446f9ea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:27.731589 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8bfa8-b29e-414b-a2e2-6ad6446f9ea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:58:27.731969 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8bfa8-b29e-414b-a2e2-6ad6446f9ea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:27.733908 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8bfa8-b29e-414b-a2e2-6ad6446f9ea4 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:27.750315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1182/2389] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:58:27.755074 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b261350-ea7d-491a-9583-f9359e2b2892 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:27.764697 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b261350-ea7d-491a-9583-f9359e2b2892 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:27.769507 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386be7c4-a1a5-41ad-92e7-dd782bd26f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:27.770275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386be7c4-a1a5-41ad-92e7-dd782bd26f19 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:27.770625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386be7c4-a1a5-41ad-92e7-dd782bd26f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:27.770987 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386be7c4-a1a5-41ad-92e7-dd782bd26f19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:27.771779 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386be7c4-a1a5-41ad-92e7-dd782bd26f19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:27.773758 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386be7c4-a1a5-41ad-92e7-dd782bd26f19 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:27.801711 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1208/2390] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:58:27 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:58:27.806032 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8bfa8-b29e-414b-a2e2-6ad6446f9ea4 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:27.816690 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8bfa8-b29e-414b-a2e2-6ad6446f9ea4 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:27.872664 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cab341-5e8c-4355-b42e-81a162a84e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:27.874096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cab341-5e8c-4355-b42e-81a162a84e65 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:27.874529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cab341-5e8c-4355-b42e-81a162a84e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:27.874988 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cab341-5e8c-4355-b42e-81a162a84e65 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:27.875872 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cab341-5e8c-4355-b42e-81a162a84e65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:27.878115 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cab341-5e8c-4355-b42e-81a162a84e65 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:27.905570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1183/2391] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:58:27 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:58:27.909773 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386be7c4-a1a5-41ad-92e7-dd782bd26f19 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:27.919915 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386be7c4-a1a5-41ad-92e7-dd782bd26f19 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:27.924652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c722d2-ade5-4918-bfa4-b35d3d77963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:27.925310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c722d2-ade5-4918-bfa4-b35d3d77963a admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:27.925591 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c722d2-ade5-4918-bfa4-b35d3d77963a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:27.925893 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c722d2-ade5-4918-bfa4-b35d3d77963a admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:27.926623 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c722d2-ade5-4918-bfa4-b35d3d77963a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:27.928576 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c722d2-ade5-4918-bfa4-b35d3d77963a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:27.938858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1209/2392] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:58:27.943119 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cab341-5e8c-4355-b42e-81a162a84e65 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:27.953247 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cab341-5e8c-4355-b42e-81a162a84e65 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:27.958224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0004c11-3022-4e27-a7a2-db01149b6468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:27.958902 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0004c11-3022-4e27-a7a2-db01149b6468 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:27.959208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0004c11-3022-4e27-a7a2-db01149b6468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:27.959480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0004c11-3022-4e27-a7a2-db01149b6468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:27.960267 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0004c11-3022-4e27-a7a2-db01149b6468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:27.961845 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0004c11-3022-4e27-a7a2-db01149b6468 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:27.972198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1184/2393] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:58:27.977324 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c722d2-ade5-4918-bfa4-b35d3d77963a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:27.990886 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c722d2-ade5-4918-bfa4-b35d3d77963a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:27.996681 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d01750-b842-4967-b98d-e6638080b4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:27.997877 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d01750-b842-4967-b98d-e6638080b4e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:27.998201 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d01750-b842-4967-b98d-e6638080b4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:27.998514 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d01750-b842-4967-b98d-e6638080b4e8 admin admin] PATH_INFO: `/v3/projects/a25486d1e05144a5a104321633f4599a/users/70753791fd184088b96e466e54d37e77/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:28.016016 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d01750-b842-4967-b98d-e6638080b4e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a25486d1e05144a5a104321633f4599a, user_id=70753791fd184088b96e466e54d37e77, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:28.019196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d01750-b842-4967-b98d-e6638080b4e8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:28.034190 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1210/2394] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:58:27 2022] PUT /identity/v3/projects/a25486d1e05144a5a104321633f4599a/users/70753791fd184088b96e466e54d37e77/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:58:28.044928 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd189b7-6a75-4909-abf3-3ba50793e6fc None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:28.045255 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd189b7-6a75-4909-abf3-3ba50793e6fc None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:28.045542 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd189b7-6a75-4909-abf3-3ba50793e6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:28.078239 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2fd189b7-6a75-4909-abf3-3ba50793e6fc None None] MFA Rules not processed for user `70753791fd184088b96e466e54d37e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:58:28.079517 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2fd189b7-6a75-4909-abf3-3ba50793e6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:28.142716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1185/2395] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:58:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:58:28.154089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d01750-b842-4967-b98d-e6638080b4e8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:28.156063 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e5d01750-b842-4967-b98d-e6638080b4e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:28.219980 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d01750-b842-4967-b98d-e6638080b4e8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:28.224099 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d8954-6bee-4e21-a1a1-e819e1c5ae5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:28.224758 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d8954-6bee-4e21-a1a1-e819e1c5ae5f service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:28.225042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d8954-6bee-4e21-a1a1-e819e1c5ae5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:28.225318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d8954-6bee-4e21-a1a1-e819e1c5ae5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:28.237118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d8954-6bee-4e21-a1a1-e819e1c5ae5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:28.238733 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d8954-6bee-4e21-a1a1-e819e1c5ae5f service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:28.249757 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1211/2396] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:58:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:58:28.275502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd189b7-6a75-4909-abf3-3ba50793e6fc None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:28.336825 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd189b7-6a75-4909-abf3-3ba50793e6fc None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:28.342465 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f4d0d-3b8c-4034-a94e-a4b935ad6386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:28.343629 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f4d0d-3b8c-4034-a94e-a4b935ad6386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:28.343971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f4d0d-3b8c-4034-a94e-a4b935ad6386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:28.344309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f4d0d-3b8c-4034-a94e-a4b935ad6386 admin admin] PATH_INFO: `/v3/users/70753791fd184088b96e466e54d37e77` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:28.345906 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f4d0d-3b8c-4034-a94e-a4b935ad6386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70753791fd184088b96e466e54d37e77)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:28.348158 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f4d0d-3b8c-4034-a94e-a4b935ad6386 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:28.401709 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6a5f4d0d-3b8c-4034-a94e-a4b935ad6386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70753791fd184088b96e466e54d37e77'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:28.414488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6a5f4d0d-3b8c-4034-a94e-a4b935ad6386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70753791fd184088b96e466e54d37e77'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:28.415217 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6a5f4d0d-3b8c-4034-a94e-a4b935ad6386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70753791fd184088b96e466e54d37e77'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:28.415835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6a5f4d0d-3b8c-4034-a94e-a4b935ad6386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70753791fd184088b96e466e54d37e77'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:28.425657 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6a5f4d0d-3b8c-4034-a94e-a4b935ad6386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70753791fd184088b96e466e54d37e77'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:28.443109 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1186/2397] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 06:58:28 2022] DELETE /identity/v3/users/70753791fd184088b96e466e54d37e77 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:58:28.447785 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d725a-5b46-4ba4-bdae-a5b29e356250 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:28.448082 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d725a-5b46-4ba4-bdae-a5b29e356250 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:28.448454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d725a-5b46-4ba4-bdae-a5b29e356250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:28.465930 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-325d725a-5b46-4ba4-bdae-a5b29e356250 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:58:28.467189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-325d725a-5b46-4ba4-bdae-a5b29e356250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:28.534577 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1212/2398] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:58:28.544821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f4d0d-3b8c-4034-a94e-a4b935ad6386 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:28.546293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6a5f4d0d-3b8c-4034-a94e-a4b935ad6386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:28.607779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f4d0d-3b8c-4034-a94e-a4b935ad6386 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:28.613188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b645f2-c90f-4212-b521-caf6e6cc6119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:28.613972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b645f2-c90f-4212-b521-caf6e6cc6119 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:28.614254 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b645f2-c90f-4212-b521-caf6e6cc6119 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:28.614527 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b645f2-c90f-4212-b521-caf6e6cc6119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:28.625427 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b645f2-c90f-4212-b521-caf6e6cc6119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:28.628380 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b645f2-c90f-4212-b521-caf6e6cc6119 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:28.646701 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1187/2399] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:58:28.950200 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d725a-5b46-4ba4-bdae-a5b29e356250 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:28.952161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-325d725a-5b46-4ba4-bdae-a5b29e356250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:28.969684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d725a-5b46-4ba4-bdae-a5b29e356250 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:28.976984 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a521bcc-8c71-420e-9e40-1b8ecba4da41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:28.977976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a521bcc-8c71-420e-9e40-1b8ecba4da41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:28.978874 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a521bcc-8c71-420e-9e40-1b8ecba4da41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:28.978874 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a521bcc-8c71-420e-9e40-1b8ecba4da41 admin admin] PATH_INFO: `/v3/projects/a25486d1e05144a5a104321633f4599a` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:28.980015 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a521bcc-8c71-420e-9e40-1b8ecba4da41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a25486d1e05144a5a104321633f4599a)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:28.982203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a521bcc-8c71-420e-9e40-1b8ecba4da41 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:29.036680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3a521bcc-8c71-420e-9e40-1b8ecba4da41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a25486d1e05144a5a104321633f4599a', 'request_id': 'req-3a521bcc-8c71-420e-9e40-1b8ecba4da41'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:29.044354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3a521bcc-8c71-420e-9e40-1b8ecba4da41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a25486d1e05144a5a104321633f4599a', 'request_id': 'req-3a521bcc-8c71-420e-9e40-1b8ecba4da41'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:29.056588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3a521bcc-8c71-420e-9e40-1b8ecba4da41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a25486d1e05144a5a104321633f4599a', 'request_id': 'req-3a521bcc-8c71-420e-9e40-1b8ecba4da41'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:29.068983 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3a521bcc-8c71-420e-9e40-1b8ecba4da41 admin admin] The token cache is being invalidate because project a25486d1e05144a5a104321633f4599a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:58:29.069418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3a521bcc-8c71-420e-9e40-1b8ecba4da41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:29.070418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3a521bcc-8c71-420e-9e40-1b8ecba4da41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:58:29.072765 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1213/2400] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 06:58:28 2022] DELETE /identity/v3/projects/a25486d1e05144a5a104321633f4599a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:58:29.078117 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f19b2-c71c-4481-a9bb-862eae8a6a0c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:29.078618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f19b2-c71c-4481-a9bb-862eae8a6a0c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:29.078794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f19b2-c71c-4481-a9bb-862eae8a6a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:29.099994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7c9f19b2-c71c-4481-a9bb-862eae8a6a0c None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:58:29.101211 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7c9f19b2-c71c-4481-a9bb-862eae8a6a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:29.162077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1188/2401] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:58:29.170224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cddeed-a95e-4772-b73c-71dc1722b0f3 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:29.170799 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cddeed-a95e-4772-b73c-71dc1722b0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:29.170907 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cddeed-a95e-4772-b73c-71dc1722b0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:29.193036 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b2cddeed-a95e-4772-b73c-71dc1722b0f3 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:58:29.194441 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b2cddeed-a95e-4772-b73c-71dc1722b0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:29.202848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1214/2402] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:58:29.207567 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f19b2-c71c-4481-a9bb-862eae8a6a0c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:29.218161 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f19b2-c71c-4481-a9bb-862eae8a6a0c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:29.222733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0192982-3018-46b4-94e0-dea35fbe4d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:29.223424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0192982-3018-46b4-94e0-dea35fbe4d51 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:29.223707 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0192982-3018-46b4-94e0-dea35fbe4d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:29.223982 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0192982-3018-46b4-94e0-dea35fbe4d51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:29.224710 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0192982-3018-46b4-94e0-dea35fbe4d51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:58:29.225015 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0192982-3018-46b4-94e0-dea35fbe4d51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:29.226613 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0192982-3018-46b4-94e0-dea35fbe4d51 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:29.239161 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1189/2403] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 06:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:58:29.243779 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cddeed-a95e-4772-b73c-71dc1722b0f3 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:29.268534 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cddeed-a95e-4772-b73c-71dc1722b0f3 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:29.275939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b80e7-f4c6-43c2-8235-15545995296b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:29.276947 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b80e7-f4c6-43c2-8235-15545995296b admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:29.277471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b80e7-f4c6-43c2-8235-15545995296b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:29.277937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b80e7-f4c6-43c2-8235-15545995296b admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:29.278831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b80e7-f4c6-43c2-8235-15545995296b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:29.281091 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b80e7-f4c6-43c2-8235-15545995296b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:29.314454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1215/2404] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 06:58:29 2022] POST /identity/v3/projects => generated 389 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:58:29.318318 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0192982-3018-46b4-94e0-dea35fbe4d51 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:29.328374 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0192982-3018-46b4-94e0-dea35fbe4d51 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:29.388970 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd34ef-4bdf-4957-8894-8afbdb0b5874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:29.389936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd34ef-4bdf-4957-8894-8afbdb0b5874 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:29.390223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd34ef-4bdf-4957-8894-8afbdb0b5874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:29.390494 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd34ef-4bdf-4957-8894-8afbdb0b5874 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:29.391296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd34ef-4bdf-4957-8894-8afbdb0b5874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:29.393317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd34ef-4bdf-4957-8894-8afbdb0b5874 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:29.422556 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1190/2405] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 06:58:29 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:58:29.425168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b80e7-f4c6-43c2-8235-15545995296b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:29.445777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b80e7-f4c6-43c2-8235-15545995296b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:29.452279 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1639dd-4d3f-458d-8d8d-fdee40c35027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:29.453168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1639dd-4d3f-458d-8d8d-fdee40c35027 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:29.453654 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1639dd-4d3f-458d-8d8d-fdee40c35027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:29.454081 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1639dd-4d3f-458d-8d8d-fdee40c35027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:29.454929 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1639dd-4d3f-458d-8d8d-fdee40c35027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:29.460491 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1639dd-4d3f-458d-8d8d-fdee40c35027 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:29.472056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1216/2406] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:58:29.477982 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd34ef-4bdf-4957-8894-8afbdb0b5874 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:29.488339 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd34ef-4bdf-4957-8894-8afbdb0b5874 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:29.496861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1470fef-583e-447b-ba7a-10c97e3f7633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:29.497549 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1470fef-583e-447b-ba7a-10c97e3f7633 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:29.497825 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1470fef-583e-447b-ba7a-10c97e3f7633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:29.498094 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1470fef-583e-447b-ba7a-10c97e3f7633 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:29.498833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1470fef-583e-447b-ba7a-10c97e3f7633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:29.500476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1470fef-583e-447b-ba7a-10c97e3f7633 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:29.513408 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1191/2407] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 06:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:58:29.517586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1639dd-4d3f-458d-8d8d-fdee40c35027 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:29.527728 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1639dd-4d3f-458d-8d8d-fdee40c35027 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:29.532359 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bc3eb-8149-40eb-ae49-1050faa99ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:29.533249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bc3eb-8149-40eb-ae49-1050faa99ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:29.533531 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bc3eb-8149-40eb-ae49-1050faa99ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:29.533807 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bc3eb-8149-40eb-ae49-1050faa99ba7 admin admin] PATH_INFO: `/v3/projects/53ec19f9ff344dfbb9462b1d2d88eceb/users/efed770bcee74bedb7bb2f78bee397cc/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:29.549113 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bc3eb-8149-40eb-ae49-1050faa99ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ec19f9ff344dfbb9462b1d2d88eceb, user_id=efed770bcee74bedb7bb2f78bee397cc, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:29.551960 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bc3eb-8149-40eb-ae49-1050faa99ba7 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:29.571653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1217/2408] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 06:58:29 2022] PUT /identity/v3/projects/53ec19f9ff344dfbb9462b1d2d88eceb/users/efed770bcee74bedb7bb2f78bee397cc/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:58:29.582628 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46809bd-f214-4467-8dec-fc556df6f5aa None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:29.582918 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46809bd-f214-4467-8dec-fc556df6f5aa None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:29.583387 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46809bd-f214-4467-8dec-fc556df6f5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:29.618009 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a46809bd-f214-4467-8dec-fc556df6f5aa None None] MFA Rules not processed for user `efed770bcee74bedb7bb2f78bee397cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:58:29.619877 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a46809bd-f214-4467-8dec-fc556df6f5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:29.686297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1192/2409] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 06:58:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:58:29.698990 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bc3eb-8149-40eb-ae49-1050faa99ba7 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:29.701352 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fc4bc3eb-8149-40eb-ae49-1050faa99ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:29.771866 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bc3eb-8149-40eb-ae49-1050faa99ba7 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:29.775975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a163b-22a0-4902-9524-e98f01c7abd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:29.776625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a163b-22a0-4902-9524-e98f01c7abd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:29.776910 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a163b-22a0-4902-9524-e98f01c7abd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:29.777188 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a163b-22a0-4902-9524-e98f01c7abd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:29.787037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a163b-22a0-4902-9524-e98f01c7abd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:29.787252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a163b-22a0-4902-9524-e98f01c7abd2 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:29.796880 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1218/2410] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 06:58:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:58:35.984097 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d460e9d-181d-4a4d-a302-c24374219ead None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:35.984650 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d460e9d-181d-4a4d-a302-c24374219ead None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:35.984650 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d460e9d-181d-4a4d-a302-c24374219ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:36.003023 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9d460e9d-181d-4a4d-a302-c24374219ead None None] MFA Rules not processed for user `99cbf80fc74c4183a6eed3e97f7196f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:58:36.004563 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9d460e9d-181d-4a4d-a302-c24374219ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:36.063953 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1193/2411] 10.222.0.77 () {58 vars in 967 bytes} [Wed May 11 06:58:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:58:36.078855 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a163b-22a0-4902-9524-e98f01c7abd2 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:58:36.080452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0e8a163b-22a0-4902-9524-e98f01c7abd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:58:36.153198 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a163b-22a0-4902-9524-e98f01c7abd2 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:58:36.159325 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde0be0-0340-4d6d-88bc-8869c7879dcc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f726f58d30734be7abf15400bff89533', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:58:36.159971 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde0be0-0340-4d6d-88bc-8869c7879dcc service swift] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:58:36.160256 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde0be0-0340-4d6d-88bc-8869c7879dcc service swift] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:58:36.160529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde0be0-0340-4d6d-88bc-8869c7879dcc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:58:36.170409 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde0be0-0340-4d6d-88bc-8869c7879dcc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:58:36.171535 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde0be0-0340-4d6d-88bc-8869c7879dcc service swift] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:58:36.180841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1219/2412] 10.222.0.77 () {60 vars in 1384 bytes} [Wed May 11 06:58:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:00:21.927337 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d460e9d-181d-4a4d-a302-c24374219ead None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:00:21.929025 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9d460e9d-181d-4a4d-a302-c24374219ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:00:21.940993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d460e9d-181d-4a4d-a302-c24374219ead None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:00:21.944724 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c29f8-8f64-4db6-b2c2-001bb01c22dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:00:21.945361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c29f8-8f64-4db6-b2c2-001bb01c22dd service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:00:21.945639 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c29f8-8f64-4db6-b2c2-001bb01c22dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:00:21.945907 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c29f8-8f64-4db6-b2c2-001bb01c22dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:00:21.947689 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-be2c29f8-8f64-4db6-b2c2-001bb01c22dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:00:22.014682 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c29f8-8f64-4db6-b2c2-001bb01c22dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:00:22.016162 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c29f8-8f64-4db6-b2c2-001bb01c22dd service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:00:22.025425 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1194/2413] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:00:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:00:26.889720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde0be0-0340-4d6d-88bc-8869c7879dcc service swift] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:00:26.902291 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde0be0-0340-4d6d-88bc-8869c7879dcc service swift] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:00:26.907111 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40f1cd-59f5-47a2-be27-be43a8bbcbde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:00:26.907566 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40f1cd-59f5-47a2-be27-be43a8bbcbde service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:00:26.907847 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40f1cd-59f5-47a2-be27-be43a8bbcbde service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:00:26.908118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40f1cd-59f5-47a2-be27-be43a8bbcbde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:00:26.910249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ad40f1cd-59f5-47a2-be27-be43a8bbcbde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:00:26.968589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40f1cd-59f5-47a2-be27-be43a8bbcbde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:00:26.970026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40f1cd-59f5-47a2-be27-be43a8bbcbde service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:00:26.978842 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1220/2414] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:00:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:01:00.351397 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c29f8-8f64-4db6-b2c2-001bb01c22dd service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:01:00.353066 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-be2c29f8-8f64-4db6-b2c2-001bb01c22dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:01:00.414436 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c29f8-8f64-4db6-b2c2-001bb01c22dd service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:01:00.418884 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e5f8c-d57f-48b8-a6a1-ac794b96eff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:01:00.419561 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e5f8c-d57f-48b8-a6a1-ac794b96eff3 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:01:00.419845 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e5f8c-d57f-48b8-a6a1-ac794b96eff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:01:00.420125 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e5f8c-d57f-48b8-a6a1-ac794b96eff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:01:00.422112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-627e5f8c-d57f-48b8-a6a1-ac794b96eff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:01:00.432099 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e5f8c-d57f-48b8-a6a1-ac794b96eff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:01:00.433519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e5f8c-d57f-48b8-a6a1-ac794b96eff3 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:01:00.441418 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1195/2415] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:01:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:01:00.897527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40f1cd-59f5-47a2-be27-be43a8bbcbde service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:01:00.909007 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40f1cd-59f5-47a2-be27-be43a8bbcbde service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:01:00.913909 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3b653-8859-4adc-8c4f-4577b20a6452 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:01:00.914761 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3b653-8859-4adc-8c4f-4577b20a6452 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:01:00.915065 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3b653-8859-4adc-8c4f-4577b20a6452 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:01:00.915336 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3b653-8859-4adc-8c4f-4577b20a6452 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:01:00.917585 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-93f3b653-8859-4adc-8c4f-4577b20a6452 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:01:00.984362 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3b653-8859-4adc-8c4f-4577b20a6452 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:01:00.985816 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3b653-8859-4adc-8c4f-4577b20a6452 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:01:00.994811 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1221/2416] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:01:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:01:06.946407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e5f8c-d57f-48b8-a6a1-ac794b96eff3 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:01:06.947907 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-627e5f8c-d57f-48b8-a6a1-ac794b96eff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:01:07.046827 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e5f8c-d57f-48b8-a6a1-ac794b96eff3 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:01:07.054739 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a23b3-fcf0-4362-96ed-57e8eca65a1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:01:07.055434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a23b3-fcf0-4362-96ed-57e8eca65a1a service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:01:07.055718 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a23b3-fcf0-4362-96ed-57e8eca65a1a service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:01:07.055996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a23b3-fcf0-4362-96ed-57e8eca65a1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:01:07.058108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-933a23b3-fcf0-4362-96ed-57e8eca65a1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:01:07.128339 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a23b3-fcf0-4362-96ed-57e8eca65a1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:01:07.129861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a23b3-fcf0-4362-96ed-57e8eca65a1a service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:01:07.138932 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1196/2417] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:01:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:01:07.190506 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3b653-8859-4adc-8c4f-4577b20a6452 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:01:07.199185 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3b653-8859-4adc-8c4f-4577b20a6452 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:01:07.203457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fde5b-cd78-44e7-afc9-c64743853fc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:01:07.203935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fde5b-cd78-44e7-afc9-c64743853fc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:01:07.204289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fde5b-cd78-44e7-afc9-c64743853fc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:01:07.204562 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fde5b-cd78-44e7-afc9-c64743853fc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:01:07.206481 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c58fde5b-cd78-44e7-afc9-c64743853fc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:01:07.222041 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fde5b-cd78-44e7-afc9-c64743853fc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:01:07.223639 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fde5b-cd78-44e7-afc9-c64743853fc7 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:01:07.234584 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1222/2418] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:01:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:02:37.011494 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a23b3-fcf0-4362-96ed-57e8eca65a1a service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:02:37.031627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a23b3-fcf0-4362-96ed-57e8eca65a1a service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:02:37.035903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af89755-97ad-4863-87a2-191119d038e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:02:37.036547 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af89755-97ad-4863-87a2-191119d038e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:02:37.036824 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af89755-97ad-4863-87a2-191119d038e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:02:37.037095 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af89755-97ad-4863-87a2-191119d038e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:02:37.039086 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3af89755-97ad-4863-87a2-191119d038e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:02:37.099710 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af89755-97ad-4863-87a2-191119d038e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:02:37.101136 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af89755-97ad-4863-87a2-191119d038e2 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:02:37.110389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1197/2419] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:02:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:03:08.484557 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fde5b-cd78-44e7-afc9-c64743853fc7 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:03:08.493479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fde5b-cd78-44e7-afc9-c64743853fc7 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:03:08.497736 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02dd40-74c9-4013-a77b-1fa84b6e72aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:03:08.498449 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02dd40-74c9-4013-a77b-1fa84b6e72aa service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:03:08.498722 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02dd40-74c9-4013-a77b-1fa84b6e72aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:03:08.499080 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02dd40-74c9-4013-a77b-1fa84b6e72aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:03:08.501304 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ab02dd40-74c9-4013-a77b-1fa84b6e72aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:03:08.560505 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02dd40-74c9-4013-a77b-1fa84b6e72aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:03:08.561950 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02dd40-74c9-4013-a77b-1fa84b6e72aa service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:03:08.571066 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1223/2420] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:03:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:03:26.373287 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af89755-97ad-4863-87a2-191119d038e2 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:03:26.384011 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af89755-97ad-4863-87a2-191119d038e2 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:03:26.388185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b4067-c834-467d-8fee-fbefcfa3ea7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:03:26.388839 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b4067-c834-467d-8fee-fbefcfa3ea7c service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:03:26.389120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b4067-c834-467d-8fee-fbefcfa3ea7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:03:26.389389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b4067-c834-467d-8fee-fbefcfa3ea7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:03:26.391308 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-137b4067-c834-467d-8fee-fbefcfa3ea7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:03:26.450195 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b4067-c834-467d-8fee-fbefcfa3ea7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:03:26.451682 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b4067-c834-467d-8fee-fbefcfa3ea7c service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:03:26.461689 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1198/2421] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:03:26 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:03:30.581767 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02dd40-74c9-4013-a77b-1fa84b6e72aa service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:03:30.591681 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02dd40-74c9-4013-a77b-1fa84b6e72aa service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:03:30.596161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83f2f5-7cd4-4bf9-8d00-d94818b81e26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:03:30.596842 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83f2f5-7cd4-4bf9-8d00-d94818b81e26 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:03:30.597125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83f2f5-7cd4-4bf9-8d00-d94818b81e26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:03:30.597400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83f2f5-7cd4-4bf9-8d00-d94818b81e26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:03:30.606064 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83f2f5-7cd4-4bf9-8d00-d94818b81e26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:03:30.607547 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83f2f5-7cd4-4bf9-8d00-d94818b81e26 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:03:30.616528 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1224/2422] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:03:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:04:02.588770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b4067-c834-467d-8fee-fbefcfa3ea7c service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:02.590360 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-137b4067-c834-467d-8fee-fbefcfa3ea7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:04:02.666927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b4067-c834-467d-8fee-fbefcfa3ea7c service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:02.674482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8269fd7-44e7-453f-9651-b764b597c41e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46e2703839e498da8f3e2c3fda1d61c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:02.675198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8269fd7-44e7-453f-9651-b764b597c41e service placement] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:02.675478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8269fd7-44e7-453f-9651-b764b597c41e service placement] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:02.675749 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8269fd7-44e7-453f-9651-b764b597c41e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:02.677842 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e8269fd7-44e7-453f-9651-b764b597c41e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:04:02.689666 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8269fd7-44e7-453f-9651-b764b597c41e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:02.691296 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8269fd7-44e7-453f-9651-b764b597c41e service placement] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:02.701176 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1199/2423] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:04:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:04:24.211578 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83f2f5-7cd4-4bf9-8d00-d94818b81e26 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:24.221805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83f2f5-7cd4-4bf9-8d00-d94818b81e26 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:24.225570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94201bbf-7922-442a-96cc-ce905b65d715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:24.226216 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94201bbf-7922-442a-96cc-ce905b65d715 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:24.226497 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94201bbf-7922-442a-96cc-ce905b65d715 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:24.226774 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94201bbf-7922-442a-96cc-ce905b65d715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:24.228613 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-94201bbf-7922-442a-96cc-ce905b65d715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:04:24.243129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94201bbf-7922-442a-96cc-ce905b65d715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:24.244660 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94201bbf-7922-442a-96cc-ce905b65d715 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:24.256265 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1225/2424] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:04:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:04:24.635827 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8269fd7-44e7-453f-9651-b764b597c41e service placement] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:24.651741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8269fd7-44e7-453f-9651-b764b597c41e service placement] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:24.657880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01361330-930b-47de-8b40-f5fd8f4f65cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:24.658530 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01361330-930b-47de-8b40-f5fd8f4f65cb service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:24.658802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01361330-930b-47de-8b40-f5fd8f4f65cb service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:24.659102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01361330-930b-47de-8b40-f5fd8f4f65cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:24.660890 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-01361330-930b-47de-8b40-f5fd8f4f65cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:04:24.674686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01361330-930b-47de-8b40-f5fd8f4f65cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:24.676305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01361330-930b-47de-8b40-f5fd8f4f65cb service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:24.687614 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1200/2425] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:04:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:04:32.861952 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94201bbf-7922-442a-96cc-ce905b65d715 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:32.930827 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94201bbf-7922-442a-96cc-ce905b65d715 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:32.935429 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066ca1d-a368-463a-8614-e09ae1a22821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:32.936399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066ca1d-a368-463a-8614-e09ae1a22821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:32.936681 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066ca1d-a368-463a-8614-e09ae1a22821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:32.937328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066ca1d-a368-463a-8614-e09ae1a22821 admin admin] PATH_INFO: `/v3/users/efed770bcee74bedb7bb2f78bee397cc` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:32.938534 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066ca1d-a368-463a-8614-e09ae1a22821 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efed770bcee74bedb7bb2f78bee397cc)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:32.940507 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066ca1d-a368-463a-8614-e09ae1a22821 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:32.987028 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-b066ca1d-a368-463a-8614-e09ae1a22821 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efed770bcee74bedb7bb2f78bee397cc'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:04:32.999222 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-b066ca1d-a368-463a-8614-e09ae1a22821 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efed770bcee74bedb7bb2f78bee397cc'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:04:32.999936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-b066ca1d-a368-463a-8614-e09ae1a22821 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efed770bcee74bedb7bb2f78bee397cc'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:04:33.000665 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-b066ca1d-a368-463a-8614-e09ae1a22821 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efed770bcee74bedb7bb2f78bee397cc'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:04:33.009336 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-b066ca1d-a368-463a-8614-e09ae1a22821 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efed770bcee74bedb7bb2f78bee397cc'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:04:33.021429 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1226/2426] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:04:32 2022] DELETE /identity/v3/users/efed770bcee74bedb7bb2f78bee397cc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:04:33.026480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512e90c-1660-403c-b67f-98375f4baa3c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:33.026982 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512e90c-1660-403c-b67f-98375f4baa3c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:33.027104 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512e90c-1660-403c-b67f-98375f4baa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:33.045808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3512e90c-1660-403c-b67f-98375f4baa3c None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:04:33.047042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3512e90c-1660-403c-b67f-98375f4baa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:04:33.101667 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1201/2427] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:04:33.111789 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066ca1d-a368-463a-8614-e09ae1a22821 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:33.113525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b066ca1d-a368-463a-8614-e09ae1a22821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:04:33.172541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066ca1d-a368-463a-8614-e09ae1a22821 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:33.176749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13ee2c-44c8-426a-8aa3-b601e84e10d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:33.177395 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13ee2c-44c8-426a-8aa3-b601e84e10d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:33.177676 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13ee2c-44c8-426a-8aa3-b601e84e10d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:33.177948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13ee2c-44c8-426a-8aa3-b601e84e10d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:33.187737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13ee2c-44c8-426a-8aa3-b601e84e10d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:33.189176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13ee2c-44c8-426a-8aa3-b601e84e10d2 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:33.198610 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1227/2428] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:04:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:04:33.484949 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512e90c-1660-403c-b67f-98375f4baa3c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:33.486557 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3512e90c-1660-403c-b67f-98375f4baa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:04:33.499011 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512e90c-1660-403c-b67f-98375f4baa3c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:33.504102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6562cf-d189-4600-a198-df7e235334fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:33.505182 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6562cf-d189-4600-a198-df7e235334fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:33.506214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6562cf-d189-4600-a198-df7e235334fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:33.506853 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6562cf-d189-4600-a198-df7e235334fe admin admin] PATH_INFO: `/v3/projects/53ec19f9ff344dfbb9462b1d2d88eceb` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:33.508468 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6562cf-d189-4600-a198-df7e235334fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ec19f9ff344dfbb9462b1d2d88eceb)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:33.510348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6562cf-d189-4600-a198-df7e235334fe admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:33.559042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5d6562cf-d189-4600-a198-df7e235334fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ec19f9ff344dfbb9462b1d2d88eceb', 'request_id': 'req-5d6562cf-d189-4600-a198-df7e235334fe'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:04:33.565023 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5d6562cf-d189-4600-a198-df7e235334fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ec19f9ff344dfbb9462b1d2d88eceb', 'request_id': 'req-5d6562cf-d189-4600-a198-df7e235334fe'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:04:33.574231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5d6562cf-d189-4600-a198-df7e235334fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ec19f9ff344dfbb9462b1d2d88eceb', 'request_id': 'req-5d6562cf-d189-4600-a198-df7e235334fe'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:04:33.584207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5d6562cf-d189-4600-a198-df7e235334fe admin admin] The token cache is being invalidate because project 53ec19f9ff344dfbb9462b1d2d88eceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:04:33.584490 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5d6562cf-d189-4600-a198-df7e235334fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:04:33.585125 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5d6562cf-d189-4600-a198-df7e235334fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:04:33.586675 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1202/2429] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:04:33 2022] DELETE /identity/v3/projects/53ec19f9ff344dfbb9462b1d2d88eceb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:04:36.554547 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13ee2c-44c8-426a-8aa3-b601e84e10d2 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:36.563601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13ee2c-44c8-426a-8aa3-b601e84e10d2 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:36.614858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f69a5-deaa-49df-90e7-9e9e6c50969b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:36.615577 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f69a5-deaa-49df-90e7-9e9e6c50969b service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:36.615859 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f69a5-deaa-49df-90e7-9e9e6c50969b service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:36.616129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f69a5-deaa-49df-90e7-9e9e6c50969b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:36.618111 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d28f69a5-deaa-49df-90e7-9e9e6c50969b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:04:36.679638 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f69a5-deaa-49df-90e7-9e9e6c50969b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:36.681103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f69a5-deaa-49df-90e7-9e9e6c50969b service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:36.690617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1228/2430] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:04:37.202700 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6562cf-d189-4600-a198-df7e235334fe admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:37.204266 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5d6562cf-d189-4600-a198-df7e235334fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:04:37.217643 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6562cf-d189-4600-a198-df7e235334fe admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:37.222420 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2977d5a-3235-4e12-b3a1-0a4c1b87427a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:37.223320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2977d5a-3235-4e12-b3a1-0a4c1b87427a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:37.223587 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2977d5a-3235-4e12-b3a1-0a4c1b87427a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:37.223855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2977d5a-3235-4e12-b3a1-0a4c1b87427a admin admin] PATH_INFO: `/v3/users/1c163ef83b1a4ceea41f9e5b83cc222d` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:37.225096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2977d5a-3235-4e12-b3a1-0a4c1b87427a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c163ef83b1a4ceea41f9e5b83cc222d)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:37.227082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2977d5a-3235-4e12-b3a1-0a4c1b87427a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:37.276639 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a2977d5a-3235-4e12-b3a1-0a4c1b87427a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c163ef83b1a4ceea41f9e5b83cc222d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:04:37.289019 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a2977d5a-3235-4e12-b3a1-0a4c1b87427a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c163ef83b1a4ceea41f9e5b83cc222d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:04:37.289664 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a2977d5a-3235-4e12-b3a1-0a4c1b87427a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c163ef83b1a4ceea41f9e5b83cc222d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:04:37.290333 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a2977d5a-3235-4e12-b3a1-0a4c1b87427a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c163ef83b1a4ceea41f9e5b83cc222d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:04:37.300842 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a2977d5a-3235-4e12-b3a1-0a4c1b87427a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c163ef83b1a4ceea41f9e5b83cc222d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:04:37.313473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1203/2431] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:04:37 2022] DELETE /identity/v3/users/1c163ef83b1a4ceea41f9e5b83cc222d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:04:37.492222 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f69a5-deaa-49df-90e7-9e9e6c50969b service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:37.502712 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f69a5-deaa-49df-90e7-9e9e6c50969b service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:37.558785 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87346a3b-49cf-426e-8448-60440419f70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:37.559827 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87346a3b-49cf-426e-8448-60440419f70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:37.560111 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87346a3b-49cf-426e-8448-60440419f70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:37.560385 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87346a3b-49cf-426e-8448-60440419f70f admin admin] PATH_INFO: `/v3/projects/49e4d308e8154fe3a75bf8e2c6d15e19` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:37.561593 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87346a3b-49cf-426e-8448-60440419f70f admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e4d308e8154fe3a75bf8e2c6d15e19)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:37.563628 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87346a3b-49cf-426e-8448-60440419f70f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:37.609717 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-87346a3b-49cf-426e-8448-60440419f70f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e4d308e8154fe3a75bf8e2c6d15e19', 'request_id': 'req-87346a3b-49cf-426e-8448-60440419f70f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:04:37.615655 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-87346a3b-49cf-426e-8448-60440419f70f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e4d308e8154fe3a75bf8e2c6d15e19', 'request_id': 'req-87346a3b-49cf-426e-8448-60440419f70f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:04:37.625201 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-87346a3b-49cf-426e-8448-60440419f70f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e4d308e8154fe3a75bf8e2c6d15e19', 'request_id': 'req-87346a3b-49cf-426e-8448-60440419f70f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:04:37.635406 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-87346a3b-49cf-426e-8448-60440419f70f admin admin] The token cache is being invalidate because project 49e4d308e8154fe3a75bf8e2c6d15e19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:04:37.635680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-87346a3b-49cf-426e-8448-60440419f70f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:04:37.636288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-87346a3b-49cf-426e-8448-60440419f70f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:04:37.637844 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1229/2432] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:04:37 2022] DELETE /identity/v3/projects/49e4d308e8154fe3a75bf8e2c6d15e19 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:04:37.644847 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7691380-f8b8-4bb2-b68d-6de90b2ce412 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:37.645137 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7691380-f8b8-4bb2-b68d-6de90b2ce412 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:37.645411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7691380-f8b8-4bb2-b68d-6de90b2ce412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:37.663217 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d7691380-f8b8-4bb2-b68d-6de90b2ce412 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:04:37.664426 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d7691380-f8b8-4bb2-b68d-6de90b2ce412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:04:37.733551 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1204/2433] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:04:37.741640 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815d19d-bf35-4f3e-8759-7f9495e7042c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:37.741928 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815d19d-bf35-4f3e-8759-7f9495e7042c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:37.742205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815d19d-bf35-4f3e-8759-7f9495e7042c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:37.762975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c815d19d-bf35-4f3e-8759-7f9495e7042c None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:04:37.764195 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c815d19d-bf35-4f3e-8759-7f9495e7042c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:04:37.773279 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1230/2434] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:04:37.777780 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7691380-f8b8-4bb2-b68d-6de90b2ce412 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:37.788329 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7691380-f8b8-4bb2-b68d-6de90b2ce412 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:37.793469 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaeaeae-593a-4f56-a42e-b86782aac72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:37.794121 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaeaeae-593a-4f56-a42e-b86782aac72f admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:37.794402 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaeaeae-593a-4f56-a42e-b86782aac72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:37.794675 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaeaeae-593a-4f56-a42e-b86782aac72f admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:37.795798 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaeaeae-593a-4f56-a42e-b86782aac72f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:04:37.796072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaeaeae-593a-4f56-a42e-b86782aac72f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:37.797714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaeaeae-593a-4f56-a42e-b86782aac72f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:37.810810 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1205/2435] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 07:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:04:37.817068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815d19d-bf35-4f3e-8759-7f9495e7042c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:37.830519 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815d19d-bf35-4f3e-8759-7f9495e7042c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:37.837919 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c33590-a4a5-4ab6-a1b6-b54e82dcc0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:37.838848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c33590-a4a5-4ab6-a1b6-b54e82dcc0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:37.839184 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c33590-a4a5-4ab6-a1b6-b54e82dcc0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:37.839460 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c33590-a4a5-4ab6-a1b6-b54e82dcc0e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:37.840224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c33590-a4a5-4ab6-a1b6-b54e82dcc0e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:37.842127 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c33590-a4a5-4ab6-a1b6-b54e82dcc0e7 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:37.879085 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1231/2436] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:04:37 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:04:37.883423 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaeaeae-593a-4f56-a42e-b86782aac72f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:37.894069 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaeaeae-593a-4f56-a42e-b86782aac72f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:37.950470 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c5864-ac12-4b33-aaa8-9281c655bd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:37.951171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c5864-ac12-4b33-aaa8-9281c655bd6c admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:37.951451 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c5864-ac12-4b33-aaa8-9281c655bd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:37.951724 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c5864-ac12-4b33-aaa8-9281c655bd6c admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:37.952422 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c5864-ac12-4b33-aaa8-9281c655bd6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:37.954342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c5864-ac12-4b33-aaa8-9281c655bd6c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:37.978166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1206/2437] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:04:37 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:04:37.983272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c33590-a4a5-4ab6-a1b6-b54e82dcc0e7 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:37.993910 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c33590-a4a5-4ab6-a1b6-b54e82dcc0e7 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:37.999618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf8c3b-9926-4b03-8b7a-a594d6d48952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:38.000234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf8c3b-9926-4b03-8b7a-a594d6d48952 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:38.000522 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf8c3b-9926-4b03-8b7a-a594d6d48952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:38.000795 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf8c3b-9926-4b03-8b7a-a594d6d48952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:38.001495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf8c3b-9926-4b03-8b7a-a594d6d48952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:38.003171 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf8c3b-9926-4b03-8b7a-a594d6d48952 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:38.013348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1232/2438] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:04:38.017482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c5864-ac12-4b33-aaa8-9281c655bd6c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:38.027966 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c5864-ac12-4b33-aaa8-9281c655bd6c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:38.033752 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841bd34-8dee-45c9-beb1-53e1fc87441c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:38.034446 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841bd34-8dee-45c9-beb1-53e1fc87441c admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:38.034721 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841bd34-8dee-45c9-beb1-53e1fc87441c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:38.035019 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841bd34-8dee-45c9-beb1-53e1fc87441c admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:38.035748 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841bd34-8dee-45c9-beb1-53e1fc87441c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:38.037347 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841bd34-8dee-45c9-beb1-53e1fc87441c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:38.051818 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1207/2439] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:04:38.057999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf8c3b-9926-4b03-8b7a-a594d6d48952 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:38.069485 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf8c3b-9926-4b03-8b7a-a594d6d48952 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:38.075938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a3918-00fa-47d9-8099-08a4506d702f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:38.076858 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a3918-00fa-47d9-8099-08a4506d702f admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:38.077139 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a3918-00fa-47d9-8099-08a4506d702f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:38.077412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a3918-00fa-47d9-8099-08a4506d702f admin admin] PATH_INFO: `/v3/projects/57566b6ed2b94469a58ea60c27a1e2b3/users/d649b56b7fd34937b0780a515033b0ea/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:38.093116 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a3918-00fa-47d9-8099-08a4506d702f admin admin] RBAC: Authorizing `identity:create_grant(project_id=57566b6ed2b94469a58ea60c27a1e2b3, user_id=d649b56b7fd34937b0780a515033b0ea, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:38.095807 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a3918-00fa-47d9-8099-08a4506d702f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:38.111233 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1233/2440] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:04:38 2022] PUT /identity/v3/projects/57566b6ed2b94469a58ea60c27a1e2b3/users/d649b56b7fd34937b0780a515033b0ea/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:04:38.116456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443c639-6b6f-46b5-adc2-bcf891a351fe None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:38.116747 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443c639-6b6f-46b5-adc2-bcf891a351fe None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:38.117040 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443c639-6b6f-46b5-adc2-bcf891a351fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:38.139143 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9443c639-6b6f-46b5-adc2-bcf891a351fe None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:04:38.140538 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9443c639-6b6f-46b5-adc2-bcf891a351fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:04:38.201712 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1208/2441] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:04:38.211329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a3918-00fa-47d9-8099-08a4506d702f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:38.213017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bc6a3918-00fa-47d9-8099-08a4506d702f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:04:38.269707 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a3918-00fa-47d9-8099-08a4506d702f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:38.274469 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cf395-c25f-4303-9b29-b8c81db0d8b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:38.275162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cf395-c25f-4303-9b29-b8c81db0d8b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:38.275434 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cf395-c25f-4303-9b29-b8c81db0d8b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:38.275704 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cf395-c25f-4303-9b29-b8c81db0d8b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:38.285905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57cf395-c25f-4303-9b29-b8c81db0d8b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:38.287407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57cf395-c25f-4303-9b29-b8c81db0d8b3 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:38.298102 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1234/2442] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:04:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:04:42.500530 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd0d4e-eda2-4a1b-8b44-de6fa6d66cc7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:42.501068 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd0d4e-eda2-4a1b-8b44-de6fa6d66cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:42.501187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd0d4e-eda2-4a1b-8b44-de6fa6d66cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:42.529545 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-cabd0d4e-eda2-4a1b-8b44-de6fa6d66cc7 None None] MFA Rules not processed for user `d649b56b7fd34937b0780a515033b0ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:04:42.530868 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cabd0d4e-eda2-4a1b-8b44-de6fa6d66cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:04:42.602713 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1209/2443] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:04:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:04:42.607183 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cf395-c25f-4303-9b29-b8c81db0d8b3 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:42.618597 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cf395-c25f-4303-9b29-b8c81db0d8b3 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:42.624503 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7134f6-45ea-4b59-a9b4-be52821e6d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:42.625189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7134f6-45ea-4b59-a9b4-be52821e6d03 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:42.626084 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7134f6-45ea-4b59-a9b4-be52821e6d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:42.626389 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7134f6-45ea-4b59-a9b4-be52821e6d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:42.627603 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7134f6-45ea-4b59-a9b4-be52821e6d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:42.629551 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7134f6-45ea-4b59-a9b4-be52821e6d03 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:42.659690 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1235/2444] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:04:42 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:04:42.663799 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd0d4e-eda2-4a1b-8b44-de6fa6d66cc7 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:42.675749 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd0d4e-eda2-4a1b-8b44-de6fa6d66cc7 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:42.732191 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34103120-79db-4bb7-b98c-77dd37f21021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:42.733005 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34103120-79db-4bb7-b98c-77dd37f21021 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:42.733353 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34103120-79db-4bb7-b98c-77dd37f21021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:42.733694 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34103120-79db-4bb7-b98c-77dd37f21021 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:42.734458 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34103120-79db-4bb7-b98c-77dd37f21021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:42.736428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34103120-79db-4bb7-b98c-77dd37f21021 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:42.760299 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1210/2445] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:04:42 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:04:42.764518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7134f6-45ea-4b59-a9b4-be52821e6d03 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:42.776168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7134f6-45ea-4b59-a9b4-be52821e6d03 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:42.780665 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b64389-8853-447c-83fc-46f2894887bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:42.781362 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b64389-8853-447c-83fc-46f2894887bc admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:42.781648 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b64389-8853-447c-83fc-46f2894887bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:42.781923 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b64389-8853-447c-83fc-46f2894887bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:42.782665 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b64389-8853-447c-83fc-46f2894887bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:42.784408 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b64389-8853-447c-83fc-46f2894887bc admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:42.795982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1236/2446] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:04:42.800177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34103120-79db-4bb7-b98c-77dd37f21021 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:42.811201 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34103120-79db-4bb7-b98c-77dd37f21021 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:42.816381 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53940800-28f3-422e-94fb-8a530a3a65cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:42.817323 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53940800-28f3-422e-94fb-8a530a3a65cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:42.817601 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53940800-28f3-422e-94fb-8a530a3a65cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:42.817871 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53940800-28f3-422e-94fb-8a530a3a65cc admin admin] PATH_INFO: `/v3/projects/3284a51fafcd4f5c84ad8c541ea7021e/users/cb76c12589e14ea7b673f745f6465ef8/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:42.835817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53940800-28f3-422e-94fb-8a530a3a65cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3284a51fafcd4f5c84ad8c541ea7021e, user_id=cb76c12589e14ea7b673f745f6465ef8, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:42.838580 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53940800-28f3-422e-94fb-8a530a3a65cc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:42.855671 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1211/2447] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:04:42 2022] PUT /identity/v3/projects/3284a51fafcd4f5c84ad8c541ea7021e/users/cb76c12589e14ea7b673f745f6465ef8/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:04:42.859872 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b64389-8853-447c-83fc-46f2894887bc admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:42.871583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b64389-8853-447c-83fc-46f2894887bc admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:42.931217 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab0a34-78fb-4a91-bf1c-1048e9dc24df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:42.931902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab0a34-78fb-4a91-bf1c-1048e9dc24df admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:42.932183 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab0a34-78fb-4a91-bf1c-1048e9dc24df admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:42.932457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab0a34-78fb-4a91-bf1c-1048e9dc24df admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:42.933195 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab0a34-78fb-4a91-bf1c-1048e9dc24df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:42.934933 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab0a34-78fb-4a91-bf1c-1048e9dc24df admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:42.948377 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1237/2448] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:04:42.949703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53940800-28f3-422e-94fb-8a530a3a65cc admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:42.960285 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53940800-28f3-422e-94fb-8a530a3a65cc admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:42.965024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd951d0c-588e-4de2-be18-de53488920de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:42.965913 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd951d0c-588e-4de2-be18-de53488920de admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:42.966186 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd951d0c-588e-4de2-be18-de53488920de admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:42.966455 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd951d0c-588e-4de2-be18-de53488920de admin admin] PATH_INFO: `/v3/projects/3284a51fafcd4f5c84ad8c541ea7021e/users/cb76c12589e14ea7b673f745f6465ef8/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:42.968447 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd951d0c-588e-4de2-be18-de53488920de admin admin] RBAC: Authorizing `identity:create_grant(project_id=3284a51fafcd4f5c84ad8c541ea7021e, user_id=cb76c12589e14ea7b673f745f6465ef8, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:42.971107 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd951d0c-588e-4de2-be18-de53488920de admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:42.981527 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1212/2449] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:04:42 2022] PUT /identity/v3/projects/3284a51fafcd4f5c84ad8c541ea7021e/users/cb76c12589e14ea7b673f745f6465ef8/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:04:48.095951 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee7ae8-5956-4b43-8e67-c9c9c32f42cc None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:48.096538 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee7ae8-5956-4b43-8e67-c9c9c32f42cc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:48.096538 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee7ae8-5956-4b43-8e67-c9c9c32f42cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:48.138162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-72ee7ae8-5956-4b43-8e67-c9c9c32f42cc None None] MFA Rules not processed for user `cb76c12589e14ea7b673f745f6465ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:04:48.139560 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-72ee7ae8-5956-4b43-8e67-c9c9c32f42cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:04:48.222733 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1238/2450] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:04:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:04:48.238813 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd951d0c-588e-4de2-be18-de53488920de admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:04:48.241853 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fd951d0c-588e-4de2-be18-de53488920de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:04:48.356573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd951d0c-588e-4de2-be18-de53488920de admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:04:48.362340 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0231e-1c2f-4dbb-9754-db02b4496889 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:04:48.363046 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0231e-1c2f-4dbb-9754-db02b4496889 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:04:48.363683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0231e-1c2f-4dbb-9754-db02b4496889 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:04:48.363683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0231e-1c2f-4dbb-9754-db02b4496889 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:04:48.434617 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0231e-1c2f-4dbb-9754-db02b4496889 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:04:48.436266 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0231e-1c2f-4dbb-9754-db02b4496889 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:04:48.447024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1213/2451] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:04:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:05:22.112955 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee7ae8-5956-4b43-8e67-c9c9c32f42cc None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:05:22.114651 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-72ee7ae8-5956-4b43-8e67-c9c9c32f42cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:05:22.181114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee7ae8-5956-4b43-8e67-c9c9c32f42cc None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:05:22.185707 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9c5ee-bd8b-47e5-8390-5ad5884e41a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:05:22.186357 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9c5ee-bd8b-47e5-8390-5ad5884e41a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:05:22.186632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9c5ee-bd8b-47e5-8390-5ad5884e41a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:05:22.186902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9c5ee-bd8b-47e5-8390-5ad5884e41a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:05:22.189072 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-69d9c5ee-bd8b-47e5-8390-5ad5884e41a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:05:22.274905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9c5ee-bd8b-47e5-8390-5ad5884e41a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:05:22.276388 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9c5ee-bd8b-47e5-8390-5ad5884e41a1 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:05:22.295555 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1239/2452] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:05:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:05:26.724226 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0231e-1c2f-4dbb-9754-db02b4496889 service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:05:26.737127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0231e-1c2f-4dbb-9754-db02b4496889 service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:05:26.741717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720efaee-c102-4965-bca6-1eb0f7380ce4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:05:26.742436 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720efaee-c102-4965-bca6-1eb0f7380ce4 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:05:26.742721 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720efaee-c102-4965-bca6-1eb0f7380ce4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:05:26.743066 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720efaee-c102-4965-bca6-1eb0f7380ce4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:05:26.745028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-720efaee-c102-4965-bca6-1eb0f7380ce4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:05:26.825007 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720efaee-c102-4965-bca6-1eb0f7380ce4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:05:26.826433 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720efaee-c102-4965-bca6-1eb0f7380ce4 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:05:26.844351 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1214/2453] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:05:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:06:02.851857 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64395c-0d41-4d9f-9f05-2372072bff75 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:06:02.852854 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64395c-0d41-4d9f-9f05-2372072bff75 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:06:02.853148 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64395c-0d41-4d9f-9f05-2372072bff75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:06:02.878904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5f64395c-0d41-4d9f-9f05-2372072bff75 None None] MFA Rules not processed for user `3abe8bdd0c8948eb97dcc7292359520c`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:06:02.880185 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5f64395c-0d41-4d9f-9f05-2372072bff75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:06:02.887693 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1240/2454] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:06:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:06:03.384248 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720efaee-c102-4965-bca6-1eb0f7380ce4 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:06:03.443912 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720efaee-c102-4965-bca6-1eb0f7380ce4 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:06:03.448007 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6cb08-2736-47bc-b9ea-2793f9055ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:06:03.448669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6cb08-2736-47bc-b9ea-2793f9055ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:06:03.448950 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6cb08-2736-47bc-b9ea-2793f9055ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:06:03.449225 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6cb08-2736-47bc-b9ea-2793f9055ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:06:03.451130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-52f6cb08-2736-47bc-b9ea-2793f9055ab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:06:03.461301 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6cb08-2736-47bc-b9ea-2793f9055ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:06:03.462745 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6cb08-2736-47bc-b9ea-2793f9055ab3 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:06:03.471634 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1215/2455] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:06:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:06:03.944399 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64395c-0d41-4d9f-9f05-2372072bff75 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:06:03.945975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5f64395c-0d41-4d9f-9f05-2372072bff75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:06:04.029341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64395c-0d41-4d9f-9f05-2372072bff75 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:06:04.034882 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a61768-7759-4106-8a8c-c75ffbba5a46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46e2703839e498da8f3e2c3fda1d61c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:06:04.035803 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a61768-7759-4106-8a8c-c75ffbba5a46 service placement] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:06:04.036253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a61768-7759-4106-8a8c-c75ffbba5a46 service placement] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:06:04.036530 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a61768-7759-4106-8a8c-c75ffbba5a46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:06:04.038437 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-95a61768-7759-4106-8a8c-c75ffbba5a46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:06:04.051537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a61768-7759-4106-8a8c-c75ffbba5a46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:06:04.053157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a61768-7759-4106-8a8c-c75ffbba5a46 service placement] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:06:04.063639 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1241/2456] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:06:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:06:04.108284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e58b8-47e9-41fe-900c-d716605ea643 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:06:04.108569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e58b8-47e9-41fe-900c-d716605ea643 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:06:04.108867 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e58b8-47e9-41fe-900c-d716605ea643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:06:04.145654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-6c6e58b8-47e9-41fe-900c-d716605ea643 None None] MFA Rules not processed for user `cffc26233de74f0ea2c438f588be3ade`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:06:04.147037 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6c6e58b8-47e9-41fe-900c-d716605ea643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:06:04.154495 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1216/2457] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:06:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:06:05.404338 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a61768-7759-4106-8a8c-c75ffbba5a46 service placement] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:06:05.406030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-95a61768-7759-4106-8a8c-c75ffbba5a46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:06:05.419787 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a61768-7759-4106-8a8c-c75ffbba5a46 service placement] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:06:05.424201 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c2828-9c43-4086-be7a-e090fc73c8ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:06:05.425013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c2828-9c43-4086-be7a-e090fc73c8ee service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:06:05.425298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c2828-9c43-4086-be7a-e090fc73c8ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:06:05.425575 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c2828-9c43-4086-be7a-e090fc73c8ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:06:05.427451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ca8c2828-9c43-4086-be7a-e090fc73c8ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:06:05.438306 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c2828-9c43-4086-be7a-e090fc73c8ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:06:05.440901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c2828-9c43-4086-be7a-e090fc73c8ee service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:06:05.451900 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1242/2458] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:06:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:06:05.743177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e58b8-47e9-41fe-900c-d716605ea643 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:06:05.754318 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e58b8-47e9-41fe-900c-d716605ea643 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:06:05.759143 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1b5d3-5bcc-4f90-9a73-36a82b98bf69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:06:05.759813 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1b5d3-5bcc-4f90-9a73-36a82b98bf69 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:06:05.760095 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1b5d3-5bcc-4f90-9a73-36a82b98bf69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:06:05.760418 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1b5d3-5bcc-4f90-9a73-36a82b98bf69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:06:05.762396 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f3e1b5d3-5bcc-4f90-9a73-36a82b98bf69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:06:05.863637 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1b5d3-5bcc-4f90-9a73-36a82b98bf69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:06:05.865246 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1b5d3-5bcc-4f90-9a73-36a82b98bf69 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:06:05.896026 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1217/2459] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:06:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:06:05.972937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c2828-9c43-4086-be7a-e090fc73c8ee service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:06:05.983940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c2828-9c43-4086-be7a-e090fc73c8ee service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:06:05.990178 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16671a-e041-47ed-a85c-3e3b1d1e6a84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:06:05.991196 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16671a-e041-47ed-a85c-3e3b1d1e6a84 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:06:05.992601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16671a-e041-47ed-a85c-3e3b1d1e6a84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:06:05.993126 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16671a-e041-47ed-a85c-3e3b1d1e6a84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:06:05.995850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0a16671a-e041-47ed-a85c-3e3b1d1e6a84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:06:06.012818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16671a-e041-47ed-a85c-3e3b1d1e6a84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:06:06.014706 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16671a-e041-47ed-a85c-3e3b1d1e6a84 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:06:06.028205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1243/2460] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:06:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:06:12.383936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1b5d3-5bcc-4f90-9a73-36a82b98bf69 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:06:12.385773 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f3e1b5d3-5bcc-4f90-9a73-36a82b98bf69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:06:12.415940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1b5d3-5bcc-4f90-9a73-36a82b98bf69 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:06:12.422982 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67df9a-4e71-487f-ac5f-e41827c47f29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:06:12.423643 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67df9a-4e71-487f-ac5f-e41827c47f29 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:06:12.424513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67df9a-4e71-487f-ac5f-e41827c47f29 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:06:12.424513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67df9a-4e71-487f-ac5f-e41827c47f29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:06:12.426015 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3e67df9a-4e71-487f-ac5f-e41827c47f29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:06:12.440595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67df9a-4e71-487f-ac5f-e41827c47f29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:06:12.443082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67df9a-4e71-487f-ac5f-e41827c47f29 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:06:12.454701 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1218/2461] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:06:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:07:36.987797 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16671a-e041-47ed-a85c-3e3b1d1e6a84 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:07:36.989306 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0a16671a-e041-47ed-a85c-3e3b1d1e6a84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:07:37.051995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16671a-e041-47ed-a85c-3e3b1d1e6a84 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:07:37.055782 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa2cf7-914c-478d-bd3a-8137418d9ae4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:07:37.056433 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa2cf7-914c-478d-bd3a-8137418d9ae4 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:07:37.056715 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa2cf7-914c-478d-bd3a-8137418d9ae4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:07:37.056995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa2cf7-914c-478d-bd3a-8137418d9ae4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:07:37.058861 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e0fa2cf7-914c-478d-bd3a-8137418d9ae4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:07:37.163356 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa2cf7-914c-478d-bd3a-8137418d9ae4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:07:37.164794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa2cf7-914c-478d-bd3a-8137418d9ae4 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:07:37.173838 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1244/2462] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:07:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:08:08.548714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67df9a-4e71-487f-ac5f-e41827c47f29 service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:08:08.570182 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67df9a-4e71-487f-ac5f-e41827c47f29 service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:08:08.574678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aff11f-727f-4bea-bfc8-fc15226b3e67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:08:08.575051 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aff11f-727f-4bea-bfc8-fc15226b3e67 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:08:08.575334 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aff11f-727f-4bea-bfc8-fc15226b3e67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:08:08.575629 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aff11f-727f-4bea-bfc8-fc15226b3e67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:08:08.577482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-86aff11f-727f-4bea-bfc8-fc15226b3e67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:08:08.668131 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aff11f-727f-4bea-bfc8-fc15226b3e67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:08:08.669612 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aff11f-727f-4bea-bfc8-fc15226b3e67 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:08:08.698710 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1219/2463] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:08:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:08:26.485838 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa2cf7-914c-478d-bd3a-8137418d9ae4 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:08:26.498139 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa2cf7-914c-478d-bd3a-8137418d9ae4 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:08:26.502992 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d296c-a7f8-4c51-ae86-eadcf13cd0a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:08:26.503674 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d296c-a7f8-4c51-ae86-eadcf13cd0a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:08:26.503955 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d296c-a7f8-4c51-ae86-eadcf13cd0a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:08:26.504231 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d296c-a7f8-4c51-ae86-eadcf13cd0a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:08:26.507578 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c41d296c-a7f8-4c51-ae86-eadcf13cd0a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:08:26.588291 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d296c-a7f8-4c51-ae86-eadcf13cd0a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:08:26.589771 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d296c-a7f8-4c51-ae86-eadcf13cd0a8 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:08:26.608122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1245/2464] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:08:26 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:09:06.625949 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aff11f-727f-4bea-bfc8-fc15226b3e67 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:09:06.627557 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-86aff11f-727f-4bea-bfc8-fc15226b3e67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:09:06.685242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aff11f-727f-4bea-bfc8-fc15226b3e67 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:09:06.690409 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151db919-42d7-41a1-98f1-cf5bed6b61a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46e2703839e498da8f3e2c3fda1d61c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:09:06.691096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151db919-42d7-41a1-98f1-cf5bed6b61a3 service placement] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:09:06.691429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151db919-42d7-41a1-98f1-cf5bed6b61a3 service placement] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:09:06.691657 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151db919-42d7-41a1-98f1-cf5bed6b61a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:09:06.693468 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-151db919-42d7-41a1-98f1-cf5bed6b61a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:09:06.705351 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151db919-42d7-41a1-98f1-cf5bed6b61a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:09:06.707060 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151db919-42d7-41a1-98f1-cf5bed6b61a3 service placement] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:09:06.722151 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1220/2465] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:09:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:09:48.569547 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d296c-a7f8-4c51-ae86-eadcf13cd0a8 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:09:48.584301 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d296c-a7f8-4c51-ae86-eadcf13cd0a8 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:09:48.591376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aca2a5-f5b1-4673-8668-0cd19cafaed1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:09:48.592021 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aca2a5-f5b1-4673-8668-0cd19cafaed1 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:09:48.592298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aca2a5-f5b1-4673-8668-0cd19cafaed1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:09:48.592540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aca2a5-f5b1-4673-8668-0cd19cafaed1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:09:48.608018 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aca2a5-f5b1-4673-8668-0cd19cafaed1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:09:48.610313 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aca2a5-f5b1-4673-8668-0cd19cafaed1 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:09:48.624144 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1246/2466] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:09:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:10:20.555526 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151db919-42d7-41a1-98f1-cf5bed6b61a3 service placement] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:10:20.564640 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151db919-42d7-41a1-98f1-cf5bed6b61a3 service placement] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:10:20.568355 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a392ca-886a-4883-8faf-65f601ff846a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:10:20.569002 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a392ca-886a-4883-8faf-65f601ff846a service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:10:20.569272 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a392ca-886a-4883-8faf-65f601ff846a service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:10:20.569540 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a392ca-886a-4883-8faf-65f601ff846a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:10:20.578081 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a392ca-886a-4883-8faf-65f601ff846a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:10:20.579543 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a392ca-886a-4883-8faf-65f601ff846a service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:10:20.588723 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1221/2467] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:10:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:10:25.768119 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aca2a5-f5b1-4673-8668-0cd19cafaed1 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:10:25.781162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aca2a5-f5b1-4673-8668-0cd19cafaed1 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:10:25.785885 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd042daa-a117-4262-961a-2709d0ee52ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:10:25.786575 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd042daa-a117-4262-961a-2709d0ee52ee service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:10:25.786898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd042daa-a117-4262-961a-2709d0ee52ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:10:25.787397 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd042daa-a117-4262-961a-2709d0ee52ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:10:25.799047 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd042daa-a117-4262-961a-2709d0ee52ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:10:25.801021 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd042daa-a117-4262-961a-2709d0ee52ee service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:10:25.810781 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1247/2468] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:10:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:10:36.543966 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a392ca-886a-4883-8faf-65f601ff846a service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:10:36.545605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f6a392ca-886a-4883-8faf-65f601ff846a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:10:36.643192 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a392ca-886a-4883-8faf-65f601ff846a service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:10:36.648034 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab60dea-f03f-41b4-b6f4-4ff5fd537bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:10:36.648903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab60dea-f03f-41b4-b6f4-4ff5fd537bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:10:36.649181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab60dea-f03f-41b4-b6f4-4ff5fd537bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:10:36.649454 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab60dea-f03f-41b4-b6f4-4ff5fd537bb1 admin admin] PATH_INFO: `/v3/users/1c075b20a7a949fcb5943ec1107a3f58` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:10:36.650651 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab60dea-f03f-41b4-b6f4-4ff5fd537bb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c075b20a7a949fcb5943ec1107a3f58)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:10:36.652615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab60dea-f03f-41b4-b6f4-4ff5fd537bb1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:10:36.699140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1ab60dea-f03f-41b4-b6f4-4ff5fd537bb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c075b20a7a949fcb5943ec1107a3f58'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:10:36.710149 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1ab60dea-f03f-41b4-b6f4-4ff5fd537bb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c075b20a7a949fcb5943ec1107a3f58'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:10:36.710796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1ab60dea-f03f-41b4-b6f4-4ff5fd537bb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c075b20a7a949fcb5943ec1107a3f58'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:10:36.711416 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1ab60dea-f03f-41b4-b6f4-4ff5fd537bb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c075b20a7a949fcb5943ec1107a3f58'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:10:36.720218 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1ab60dea-f03f-41b4-b6f4-4ff5fd537bb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c075b20a7a949fcb5943ec1107a3f58'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:10:36.733233 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1222/2469] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:10:36 2022] DELETE /identity/v3/users/1c075b20a7a949fcb5943ec1107a3f58 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:10:36.738073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15bf19-7f87-41b6-964c-c8e4b40031ed None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:10:36.738594 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15bf19-7f87-41b6-964c-c8e4b40031ed None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:10:36.738594 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15bf19-7f87-41b6-964c-c8e4b40031ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:10:36.767043 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9a15bf19-7f87-41b6-964c-c8e4b40031ed None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:10:36.768256 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9a15bf19-7f87-41b6-964c-c8e4b40031ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:10:36.827159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1248/2470] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:10:36.837521 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab60dea-f03f-41b4-b6f4-4ff5fd537bb1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:10:36.839025 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1ab60dea-f03f-41b4-b6f4-4ff5fd537bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:10:36.912785 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab60dea-f03f-41b4-b6f4-4ff5fd537bb1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:10:36.917190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa28ec8-0a27-48e5-b726-3970ae5bca65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:10:36.917833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa28ec8-0a27-48e5-b726-3970ae5bca65 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:10:36.918106 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa28ec8-0a27-48e5-b726-3970ae5bca65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:10:36.918377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa28ec8-0a27-48e5-b726-3970ae5bca65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:10:36.930496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa28ec8-0a27-48e5-b726-3970ae5bca65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:10:36.931994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa28ec8-0a27-48e5-b726-3970ae5bca65 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:10:36.943950 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1223/2471] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:10:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:10:37.223200 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15bf19-7f87-41b6-964c-c8e4b40031ed None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:10:37.224699 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9a15bf19-7f87-41b6-964c-c8e4b40031ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:10:37.236667 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15bf19-7f87-41b6-964c-c8e4b40031ed None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:10:37.241569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5388da-41b3-4687-b336-037776434aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:10:37.242437 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5388da-41b3-4687-b336-037776434aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:10:37.242719 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5388da-41b3-4687-b336-037776434aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:10:37.243018 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5388da-41b3-4687-b336-037776434aa2 admin admin] PATH_INFO: `/v3/projects/d6f5e54830ef491aaf74e752ff1ab77e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:10:37.244668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5388da-41b3-4687-b336-037776434aa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6f5e54830ef491aaf74e752ff1ab77e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:10:37.246685 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5388da-41b3-4687-b336-037776434aa2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:10:37.306314 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4e5388da-41b3-4687-b336-037776434aa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6f5e54830ef491aaf74e752ff1ab77e', 'request_id': 'req-4e5388da-41b3-4687-b336-037776434aa2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:10:37.312459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4e5388da-41b3-4687-b336-037776434aa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6f5e54830ef491aaf74e752ff1ab77e', 'request_id': 'req-4e5388da-41b3-4687-b336-037776434aa2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:10:37.321105 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4e5388da-41b3-4687-b336-037776434aa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6f5e54830ef491aaf74e752ff1ab77e', 'request_id': 'req-4e5388da-41b3-4687-b336-037776434aa2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:10:37.331139 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4e5388da-41b3-4687-b336-037776434aa2 admin admin] The token cache is being invalidate because project d6f5e54830ef491aaf74e752ff1ab77e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:10:37.331423 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4e5388da-41b3-4687-b336-037776434aa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:10:37.332097 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4e5388da-41b3-4687-b336-037776434aa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:10:37.333679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1249/2472] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:10:37 2022] DELETE /identity/v3/projects/d6f5e54830ef491aaf74e752ff1ab77e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:10:37.340394 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f911376-4be6-47ec-a11e-8fc18615db2f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:10:37.340619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f911376-4be6-47ec-a11e-8fc18615db2f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:10:37.340897 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f911376-4be6-47ec-a11e-8fc18615db2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:10:37.390677 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3f911376-4be6-47ec-a11e-8fc18615db2f None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:10:37.392219 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3f911376-4be6-47ec-a11e-8fc18615db2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:10:37.458861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1224/2473] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:10:37.466395 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd03eb4-93e2-4392-aca4-361db891ea5c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:10:37.466734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd03eb4-93e2-4392-aca4-361db891ea5c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:10:37.467045 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd03eb4-93e2-4392-aca4-361db891ea5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:10:37.486171 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ecd03eb4-93e2-4392-aca4-361db891ea5c None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:10:37.487446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ecd03eb4-93e2-4392-aca4-361db891ea5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:10:37.496937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1250/2474] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:10:37.501394 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f911376-4be6-47ec-a11e-8fc18615db2f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:10:37.511599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f911376-4be6-47ec-a11e-8fc18615db2f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:10:37.517228 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e6cb4-e292-4bcf-9f76-91d11cbb32cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:10:37.517910 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e6cb4-e292-4bcf-9f76-91d11cbb32cf admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:10:37.518186 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e6cb4-e292-4bcf-9f76-91d11cbb32cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:10:37.518454 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e6cb4-e292-4bcf-9f76-91d11cbb32cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:10:37.519221 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e6cb4-e292-4bcf-9f76-91d11cbb32cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:10:37.519525 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e6cb4-e292-4bcf-9f76-91d11cbb32cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:10:37.521127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e6cb4-e292-4bcf-9f76-91d11cbb32cf admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:10:37.532785 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1225/2475] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 07:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:10:37.537270 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd03eb4-93e2-4392-aca4-361db891ea5c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:10:37.547413 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd03eb4-93e2-4392-aca4-361db891ea5c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:10:37.552736 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef14723-355c-4774-9654-1fffeb5d92fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:10:37.553410 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef14723-355c-4774-9654-1fffeb5d92fd admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:10:37.553719 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef14723-355c-4774-9654-1fffeb5d92fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:10:37.553995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef14723-355c-4774-9654-1fffeb5d92fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:10:37.554688 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef14723-355c-4774-9654-1fffeb5d92fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:10:37.556629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef14723-355c-4774-9654-1fffeb5d92fd admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:10:37.583705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1251/2476] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:10:37 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:10:37.588548 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e6cb4-e292-4bcf-9f76-91d11cbb32cf admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:10:37.601829 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e6cb4-e292-4bcf-9f76-91d11cbb32cf admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:10:37.658682 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d460d5-17bb-4c8d-b175-00e1375781d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:10:37.659381 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d460d5-17bb-4c8d-b175-00e1375781d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:10:37.659665 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d460d5-17bb-4c8d-b175-00e1375781d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:10:37.659981 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d460d5-17bb-4c8d-b175-00e1375781d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:10:37.660673 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d460d5-17bb-4c8d-b175-00e1375781d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:10:37.662600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d460d5-17bb-4c8d-b175-00e1375781d2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:10:37.684393 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1226/2477] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:10:37 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:10:37.688530 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef14723-355c-4774-9654-1fffeb5d92fd admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:10:37.698695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef14723-355c-4774-9654-1fffeb5d92fd admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:10:37.703851 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3fb56-fc53-47e6-bef8-22cbe8f599cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:10:37.704511 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3fb56-fc53-47e6-bef8-22cbe8f599cd admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:10:37.704794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3fb56-fc53-47e6-bef8-22cbe8f599cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:10:37.705076 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3fb56-fc53-47e6-bef8-22cbe8f599cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:10:37.705804 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3fb56-fc53-47e6-bef8-22cbe8f599cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:10:37.707508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3fb56-fc53-47e6-bef8-22cbe8f599cd admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:10:37.718083 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1252/2478] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:10:37.722010 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d460d5-17bb-4c8d-b175-00e1375781d2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:10:37.732283 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d460d5-17bb-4c8d-b175-00e1375781d2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:10:37.737509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf094db-2b17-4014-a8db-8850f58b1280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:10:37.738234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf094db-2b17-4014-a8db-8850f58b1280 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:10:37.738514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf094db-2b17-4014-a8db-8850f58b1280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:10:37.738788 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf094db-2b17-4014-a8db-8850f58b1280 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:10:37.739549 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf094db-2b17-4014-a8db-8850f58b1280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:10:37.741178 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf094db-2b17-4014-a8db-8850f58b1280 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:10:37.751848 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1227/2479] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:10:37.755952 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3fb56-fc53-47e6-bef8-22cbe8f599cd admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:10:37.766043 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3fb56-fc53-47e6-bef8-22cbe8f599cd admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:10:37.771240 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f07ce-db4d-4272-a851-2389439f8411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:10:37.772114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f07ce-db4d-4272-a851-2389439f8411 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:10:37.772394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f07ce-db4d-4272-a851-2389439f8411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:10:37.772665 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f07ce-db4d-4272-a851-2389439f8411 admin admin] PATH_INFO: `/v3/projects/b4099001a55d4411a8030d70be31d109/users/5bf23f999f64446a98446f7d07eca23f/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:10:37.788195 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f07ce-db4d-4272-a851-2389439f8411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4099001a55d4411a8030d70be31d109, user_id=5bf23f999f64446a98446f7d07eca23f, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:10:37.791259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f07ce-db4d-4272-a851-2389439f8411 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:10:37.807053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1253/2480] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:10:37 2022] PUT /identity/v3/projects/b4099001a55d4411a8030d70be31d109/users/5bf23f999f64446a98446f7d07eca23f/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:10:37.817496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b9160-f252-400e-a67e-da6bc3fb906d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:10:37.817800 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b9160-f252-400e-a67e-da6bc3fb906d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:10:37.818065 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b9160-f252-400e-a67e-da6bc3fb906d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:10:37.845674 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-476b9160-f252-400e-a67e-da6bc3fb906d None None] MFA Rules not processed for user `5bf23f999f64446a98446f7d07eca23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:10:37.846940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-476b9160-f252-400e-a67e-da6bc3fb906d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:10:37.912378 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1228/2481] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:10:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:10:37.927085 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f07ce-db4d-4272-a851-2389439f8411 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:10:37.928894 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5c9f07ce-db4d-4272-a851-2389439f8411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:10:37.991837 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f07ce-db4d-4272-a851-2389439f8411 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:10:37.996627 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cd897-067c-48fa-be6e-ad7e3c3ae5a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:10:37.997539 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cd897-067c-48fa-be6e-ad7e3c3ae5a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:10:37.997824 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cd897-067c-48fa-be6e-ad7e3c3ae5a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:10:37.998108 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cd897-067c-48fa-be6e-ad7e3c3ae5a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:10:38.007952 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668cd897-067c-48fa-be6e-ad7e3c3ae5a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:10:38.009404 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668cd897-067c-48fa-be6e-ad7e3c3ae5a9 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:10:38.018452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1254/2482] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:10:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:11:05.838990 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b9160-f252-400e-a67e-da6bc3fb906d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:11:05.840447 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-476b9160-f252-400e-a67e-da6bc3fb906d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:11:05.853134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b9160-f252-400e-a67e-da6bc3fb906d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:11:05.856991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d93a1-29e4-43d6-9bc8-95dddd96c123 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:11:05.857728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d93a1-29e4-43d6-9bc8-95dddd96c123 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:11:05.858094 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d93a1-29e4-43d6-9bc8-95dddd96c123 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:11:05.858440 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d93a1-29e4-43d6-9bc8-95dddd96c123 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:11:05.860336 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-520d93a1-29e4-43d6-9bc8-95dddd96c123 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:11:05.921959 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d93a1-29e4-43d6-9bc8-95dddd96c123 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:11:05.923427 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d93a1-29e4-43d6-9bc8-95dddd96c123 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:11:05.932623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1229/2483] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:11:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:11:10.307854 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cd897-067c-48fa-be6e-ad7e3c3ae5a9 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:11:10.309559 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-668cd897-067c-48fa-be6e-ad7e3c3ae5a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:11:10.368026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cd897-067c-48fa-be6e-ad7e3c3ae5a9 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:11:10.373134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b4d6f-6c50-48d8-b381-4d4bbf400c53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:11:10.373908 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b4d6f-6c50-48d8-b381-4d4bbf400c53 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:11:10.374247 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b4d6f-6c50-48d8-b381-4d4bbf400c53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:11:10.374520 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b4d6f-6c50-48d8-b381-4d4bbf400c53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:11:10.376625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e05b4d6f-6c50-48d8-b381-4d4bbf400c53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:11:10.386797 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b4d6f-6c50-48d8-b381-4d4bbf400c53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:11:10.388273 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b4d6f-6c50-48d8-b381-4d4bbf400c53 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:11:10.396767 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1255/2484] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:11:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:11:44.408079 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d93a1-29e4-43d6-9bc8-95dddd96c123 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:11:44.418318 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d93a1-29e4-43d6-9bc8-95dddd96c123 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:11:44.422691 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f878cd2-5764-43ef-860e-69e458c209c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:11:44.423376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f878cd2-5764-43ef-860e-69e458c209c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:11:44.423658 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f878cd2-5764-43ef-860e-69e458c209c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:11:44.423924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f878cd2-5764-43ef-860e-69e458c209c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:11:44.426062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5f878cd2-5764-43ef-860e-69e458c209c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:11:44.529330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f878cd2-5764-43ef-860e-69e458c209c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:11:44.530716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f878cd2-5764-43ef-860e-69e458c209c2 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:11:44.552132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1230/2485] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:11:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:11:45.739313 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b4d6f-6c50-48d8-b381-4d4bbf400c53 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:11:45.740774 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e05b4d6f-6c50-48d8-b381-4d4bbf400c53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:11:45.770779 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b4d6f-6c50-48d8-b381-4d4bbf400c53 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:11:45.775174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00babee5-2a09-4072-9265-59cb8124a5a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:11:45.776116 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00babee5-2a09-4072-9265-59cb8124a5a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:11:45.776465 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00babee5-2a09-4072-9265-59cb8124a5a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:11:45.779127 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00babee5-2a09-4072-9265-59cb8124a5a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:11:45.781062 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-00babee5-2a09-4072-9265-59cb8124a5a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:11:45.795667 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00babee5-2a09-4072-9265-59cb8124a5a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:11:45.797281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00babee5-2a09-4072-9265-59cb8124a5a1 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:11:45.815362 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f878cd2-5764-43ef-860e-69e458c209c2 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:11:45.816880 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1256/2486] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:11:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:11:45.818364 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5f878cd2-5764-43ef-860e-69e458c209c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:11:45.834341 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f878cd2-5764-43ef-860e-69e458c209c2 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:11:45.840574 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a270f05-cda3-4864-a276-f7320c23f5a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:11:45.841652 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a270f05-cda3-4864-a276-f7320c23f5a5 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:11:45.841948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a270f05-cda3-4864-a276-f7320c23f5a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:11:45.842235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a270f05-cda3-4864-a276-f7320c23f5a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:11:45.844220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4a270f05-cda3-4864-a276-f7320c23f5a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:11:45.857721 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a270f05-cda3-4864-a276-f7320c23f5a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:11:45.859349 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a270f05-cda3-4864-a276-f7320c23f5a5 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:11:45.870696 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1231/2487] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:11:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:11:47.993320 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64e0d5-365b-4b77-86be-f95e788ab37e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:11:47.993879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64e0d5-365b-4b77-86be-f95e788ab37e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:11:47.993879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64e0d5-365b-4b77-86be-f95e788ab37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:11:48.084216 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3b64e0d5-365b-4b77-86be-f95e788ab37e None None] MFA Rules not processed for user `99cbf80fc74c4183a6eed3e97f7196f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:11:48.085475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3b64e0d5-365b-4b77-86be-f95e788ab37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:11:48.147097 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1257/2488] 10.222.0.77 () {58 vars in 967 bytes} [Wed May 11 07:11:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:11:48.201460 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a270f05-cda3-4864-a276-f7320c23f5a5 service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:11:48.202993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4a270f05-cda3-4864-a276-f7320c23f5a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:11:48.303539 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a270f05-cda3-4864-a276-f7320c23f5a5 service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:11:48.309756 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1c9f3-5107-4253-b009-cec4506746be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f726f58d30734be7abf15400bff89533', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:11:48.310411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1c9f3-5107-4253-b009-cec4506746be service swift] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:11:48.310690 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1c9f3-5107-4253-b009-cec4506746be service swift] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:11:48.310982 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1c9f3-5107-4253-b009-cec4506746be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:11:48.320283 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1c9f3-5107-4253-b009-cec4506746be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:11:48.321885 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1c9f3-5107-4253-b009-cec4506746be service swift] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:11:48.330075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1232/2489] 10.222.0.77 () {60 vars in 1384 bytes} [Wed May 11 07:11:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 07:11:48.827289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64e0d5-365b-4b77-86be-f95e788ab37e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:11:48.837635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64e0d5-365b-4b77-86be-f95e788ab37e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:11:48.845374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3490a3-f933-4eeb-bf19-0a82f7727b2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:11:48.848436 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3490a3-f933-4eeb-bf19-0a82f7727b2b service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:11:48.848724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3490a3-f933-4eeb-bf19-0a82f7727b2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:11:48.849003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3490a3-f933-4eeb-bf19-0a82f7727b2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:11:48.851267 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3e3490a3-f933-4eeb-bf19-0a82f7727b2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:11:48.918632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3490a3-f933-4eeb-bf19-0a82f7727b2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:11:48.920231 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3490a3-f933-4eeb-bf19-0a82f7727b2b service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:11:48.930064 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1258/2490] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:11:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:11:56.026293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1c9f3-5107-4253-b009-cec4506746be service swift] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:11:56.027930 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-77d1c9f3-5107-4253-b009-cec4506746be service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:11:56.043124 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1c9f3-5107-4253-b009-cec4506746be service swift] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:11:56.048610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89349b3-f138-4b0a-9f62-48759b4ee1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:11:56.049491 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89349b3-f138-4b0a-9f62-48759b4ee1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:11:56.049792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89349b3-f138-4b0a-9f62-48759b4ee1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:11:56.050068 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89349b3-f138-4b0a-9f62-48759b4ee1b8 admin admin] PATH_INFO: `/v3/users/35c313dff3de48a4921c039937812aab` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:11:56.051456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89349b3-f138-4b0a-9f62-48759b4ee1b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35c313dff3de48a4921c039937812aab)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:11:56.053383 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89349b3-f138-4b0a-9f62-48759b4ee1b8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:11:56.101055 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c89349b3-f138-4b0a-9f62-48759b4ee1b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35c313dff3de48a4921c039937812aab'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:11:56.112538 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c89349b3-f138-4b0a-9f62-48759b4ee1b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35c313dff3de48a4921c039937812aab'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:11:56.113217 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c89349b3-f138-4b0a-9f62-48759b4ee1b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35c313dff3de48a4921c039937812aab'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:11:56.113794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c89349b3-f138-4b0a-9f62-48759b4ee1b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35c313dff3de48a4921c039937812aab'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:11:56.122109 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c89349b3-f138-4b0a-9f62-48759b4ee1b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35c313dff3de48a4921c039937812aab'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:11:56.134499 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1233/2491] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:11:56 2022] DELETE /identity/v3/users/35c313dff3de48a4921c039937812aab => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:11:56.317938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3490a3-f933-4eeb-bf19-0a82f7727b2b service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:11:56.330030 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3490a3-f933-4eeb-bf19-0a82f7727b2b service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:11:56.388037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a28d13-eaff-40ef-9170-c6a801e47d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:11:56.388925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a28d13-eaff-40ef-9170-c6a801e47d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:11:56.389209 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a28d13-eaff-40ef-9170-c6a801e47d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:11:56.389486 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a28d13-eaff-40ef-9170-c6a801e47d86 admin admin] PATH_INFO: `/v3/projects/1b9c5af7cbd140d0a1b13b77f53eb9d3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:11:56.390705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a28d13-eaff-40ef-9170-c6a801e47d86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b9c5af7cbd140d0a1b13b77f53eb9d3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:11:56.392664 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a28d13-eaff-40ef-9170-c6a801e47d86 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:11:56.441288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-82a28d13-eaff-40ef-9170-c6a801e47d86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b9c5af7cbd140d0a1b13b77f53eb9d3', 'request_id': 'req-82a28d13-eaff-40ef-9170-c6a801e47d86'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:11:56.447559 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-82a28d13-eaff-40ef-9170-c6a801e47d86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b9c5af7cbd140d0a1b13b77f53eb9d3', 'request_id': 'req-82a28d13-eaff-40ef-9170-c6a801e47d86'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:11:56.457232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-82a28d13-eaff-40ef-9170-c6a801e47d86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b9c5af7cbd140d0a1b13b77f53eb9d3', 'request_id': 'req-82a28d13-eaff-40ef-9170-c6a801e47d86'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:11:56.468020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-82a28d13-eaff-40ef-9170-c6a801e47d86 admin admin] The token cache is being invalidate because project 1b9c5af7cbd140d0a1b13b77f53eb9d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:11:56.468300 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-82a28d13-eaff-40ef-9170-c6a801e47d86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:11:56.468943 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-82a28d13-eaff-40ef-9170-c6a801e47d86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:11:56.470529 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1259/2492] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:11:56 2022] DELETE /identity/v3/projects/1b9c5af7cbd140d0a1b13b77f53eb9d3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:11:56.474523 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89349b3-f138-4b0a-9f62-48759b4ee1b8 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:11:56.476211 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c89349b3-f138-4b0a-9f62-48759b4ee1b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:11:56.490160 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89349b3-f138-4b0a-9f62-48759b4ee1b8 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:11:56.555519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c754d3-a618-4ede-b9bd-67986677460e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:11:56.556407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c754d3-a618-4ede-b9bd-67986677460e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:11:56.556686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c754d3-a618-4ede-b9bd-67986677460e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:11:56.556965 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c754d3-a618-4ede-b9bd-67986677460e admin admin] PATH_INFO: `/v3/users/40f3a246f4734aa785bea6ad63325e50` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:11:56.570218 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c754d3-a618-4ede-b9bd-67986677460e admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f3a246f4734aa785bea6ad63325e50)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:11:56.572184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c754d3-a618-4ede-b9bd-67986677460e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:11:56.616561 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a7c754d3-a618-4ede-b9bd-67986677460e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f3a246f4734aa785bea6ad63325e50'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:11:56.627392 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a7c754d3-a618-4ede-b9bd-67986677460e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f3a246f4734aa785bea6ad63325e50'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:11:56.628133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a7c754d3-a618-4ede-b9bd-67986677460e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f3a246f4734aa785bea6ad63325e50'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:11:56.628764 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a7c754d3-a618-4ede-b9bd-67986677460e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f3a246f4734aa785bea6ad63325e50'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:11:56.638309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a7c754d3-a618-4ede-b9bd-67986677460e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f3a246f4734aa785bea6ad63325e50'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:11:56.649986 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1234/2493] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:11:56 2022] DELETE /identity/v3/users/40f3a246f4734aa785bea6ad63325e50 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:11:56.828004 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a28d13-eaff-40ef-9170-c6a801e47d86 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:11:56.829636 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-82a28d13-eaff-40ef-9170-c6a801e47d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:11:56.842833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a28d13-eaff-40ef-9170-c6a801e47d86 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:11:56.899873 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6a01a-d18b-4da6-8e59-f00c0e8d102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:11:56.900760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6a01a-d18b-4da6-8e59-f00c0e8d102a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:11:56.901049 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6a01a-d18b-4da6-8e59-f00c0e8d102a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:11:56.901329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6a01a-d18b-4da6-8e59-f00c0e8d102a admin admin] PATH_INFO: `/v3/projects/4b705ad8bfbc4e66b747a82996bb3c50` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:11:56.911714 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6a01a-d18b-4da6-8e59-f00c0e8d102a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b705ad8bfbc4e66b747a82996bb3c50)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:11:56.913677 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6a01a-d18b-4da6-8e59-f00c0e8d102a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:11:56.961777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f7c6a01a-d18b-4da6-8e59-f00c0e8d102a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b705ad8bfbc4e66b747a82996bb3c50', 'request_id': 'req-f7c6a01a-d18b-4da6-8e59-f00c0e8d102a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:11:56.968706 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f7c6a01a-d18b-4da6-8e59-f00c0e8d102a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b705ad8bfbc4e66b747a82996bb3c50', 'request_id': 'req-f7c6a01a-d18b-4da6-8e59-f00c0e8d102a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:11:56.977234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f7c6a01a-d18b-4da6-8e59-f00c0e8d102a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b705ad8bfbc4e66b747a82996bb3c50', 'request_id': 'req-f7c6a01a-d18b-4da6-8e59-f00c0e8d102a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:11:56.987496 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f7c6a01a-d18b-4da6-8e59-f00c0e8d102a admin admin] The token cache is being invalidate because project 4b705ad8bfbc4e66b747a82996bb3c50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:11:56.987781 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f7c6a01a-d18b-4da6-8e59-f00c0e8d102a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:11:56.988406 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f7c6a01a-d18b-4da6-8e59-f00c0e8d102a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:11:56.989962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1260/2494] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:11:56 2022] DELETE /identity/v3/projects/4b705ad8bfbc4e66b747a82996bb3c50 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:12:37.561428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c754d3-a618-4ede-b9bd-67986677460e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:12:37.564098 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a7c754d3-a618-4ede-b9bd-67986677460e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:12:37.633003 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c754d3-a618-4ede-b9bd-67986677460e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:12:37.683228 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24ed51-81c6-4d14-939b-08885b49754d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:12:37.683919 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24ed51-81c6-4d14-939b-08885b49754d service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:12:37.684212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24ed51-81c6-4d14-939b-08885b49754d service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:12:37.684478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24ed51-81c6-4d14-939b-08885b49754d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:12:37.686404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9e24ed51-81c6-4d14-939b-08885b49754d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:12:37.745216 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24ed51-81c6-4d14-939b-08885b49754d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:12:37.746662 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24ed51-81c6-4d14-939b-08885b49754d service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:12:37.765025 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1235/2495] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:12:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:13:38.251871 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78e81c-3fe8-4adb-8d39-a754c3874c07 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:13:38.252509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78e81c-3fe8-4adb-8d39-a754c3874c07 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:13:38.252509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78e81c-3fe8-4adb-8d39-a754c3874c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:13:38.276011 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5c78e81c-3fe8-4adb-8d39-a754c3874c07 None None] MFA Rules not processed for user `3abe8bdd0c8948eb97dcc7292359520c`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:13:38.277740 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5c78e81c-3fe8-4adb-8d39-a754c3874c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:13:38.344294 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1261/2496] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:13:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:13:38.712891 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24ed51-81c6-4d14-939b-08885b49754d service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:13:38.714350 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9e24ed51-81c6-4d14-939b-08885b49754d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:13:38.771112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24ed51-81c6-4d14-939b-08885b49754d service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:13:38.775085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1eee2-9f36-46bd-820f-77303cf6edd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:13:38.775962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1eee2-9f36-46bd-820f-77303cf6edd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:13:38.776461 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1eee2-9f36-46bd-820f-77303cf6edd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:13:38.776738 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1eee2-9f36-46bd-820f-77303cf6edd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:13:38.778591 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-83e1eee2-9f36-46bd-820f-77303cf6edd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:13:38.790455 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1eee2-9f36-46bd-820f-77303cf6edd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:13:38.792135 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1eee2-9f36-46bd-820f-77303cf6edd4 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:13:38.801242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1236/2497] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:13:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:13:39.140625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78e81c-3fe8-4adb-8d39-a754c3874c07 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:13:39.143810 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5c78e81c-3fe8-4adb-8d39-a754c3874c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:13:39.210436 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78e81c-3fe8-4adb-8d39-a754c3874c07 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:13:39.215376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a0322-42ec-495f-9ee4-0d47ed186ed8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46e2703839e498da8f3e2c3fda1d61c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:13:39.216026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a0322-42ec-495f-9ee4-0d47ed186ed8 service placement] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:13:39.216303 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a0322-42ec-495f-9ee4-0d47ed186ed8 service placement] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:13:39.216581 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a0322-42ec-495f-9ee4-0d47ed186ed8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:13:39.218352 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ae0a0322-42ec-495f-9ee4-0d47ed186ed8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:13:39.230512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a0322-42ec-495f-9ee4-0d47ed186ed8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:13:39.232407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a0322-42ec-495f-9ee4-0d47ed186ed8 service placement] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:13:39.243195 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1262/2498] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:13:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:13:48.576799 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1eee2-9f36-46bd-820f-77303cf6edd4 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:13:48.585249 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-83e1eee2-9f36-46bd-820f-77303cf6edd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:13:48.657023 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1eee2-9f36-46bd-820f-77303cf6edd4 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:13:48.662849 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e170c-d0c4-4eb4-98fb-535cf865ea6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:13:48.663535 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e170c-d0c4-4eb4-98fb-535cf865ea6b service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:13:48.663813 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e170c-d0c4-4eb4-98fb-535cf865ea6b service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:13:48.664085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e170c-d0c4-4eb4-98fb-535cf865ea6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:13:48.665902 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e82e170c-d0c4-4eb4-98fb-535cf865ea6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:13:48.677672 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e170c-d0c4-4eb4-98fb-535cf865ea6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:13:48.679281 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e170c-d0c4-4eb4-98fb-535cf865ea6b service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:13:48.697241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1237/2499] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:13:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:13:52.267418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a0322-42ec-495f-9ee4-0d47ed186ed8 service placement] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:13:52.281791 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a0322-42ec-495f-9ee4-0d47ed186ed8 service placement] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:13:52.288088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850be523-b3d8-4052-ad92-fbf262f27792 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:13:52.288751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850be523-b3d8-4052-ad92-fbf262f27792 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:13:52.291226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850be523-b3d8-4052-ad92-fbf262f27792 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:13:52.291710 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850be523-b3d8-4052-ad92-fbf262f27792 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:13:52.296515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-850be523-b3d8-4052-ad92-fbf262f27792 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:13:52.309158 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850be523-b3d8-4052-ad92-fbf262f27792 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:13:52.310527 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850be523-b3d8-4052-ad92-fbf262f27792 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:13:52.321581 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1263/2500] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:13:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:14:13.572610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e170c-d0c4-4eb4-98fb-535cf865ea6b service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:14:13.584647 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e170c-d0c4-4eb4-98fb-535cf865ea6b service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:14:13.591247 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4bea7-12c6-4d1b-b080-b6c8b3b10711 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46e2703839e498da8f3e2c3fda1d61c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:14:13.591905 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4bea7-12c6-4d1b-b080-b6c8b3b10711 service placement] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:14:13.592167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4bea7-12c6-4d1b-b080-b6c8b3b10711 service placement] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:14:13.592435 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4bea7-12c6-4d1b-b080-b6c8b3b10711 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:14:13.594435 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-01d4bea7-12c6-4d1b-b080-b6c8b3b10711 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:14:13.606912 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4bea7-12c6-4d1b-b080-b6c8b3b10711 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:14:13.608514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4bea7-12c6-4d1b-b080-b6c8b3b10711 service placement] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:14:13.619421 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1238/2501] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:14:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:14:48.416000 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850be523-b3d8-4052-ad92-fbf262f27792 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:14:48.417846 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-850be523-b3d8-4052-ad92-fbf262f27792 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:14:48.431185 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850be523-b3d8-4052-ad92-fbf262f27792 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:14:48.436213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984d789-bd2e-41af-b51e-6d1cac594958 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:14:48.436954 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984d789-bd2e-41af-b51e-6d1cac594958 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:14:48.437241 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984d789-bd2e-41af-b51e-6d1cac594958 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:14:48.437547 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984d789-bd2e-41af-b51e-6d1cac594958 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:14:48.439943 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7984d789-bd2e-41af-b51e-6d1cac594958 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:14:48.518695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984d789-bd2e-41af-b51e-6d1cac594958 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:14:48.520176 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984d789-bd2e-41af-b51e-6d1cac594958 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:14:48.538662 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1264/2502] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:14:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:15:21.693293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4bea7-12c6-4d1b-b080-b6c8b3b10711 service placement] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:15:21.702642 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4bea7-12c6-4d1b-b080-b6c8b3b10711 service placement] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:15:21.706573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421858ea-dcc9-49cf-b556-d95aec00fee0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:15:21.707249 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421858ea-dcc9-49cf-b556-d95aec00fee0 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:15:21.707534 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421858ea-dcc9-49cf-b556-d95aec00fee0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:15:21.707808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421858ea-dcc9-49cf-b556-d95aec00fee0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:15:21.709612 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-421858ea-dcc9-49cf-b556-d95aec00fee0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:15:21.721144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421858ea-dcc9-49cf-b556-d95aec00fee0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:15:21.723107 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421858ea-dcc9-49cf-b556-d95aec00fee0 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:15:21.732932 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1239/2503] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:15:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:15:26.258009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984d789-bd2e-41af-b51e-6d1cac594958 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:15:26.270579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984d789-bd2e-41af-b51e-6d1cac594958 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:15:26.275298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992e000-2f29-4311-b30e-20df453f4e24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:15:26.275940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992e000-2f29-4311-b30e-20df453f4e24 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:15:26.276242 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992e000-2f29-4311-b30e-20df453f4e24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:15:26.276488 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992e000-2f29-4311-b30e-20df453f4e24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:15:26.278655 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5992e000-2f29-4311-b30e-20df453f4e24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:15:26.341771 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992e000-2f29-4311-b30e-20df453f4e24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:15:26.343252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992e000-2f29-4311-b30e-20df453f4e24 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:15:26.353097 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1265/2504] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:15:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:15:37.976461 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421858ea-dcc9-49cf-b556-d95aec00fee0 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:15:37.985321 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421858ea-dcc9-49cf-b556-d95aec00fee0 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:15:37.989562 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1327806-8bc4-4e63-b366-83e6da275e56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:15:37.990207 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1327806-8bc4-4e63-b366-83e6da275e56 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:15:37.990505 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1327806-8bc4-4e63-b366-83e6da275e56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:15:37.990774 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1327806-8bc4-4e63-b366-83e6da275e56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:15:37.992687 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a1327806-8bc4-4e63-b366-83e6da275e56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:15:38.054831 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1327806-8bc4-4e63-b366-83e6da275e56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:15:38.056414 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1327806-8bc4-4e63-b366-83e6da275e56 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:15:38.065327 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1240/2505] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:15:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:16:06.678039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992e000-2f29-4311-b30e-20df453f4e24 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:16:06.679636 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5992e000-2f29-4311-b30e-20df453f4e24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:16:06.691398 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992e000-2f29-4311-b30e-20df453f4e24 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:16:06.695583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a75f8a-7fac-4c71-8876-f66e45667c93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:16:06.696232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a75f8a-7fac-4c71-8876-f66e45667c93 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:16:06.696494 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a75f8a-7fac-4c71-8876-f66e45667c93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:16:06.696792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a75f8a-7fac-4c71-8876-f66e45667c93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:16:06.698805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c3a75f8a-7fac-4c71-8876-f66e45667c93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:16:06.778680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a75f8a-7fac-4c71-8876-f66e45667c93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:16:06.780058 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a75f8a-7fac-4c71-8876-f66e45667c93 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:16:06.801165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1266/2506] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:16:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:16:13.258934 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1327806-8bc4-4e63-b366-83e6da275e56 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:16:13.260622 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a1327806-8bc4-4e63-b366-83e6da275e56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:16:13.273775 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1327806-8bc4-4e63-b366-83e6da275e56 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:16:13.278315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe9f22-de05-417a-9ddb-4ce6aee0fc94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:16:13.279015 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe9f22-de05-417a-9ddb-4ce6aee0fc94 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:16:13.279329 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe9f22-de05-417a-9ddb-4ce6aee0fc94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:16:13.279602 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe9f22-de05-417a-9ddb-4ce6aee0fc94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:16:13.281764 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-66fe9f22-de05-417a-9ddb-4ce6aee0fc94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:16:13.296101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe9f22-de05-417a-9ddb-4ce6aee0fc94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:16:13.297587 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe9f22-de05-417a-9ddb-4ce6aee0fc94 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:16:13.305919 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1241/2507] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:16:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:16:38.226687 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a75f8a-7fac-4c71-8876-f66e45667c93 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:16:38.228289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c3a75f8a-7fac-4c71-8876-f66e45667c93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:16:38.293699 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a75f8a-7fac-4c71-8876-f66e45667c93 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:16:38.303175 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f8749-1661-42e4-b460-c87320dfe2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:16:38.304070 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f8749-1661-42e4-b460-c87320dfe2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:16:38.304343 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f8749-1661-42e4-b460-c87320dfe2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:16:38.304610 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f8749-1661-42e4-b460-c87320dfe2a2 admin admin] PATH_INFO: `/v3/users/5bf23f999f64446a98446f7d07eca23f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:16:38.305948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f8749-1661-42e4-b460-c87320dfe2a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bf23f999f64446a98446f7d07eca23f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:16:38.308083 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f8749-1661-42e4-b460-c87320dfe2a2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:16:38.359781 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d15f8749-1661-42e4-b460-c87320dfe2a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bf23f999f64446a98446f7d07eca23f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:38.371813 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d15f8749-1661-42e4-b460-c87320dfe2a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bf23f999f64446a98446f7d07eca23f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:38.372482 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d15f8749-1661-42e4-b460-c87320dfe2a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bf23f999f64446a98446f7d07eca23f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:38.373074 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d15f8749-1661-42e4-b460-c87320dfe2a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bf23f999f64446a98446f7d07eca23f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:38.382716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d15f8749-1661-42e4-b460-c87320dfe2a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bf23f999f64446a98446f7d07eca23f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:38.394375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1267/2508] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:16:38 2022] DELETE /identity/v3/users/5bf23f999f64446a98446f7d07eca23f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:16:38.399016 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af6d9b-3c30-4118-95fd-f8f41cca4fe8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:16:38.399515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af6d9b-3c30-4118-95fd-f8f41cca4fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:16:38.399642 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af6d9b-3c30-4118-95fd-f8f41cca4fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:16:38.417192 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-56af6d9b-3c30-4118-95fd-f8f41cca4fe8 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:16:38.418429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-56af6d9b-3c30-4118-95fd-f8f41cca4fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:16:38.486763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1242/2509] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:16:38.493605 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f8749-1661-42e4-b460-c87320dfe2a2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:16:38.503466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d15f8749-1661-42e4-b460-c87320dfe2a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:16:38.558216 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f8749-1661-42e4-b460-c87320dfe2a2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:16:38.562283 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55309d5a-9f1b-49d1-a7a2-ced2291b37b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:16:38.562936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55309d5a-9f1b-49d1-a7a2-ced2291b37b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:16:38.563237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55309d5a-9f1b-49d1-a7a2-ced2291b37b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:16:38.563515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55309d5a-9f1b-49d1-a7a2-ced2291b37b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:16:38.572693 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55309d5a-9f1b-49d1-a7a2-ced2291b37b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:16:38.574166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55309d5a-9f1b-49d1-a7a2-ced2291b37b3 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:16:38.583850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1268/2510] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:16:38.849632 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af6d9b-3c30-4118-95fd-f8f41cca4fe8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:16:38.851086 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-56af6d9b-3c30-4118-95fd-f8f41cca4fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:16:38.871928 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af6d9b-3c30-4118-95fd-f8f41cca4fe8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:16:38.877382 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170eab6-9ff5-4fe9-bd42-60e3ce881127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:16:38.878260 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170eab6-9ff5-4fe9-bd42-60e3ce881127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:16:38.878544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170eab6-9ff5-4fe9-bd42-60e3ce881127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:16:38.878815 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170eab6-9ff5-4fe9-bd42-60e3ce881127 admin admin] PATH_INFO: `/v3/projects/b4099001a55d4411a8030d70be31d109` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:16:38.880093 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170eab6-9ff5-4fe9-bd42-60e3ce881127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4099001a55d4411a8030d70be31d109)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:16:38.882021 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170eab6-9ff5-4fe9-bd42-60e3ce881127 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:16:38.929858 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6170eab6-9ff5-4fe9-bd42-60e3ce881127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4099001a55d4411a8030d70be31d109', 'request_id': 'req-6170eab6-9ff5-4fe9-bd42-60e3ce881127'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:38.935722 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6170eab6-9ff5-4fe9-bd42-60e3ce881127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4099001a55d4411a8030d70be31d109', 'request_id': 'req-6170eab6-9ff5-4fe9-bd42-60e3ce881127'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:38.943903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6170eab6-9ff5-4fe9-bd42-60e3ce881127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4099001a55d4411a8030d70be31d109', 'request_id': 'req-6170eab6-9ff5-4fe9-bd42-60e3ce881127'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:38.954079 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6170eab6-9ff5-4fe9-bd42-60e3ce881127 admin admin] The token cache is being invalidate because project b4099001a55d4411a8030d70be31d109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:16:38.954367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6170eab6-9ff5-4fe9-bd42-60e3ce881127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:38.955089 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6170eab6-9ff5-4fe9-bd42-60e3ce881127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:38.956664 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1243/2511] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:16:38 2022] DELETE /identity/v3/projects/b4099001a55d4411a8030d70be31d109 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:16:51.376197 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55309d5a-9f1b-49d1-a7a2-ced2291b37b3 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:16:51.377615 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-55309d5a-9f1b-49d1-a7a2-ced2291b37b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:16:51.388965 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55309d5a-9f1b-49d1-a7a2-ced2291b37b3 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:16:51.442692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babdf6a-9a2a-4bd4-b67b-bb3ee2c3203a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:16:51.443369 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babdf6a-9a2a-4bd4-b67b-bb3ee2c3203a service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:16:51.443652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babdf6a-9a2a-4bd4-b67b-bb3ee2c3203a service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:16:51.443922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babdf6a-9a2a-4bd4-b67b-bb3ee2c3203a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:16:51.445948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3babdf6a-9a2a-4bd4-b67b-bb3ee2c3203a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:16:51.517292 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babdf6a-9a2a-4bd4-b67b-bb3ee2c3203a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:16:51.518753 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babdf6a-9a2a-4bd4-b67b-bb3ee2c3203a service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:16:51.529435 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1269/2512] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:16:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:16:58.054621 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170eab6-9ff5-4fe9-bd42-60e3ce881127 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:16:58.056385 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6170eab6-9ff5-4fe9-bd42-60e3ce881127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:16:58.069938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170eab6-9ff5-4fe9-bd42-60e3ce881127 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:16:58.074687 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec0d67-57aa-446f-befd-cb87c2a76538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:16:58.075675 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec0d67-57aa-446f-befd-cb87c2a76538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:16:58.076023 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec0d67-57aa-446f-befd-cb87c2a76538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:16:58.076428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec0d67-57aa-446f-befd-cb87c2a76538 admin admin] PATH_INFO: `/v3/users/d649b56b7fd34937b0780a515033b0ea` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:16:58.077692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec0d67-57aa-446f-befd-cb87c2a76538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d649b56b7fd34937b0780a515033b0ea)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:16:58.079733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec0d67-57aa-446f-befd-cb87c2a76538 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:16:58.127338 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6aec0d67-57aa-446f-befd-cb87c2a76538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd649b56b7fd34937b0780a515033b0ea'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:58.138476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6aec0d67-57aa-446f-befd-cb87c2a76538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd649b56b7fd34937b0780a515033b0ea'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:58.139214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6aec0d67-57aa-446f-befd-cb87c2a76538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd649b56b7fd34937b0780a515033b0ea'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:58.139821 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6aec0d67-57aa-446f-befd-cb87c2a76538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd649b56b7fd34937b0780a515033b0ea'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:58.148742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6aec0d67-57aa-446f-befd-cb87c2a76538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd649b56b7fd34937b0780a515033b0ea'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:58.161623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1244/2513] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:16:58 2022] DELETE /identity/v3/users/d649b56b7fd34937b0780a515033b0ea => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:16:58.340648 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babdf6a-9a2a-4bd4-b67b-bb3ee2c3203a service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:16:58.350788 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babdf6a-9a2a-4bd4-b67b-bb3ee2c3203a service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:16:58.409791 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa83f3-9fd5-4ea7-9814-bfa6360d2e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:16:58.410655 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa83f3-9fd5-4ea7-9814-bfa6360d2e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:16:58.410936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa83f3-9fd5-4ea7-9814-bfa6360d2e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:16:58.411247 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa83f3-9fd5-4ea7-9814-bfa6360d2e82 admin admin] PATH_INFO: `/v3/projects/57566b6ed2b94469a58ea60c27a1e2b3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:16:58.412473 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa83f3-9fd5-4ea7-9814-bfa6360d2e82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57566b6ed2b94469a58ea60c27a1e2b3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:16:58.414390 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa83f3-9fd5-4ea7-9814-bfa6360d2e82 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:16:58.467757 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a0fa83f3-9fd5-4ea7-9814-bfa6360d2e82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57566b6ed2b94469a58ea60c27a1e2b3', 'request_id': 'req-a0fa83f3-9fd5-4ea7-9814-bfa6360d2e82'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:58.473683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a0fa83f3-9fd5-4ea7-9814-bfa6360d2e82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57566b6ed2b94469a58ea60c27a1e2b3', 'request_id': 'req-a0fa83f3-9fd5-4ea7-9814-bfa6360d2e82'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:58.484966 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a0fa83f3-9fd5-4ea7-9814-bfa6360d2e82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57566b6ed2b94469a58ea60c27a1e2b3', 'request_id': 'req-a0fa83f3-9fd5-4ea7-9814-bfa6360d2e82'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:58.499661 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a0fa83f3-9fd5-4ea7-9814-bfa6360d2e82 admin admin] The token cache is being invalidate because project 57566b6ed2b94469a58ea60c27a1e2b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:16:58.499945 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a0fa83f3-9fd5-4ea7-9814-bfa6360d2e82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:58.500604 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a0fa83f3-9fd5-4ea7-9814-bfa6360d2e82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:58.502195 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1270/2514] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:16:58 2022] DELETE /identity/v3/projects/57566b6ed2b94469a58ea60c27a1e2b3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:16:58.506230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec0d67-57aa-446f-befd-cb87c2a76538 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:16:58.507720 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6aec0d67-57aa-446f-befd-cb87c2a76538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:16:58.520563 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec0d67-57aa-446f-befd-cb87c2a76538 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:16:58.578358 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2073f8c-ded9-4cc2-8843-61368a281695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:16:58.579391 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2073f8c-ded9-4cc2-8843-61368a281695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:16:58.579693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2073f8c-ded9-4cc2-8843-61368a281695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:16:58.579988 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2073f8c-ded9-4cc2-8843-61368a281695 admin admin] PATH_INFO: `/v3/users/cb76c12589e14ea7b673f745f6465ef8` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:16:58.594421 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2073f8c-ded9-4cc2-8843-61368a281695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb76c12589e14ea7b673f745f6465ef8)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:16:58.597074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2073f8c-ded9-4cc2-8843-61368a281695 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:16:58.652660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c2073f8c-ded9-4cc2-8843-61368a281695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb76c12589e14ea7b673f745f6465ef8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:58.667767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c2073f8c-ded9-4cc2-8843-61368a281695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb76c12589e14ea7b673f745f6465ef8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:58.668521 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c2073f8c-ded9-4cc2-8843-61368a281695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb76c12589e14ea7b673f745f6465ef8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:58.669115 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c2073f8c-ded9-4cc2-8843-61368a281695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb76c12589e14ea7b673f745f6465ef8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:58.677327 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c2073f8c-ded9-4cc2-8843-61368a281695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb76c12589e14ea7b673f745f6465ef8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:58.689728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1245/2515] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:16:58 2022] DELETE /identity/v3/users/cb76c12589e14ea7b673f745f6465ef8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:16:58.884685 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa83f3-9fd5-4ea7-9814-bfa6360d2e82 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:16:58.886205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a0fa83f3-9fd5-4ea7-9814-bfa6360d2e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:16:58.900418 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa83f3-9fd5-4ea7-9814-bfa6360d2e82 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:16:58.959293 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7cc9f-bead-49b3-826e-5a41a39ff153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:16:58.960162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7cc9f-bead-49b3-826e-5a41a39ff153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:16:58.960445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7cc9f-bead-49b3-826e-5a41a39ff153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:16:58.960719 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7cc9f-bead-49b3-826e-5a41a39ff153 admin admin] PATH_INFO: `/v3/projects/3284a51fafcd4f5c84ad8c541ea7021e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:16:58.971014 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7cc9f-bead-49b3-826e-5a41a39ff153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3284a51fafcd4f5c84ad8c541ea7021e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:16:58.972944 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7cc9f-bead-49b3-826e-5a41a39ff153 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:16:59.019687 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cfd7cc9f-bead-49b3-826e-5a41a39ff153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3284a51fafcd4f5c84ad8c541ea7021e', 'request_id': 'req-cfd7cc9f-bead-49b3-826e-5a41a39ff153'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:59.026039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cfd7cc9f-bead-49b3-826e-5a41a39ff153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3284a51fafcd4f5c84ad8c541ea7021e', 'request_id': 'req-cfd7cc9f-bead-49b3-826e-5a41a39ff153'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:59.035125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cfd7cc9f-bead-49b3-826e-5a41a39ff153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3284a51fafcd4f5c84ad8c541ea7021e', 'request_id': 'req-cfd7cc9f-bead-49b3-826e-5a41a39ff153'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:59.045230 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cfd7cc9f-bead-49b3-826e-5a41a39ff153 admin admin] The token cache is being invalidate because project 3284a51fafcd4f5c84ad8c541ea7021e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:16:59.045509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cfd7cc9f-bead-49b3-826e-5a41a39ff153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:59.046145 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cfd7cc9f-bead-49b3-826e-5a41a39ff153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:16:59.047807 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1271/2516] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:16:58 2022] DELETE /identity/v3/projects/3284a51fafcd4f5c84ad8c541ea7021e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:17:37.629311 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2073f8c-ded9-4cc2-8843-61368a281695 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:17:37.631975 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c2073f8c-ded9-4cc2-8843-61368a281695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:17:37.746685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2073f8c-ded9-4cc2-8843-61368a281695 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:17:37.797778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf9ca9-8ba9-43eb-b00e-25ba9a5492ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:17:37.798437 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf9ca9-8ba9-43eb-b00e-25ba9a5492ab service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:17:37.798819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf9ca9-8ba9-43eb-b00e-25ba9a5492ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:17:37.799129 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf9ca9-8ba9-43eb-b00e-25ba9a5492ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:17:37.801034 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5ebf9ca9-8ba9-43eb-b00e-25ba9a5492ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:17:37.897370 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf9ca9-8ba9-43eb-b00e-25ba9a5492ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:17:37.898811 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf9ca9-8ba9-43eb-b00e-25ba9a5492ab service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:17:37.907896 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1246/2517] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:17:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:19:11.939519 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7cc9f-bead-49b3-826e-5a41a39ff153 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:19:11.940930 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cfd7cc9f-bead-49b3-826e-5a41a39ff153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:12.011598 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7cc9f-bead-49b3-826e-5a41a39ff153 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:19:12.015780 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc53c8-26d1-4b00-9869-86d4dcc42053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:19:12.016433 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc53c8-26d1-4b00-9869-86d4dcc42053 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:12.016712 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc53c8-26d1-4b00-9869-86d4dcc42053 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:12.016992 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc53c8-26d1-4b00-9869-86d4dcc42053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:12.018839 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a0cc53c8-26d1-4b00-9869-86d4dcc42053 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:12.097667 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc53c8-26d1-4b00-9869-86d4dcc42053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:19:12.099162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc53c8-26d1-4b00-9869-86d4dcc42053 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:19:12.110170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1272/2518] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:19:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:19:13.286808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf9ca9-8ba9-43eb-b00e-25ba9a5492ab service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:19:13.288324 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5ebf9ca9-8ba9-43eb-b00e-25ba9a5492ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:13.314487 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf9ca9-8ba9-43eb-b00e-25ba9a5492ab service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:19:13.319820 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66b375-deb1-48d0-a39b-e6dc58569874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:19:13.320703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66b375-deb1-48d0-a39b-e6dc58569874 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:13.320845 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66b375-deb1-48d0-a39b-e6dc58569874 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:13.321057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66b375-deb1-48d0-a39b-e6dc58569874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:13.322794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0e66b375-deb1-48d0-a39b-e6dc58569874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:13.337426 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66b375-deb1-48d0-a39b-e6dc58569874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:19:13.339559 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66b375-deb1-48d0-a39b-e6dc58569874 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:19:13.350910 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1247/2519] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:19:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:19:13.491680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc53c8-26d1-4b00-9869-86d4dcc42053 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:19:13.493924 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a0cc53c8-26d1-4b00-9869-86d4dcc42053 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:13.509564 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc53c8-26d1-4b00-9869-86d4dcc42053 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:19:13.526279 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020219c-8868-4a17-b211-02034fe9ad6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:19:13.529671 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020219c-8868-4a17-b211-02034fe9ad6c service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:13.530520 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020219c-8868-4a17-b211-02034fe9ad6c service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:13.530903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020219c-8868-4a17-b211-02034fe9ad6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:13.534445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8020219c-8868-4a17-b211-02034fe9ad6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:13.550070 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020219c-8868-4a17-b211-02034fe9ad6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:19:13.551817 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020219c-8868-4a17-b211-02034fe9ad6c service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:19:13.566512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1273/2520] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:19:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:19:13.998916 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66b375-deb1-48d0-a39b-e6dc58569874 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:19:14.000695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0e66b375-deb1-48d0-a39b-e6dc58569874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:14.093365 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66b375-deb1-48d0-a39b-e6dc58569874 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:19:14.098805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb9383-38a8-446b-8db1-be8a5aad164d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46e2703839e498da8f3e2c3fda1d61c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:19:14.099594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb9383-38a8-446b-8db1-be8a5aad164d service placement] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:14.099998 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb9383-38a8-446b-8db1-be8a5aad164d service placement] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:14.100284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb9383-38a8-446b-8db1-be8a5aad164d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:14.102118 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7bfb9383-38a8-446b-8db1-be8a5aad164d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:14.113967 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb9383-38a8-446b-8db1-be8a5aad164d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:19:14.115594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb9383-38a8-446b-8db1-be8a5aad164d service placement] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:19:14.125416 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1248/2521] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:19:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:19:17.119866 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020219c-8868-4a17-b211-02034fe9ad6c service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:19:17.130375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020219c-8868-4a17-b211-02034fe9ad6c service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:19:17.134937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97ce02-ae84-4661-b9a5-979fc3bbf5ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:19:17.135614 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97ce02-ae84-4661-b9a5-979fc3bbf5ab service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:17.135897 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97ce02-ae84-4661-b9a5-979fc3bbf5ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:17.136172 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97ce02-ae84-4661-b9a5-979fc3bbf5ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:17.138416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5f97ce02-ae84-4661-b9a5-979fc3bbf5ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:17.204750 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97ce02-ae84-4661-b9a5-979fc3bbf5ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:19:17.206107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97ce02-ae84-4661-b9a5-979fc3bbf5ab service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:19:17.216315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1274/2522] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:19:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:19:20.495456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb9383-38a8-446b-8db1-be8a5aad164d service placement] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:19:20.496971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7bfb9383-38a8-446b-8db1-be8a5aad164d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:20.510262 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb9383-38a8-446b-8db1-be8a5aad164d service placement] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:19:20.515132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f90f5-d9f9-402d-9d82-f9ad4730e5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:19:20.516028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f90f5-d9f9-402d-9d82-f9ad4730e5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:20.516305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f90f5-d9f9-402d-9d82-f9ad4730e5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:20.516572 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f90f5-d9f9-402d-9d82-f9ad4730e5d1 admin admin] PATH_INFO: `/v3/users/63548f8706214c4e9b116dfd89fc0372` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:20.517756 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f90f5-d9f9-402d-9d82-f9ad4730e5d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63548f8706214c4e9b116dfd89fc0372)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:19:20.519717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f90f5-d9f9-402d-9d82-f9ad4730e5d1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:19:20.566278 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ba1f90f5-d9f9-402d-9d82-f9ad4730e5d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63548f8706214c4e9b116dfd89fc0372'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:19:20.579058 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ba1f90f5-d9f9-402d-9d82-f9ad4730e5d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63548f8706214c4e9b116dfd89fc0372'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:19:20.579787 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ba1f90f5-d9f9-402d-9d82-f9ad4730e5d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63548f8706214c4e9b116dfd89fc0372'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:19:20.580472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ba1f90f5-d9f9-402d-9d82-f9ad4730e5d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63548f8706214c4e9b116dfd89fc0372'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:19:20.589435 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ba1f90f5-d9f9-402d-9d82-f9ad4730e5d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63548f8706214c4e9b116dfd89fc0372'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:19:20.601525 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1249/2523] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:19:20 2022] DELETE /identity/v3/users/63548f8706214c4e9b116dfd89fc0372 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:19:20.777007 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97ce02-ae84-4661-b9a5-979fc3bbf5ab service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:19:20.791175 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97ce02-ae84-4661-b9a5-979fc3bbf5ab service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:19:20.848448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30cc7a-4362-44a4-8bde-d6fa7a304fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:19:20.848980 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30cc7a-4362-44a4-8bde-d6fa7a304fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:20.849245 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30cc7a-4362-44a4-8bde-d6fa7a304fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:20.849516 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30cc7a-4362-44a4-8bde-d6fa7a304fae admin admin] PATH_INFO: `/v3/projects/fe49406d807c4471ab917e8e50f25fe2` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:20.850855 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30cc7a-4362-44a4-8bde-d6fa7a304fae admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe49406d807c4471ab917e8e50f25fe2)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:19:20.852998 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30cc7a-4362-44a4-8bde-d6fa7a304fae admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:19:20.904139 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-be30cc7a-4362-44a4-8bde-d6fa7a304fae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe49406d807c4471ab917e8e50f25fe2', 'request_id': 'req-be30cc7a-4362-44a4-8bde-d6fa7a304fae'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:19:20.910561 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-be30cc7a-4362-44a4-8bde-d6fa7a304fae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe49406d807c4471ab917e8e50f25fe2', 'request_id': 'req-be30cc7a-4362-44a4-8bde-d6fa7a304fae'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:19:20.920183 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-be30cc7a-4362-44a4-8bde-d6fa7a304fae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe49406d807c4471ab917e8e50f25fe2', 'request_id': 'req-be30cc7a-4362-44a4-8bde-d6fa7a304fae'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:19:20.933607 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-be30cc7a-4362-44a4-8bde-d6fa7a304fae admin admin] The token cache is being invalidate because project fe49406d807c4471ab917e8e50f25fe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:19:20.933955 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-be30cc7a-4362-44a4-8bde-d6fa7a304fae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:19:20.934907 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-be30cc7a-4362-44a4-8bde-d6fa7a304fae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:19:20.937060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1275/2524] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:19:20 2022] DELETE /identity/v3/projects/fe49406d807c4471ab917e8e50f25fe2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:19:20.943385 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd783585-73d1-47ad-988c-5d9089792f3f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:20.943675 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd783585-73d1-47ad-988c-5d9089792f3f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:20.943947 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd783585-73d1-47ad-988c-5d9089792f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:20.962483 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fd783585-73d1-47ad-988c-5d9089792f3f None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:19:20.963722 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fd783585-73d1-47ad-988c-5d9089792f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:21.022017 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1250/2525] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:19:21.033254 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43896503-9533-4aa6-81c3-a690f21aceb1 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:21.033601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43896503-9533-4aa6-81c3-a690f21aceb1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:21.034318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43896503-9533-4aa6-81c3-a690f21aceb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:21.054404 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-43896503-9533-4aa6-81c3-a690f21aceb1 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:19:21.055661 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-43896503-9533-4aa6-81c3-a690f21aceb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:21.064787 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1276/2526] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:19:21.069161 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd783585-73d1-47ad-988c-5d9089792f3f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:19:21.079311 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd783585-73d1-47ad-988c-5d9089792f3f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:19:21.085541 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee04d13-ea94-4d96-9ba9-573e4015962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:19:21.086198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee04d13-ea94-4d96-9ba9-573e4015962f admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:21.086483 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee04d13-ea94-4d96-9ba9-573e4015962f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:21.086747 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee04d13-ea94-4d96-9ba9-573e4015962f admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:21.087507 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee04d13-ea94-4d96-9ba9-573e4015962f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:19:21.087813 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee04d13-ea94-4d96-9ba9-573e4015962f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:19:21.089418 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee04d13-ea94-4d96-9ba9-573e4015962f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:19:21.101514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1251/2527] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 07:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:19:21.106232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43896503-9533-4aa6-81c3-a690f21aceb1 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:19:21.120363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43896503-9533-4aa6-81c3-a690f21aceb1 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:19:21.127263 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74179f6-54bc-421b-829c-cafbf609e20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:19:21.127925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74179f6-54bc-421b-829c-cafbf609e20f admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:21.128200 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74179f6-54bc-421b-829c-cafbf609e20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:21.128475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74179f6-54bc-421b-829c-cafbf609e20f admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:21.129166 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74179f6-54bc-421b-829c-cafbf609e20f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:19:21.131110 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74179f6-54bc-421b-829c-cafbf609e20f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:19:21.171150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1277/2528] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:19:21 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:19:21.173140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee04d13-ea94-4d96-9ba9-573e4015962f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:19:21.182929 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee04d13-ea94-4d96-9ba9-573e4015962f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:19:21.239101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcaa64c-b51d-4e02-97b3-8fc609560f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:19:21.239931 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaa64c-b51d-4e02-97b3-8fc609560f89 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:21.240049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaa64c-b51d-4e02-97b3-8fc609560f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:21.240295 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaa64c-b51d-4e02-97b3-8fc609560f89 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:21.240982 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcaa64c-b51d-4e02-97b3-8fc609560f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:19:21.242892 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcaa64c-b51d-4e02-97b3-8fc609560f89 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:19:21.266522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1252/2529] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:19:21 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:19:21.270629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74179f6-54bc-421b-829c-cafbf609e20f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:19:21.280958 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74179f6-54bc-421b-829c-cafbf609e20f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:19:21.286074 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4be2e-ebf6-4af6-a632-238a2e6ab943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:19:21.286751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4be2e-ebf6-4af6-a632-238a2e6ab943 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:21.287070 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4be2e-ebf6-4af6-a632-238a2e6ab943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:21.287345 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4be2e-ebf6-4af6-a632-238a2e6ab943 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:21.288082 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4be2e-ebf6-4af6-a632-238a2e6ab943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:19:21.289698 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4be2e-ebf6-4af6-a632-238a2e6ab943 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:19:21.299762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1278/2530] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:19:21.303896 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcaa64c-b51d-4e02-97b3-8fc609560f89 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:19:21.314181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcaa64c-b51d-4e02-97b3-8fc609560f89 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:19:21.319613 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d740a81-9dbb-411f-b989-888008a105d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:19:21.320277 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d740a81-9dbb-411f-b989-888008a105d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:21.320535 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d740a81-9dbb-411f-b989-888008a105d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:21.320808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d740a81-9dbb-411f-b989-888008a105d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:21.321587 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d740a81-9dbb-411f-b989-888008a105d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:19:21.323260 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d740a81-9dbb-411f-b989-888008a105d5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:19:21.333185 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1253/2531] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:19:21.337537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4be2e-ebf6-4af6-a632-238a2e6ab943 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:19:21.347517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4be2e-ebf6-4af6-a632-238a2e6ab943 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:19:21.352756 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf74bfc-c53b-41e0-b631-13b14c763597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:19:21.353582 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf74bfc-c53b-41e0-b631-13b14c763597 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:21.353875 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf74bfc-c53b-41e0-b631-13b14c763597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:21.354122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf74bfc-c53b-41e0-b631-13b14c763597 admin admin] PATH_INFO: `/v3/projects/77fc86227d494376b6634da64720bbbc/users/17f57a9a926b4954acb4c002367474ec/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:21.369679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf74bfc-c53b-41e0-b631-13b14c763597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77fc86227d494376b6634da64720bbbc, user_id=17f57a9a926b4954acb4c002367474ec, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:19:21.372456 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf74bfc-c53b-41e0-b631-13b14c763597 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:19:21.387266 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1279/2532] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:19:21 2022] PUT /identity/v3/projects/77fc86227d494376b6634da64720bbbc/users/17f57a9a926b4954acb4c002367474ec/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:19:21.392399 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0f6f4-70c0-4d82-ab83-c0ec2c8053c7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:21.392686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0f6f4-70c0-4d82-ab83-c0ec2c8053c7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:21.393014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0f6f4-70c0-4d82-ab83-c0ec2c8053c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:21.410993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fdd0f6f4-70c0-4d82-ab83-c0ec2c8053c7 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:19:21.412253 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fdd0f6f4-70c0-4d82-ab83-c0ec2c8053c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:21.483598 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1254/2533] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:19:21.495039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf74bfc-c53b-41e0-b631-13b14c763597 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:19:21.497242 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9cf74bfc-c53b-41e0-b631-13b14c763597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:21.558508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf74bfc-c53b-41e0-b631-13b14c763597 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:19:21.563398 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00436c77-3b56-456c-a544-d98071abbbf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:19:21.564057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00436c77-3b56-456c-a544-d98071abbbf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:21.564341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00436c77-3b56-456c-a544-d98071abbbf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:21.564613 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00436c77-3b56-456c-a544-d98071abbbf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:21.577884 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00436c77-3b56-456c-a544-d98071abbbf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:19:21.579374 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00436c77-3b56-456c-a544-d98071abbbf2 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:19:21.589596 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1280/2534] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:19:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:19:25.677586 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb670c4-329d-4084-83b7-f6433473fe61 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:25.678078 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb670c4-329d-4084-83b7-f6433473fe61 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:25.679137 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb670c4-329d-4084-83b7-f6433473fe61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:25.710861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7cb670c4-329d-4084-83b7-f6433473fe61 None None] MFA Rules not processed for user `17f57a9a926b4954acb4c002367474ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:19:25.712034 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7cb670c4-329d-4084-83b7-f6433473fe61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:25.795357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1255/2535] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:19:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:19:25.810574 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00436c77-3b56-456c-a544-d98071abbbf2 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:19:25.812491 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-00436c77-3b56-456c-a544-d98071abbbf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:25.896899 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00436c77-3b56-456c-a544-d98071abbbf2 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:19:25.902600 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fb3ba-6595-48a9-9211-b946c33cd3ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:19:25.903405 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fb3ba-6595-48a9-9211-b946c33cd3ce service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:25.903693 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fb3ba-6595-48a9-9211-b946c33cd3ce service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:25.903969 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fb3ba-6595-48a9-9211-b946c33cd3ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:25.913003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fb3ba-6595-48a9-9211-b946c33cd3ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:19:25.914781 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fb3ba-6595-48a9-9211-b946c33cd3ce service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:19:25.924190 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1281/2536] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:19:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:19:27.310235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409408b-d974-4540-9fb1-a3056b4e3bce None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:27.310752 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409408b-d974-4540-9fb1-a3056b4e3bce None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:27.310860 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409408b-d974-4540-9fb1-a3056b4e3bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:27.328445 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-6409408b-d974-4540-9fb1-a3056b4e3bce None None] MFA Rules not processed for user `17f57a9a926b4954acb4c002367474ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:19:27.329694 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6409408b-d974-4540-9fb1-a3056b4e3bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:27.336616 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1256/2537] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:19:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:19:27.650625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fb3ba-6595-48a9-9211-b946c33cd3ce service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:19:27.652950 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-727fb3ba-6595-48a9-9211-b946c33cd3ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:27.668989 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fb3ba-6595-48a9-9211-b946c33cd3ce service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:19:27.673053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea74634-f826-45b6-bf58-433b1d3715fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:19:27.673749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea74634-f826-45b6-bf58-433b1d3715fc service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:27.674073 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea74634-f826-45b6-bf58-433b1d3715fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:27.674252 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea74634-f826-45b6-bf58-433b1d3715fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:27.676354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9ea74634-f826-45b6-bf58-433b1d3715fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:27.686203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea74634-f826-45b6-bf58-433b1d3715fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:19:27.687664 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea74634-f826-45b6-bf58-433b1d3715fc service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:19:27.695621 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1282/2538] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:19:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:19:28.019309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409408b-d974-4540-9fb1-a3056b4e3bce None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:19:28.020893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6409408b-d974-4540-9fb1-a3056b4e3bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:28.107210 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409408b-d974-4540-9fb1-a3056b4e3bce None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:19:28.111909 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9bed1-3807-485c-92e8-4421712d3e00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46e2703839e498da8f3e2c3fda1d61c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:19:28.112683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9bed1-3807-485c-92e8-4421712d3e00 service placement] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:28.113041 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9bed1-3807-485c-92e8-4421712d3e00 service placement] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:28.113389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9bed1-3807-485c-92e8-4421712d3e00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:28.115338 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-28f9bed1-3807-485c-92e8-4421712d3e00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:28.127585 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9bed1-3807-485c-92e8-4421712d3e00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:19:28.129318 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9bed1-3807-485c-92e8-4421712d3e00 service placement] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:19:28.140323 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1257/2539] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:19:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:19:36.462092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea74634-f826-45b6-bf58-433b1d3715fc service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:19:36.463754 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9ea74634-f826-45b6-bf58-433b1d3715fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:36.482162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea74634-f826-45b6-bf58-433b1d3715fc service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:19:36.487940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3232e5-74df-486e-a99e-9495c30dc08f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:19:36.488539 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3232e5-74df-486e-a99e-9495c30dc08f service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:19:36.488824 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3232e5-74df-486e-a99e-9495c30dc08f service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:19:36.489104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3232e5-74df-486e-a99e-9495c30dc08f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:19:36.490902 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9c3232e5-74df-486e-a99e-9495c30dc08f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:19:36.503317 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3232e5-74df-486e-a99e-9495c30dc08f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:19:36.504920 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3232e5-74df-486e-a99e-9495c30dc08f service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:19:36.515885 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1283/2540] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:19:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:20:22.310312 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9bed1-3807-485c-92e8-4421712d3e00 service placement] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:20:22.311888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-28f9bed1-3807-485c-92e8-4421712d3e00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:20:22.371117 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9bed1-3807-485c-92e8-4421712d3e00 service placement] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:20:22.374920 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f18e6-6694-4c6f-9984-a3736ee8caa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:20:22.375600 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f18e6-6694-4c6f-9984-a3736ee8caa7 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:20:22.375881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f18e6-6694-4c6f-9984-a3736ee8caa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:20:22.376153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f18e6-6694-4c6f-9984-a3736ee8caa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:20:22.377953 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cb7f18e6-6694-4c6f-9984-a3736ee8caa7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:20:22.457840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f18e6-6694-4c6f-9984-a3736ee8caa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:20:22.459352 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f18e6-6694-4c6f-9984-a3736ee8caa7 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:20:22.481481 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1258/2541] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:20:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:20:26.532693 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3232e5-74df-486e-a99e-9495c30dc08f service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:20:26.548853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3232e5-74df-486e-a99e-9495c30dc08f service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:20:26.556508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e15de-0f33-4fdb-bb7d-2194c6620f31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:20:26.557542 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e15de-0f33-4fdb-bb7d-2194c6620f31 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:20:26.558244 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e15de-0f33-4fdb-bb7d-2194c6620f31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:20:26.558551 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e15de-0f33-4fdb-bb7d-2194c6620f31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:20:26.560738 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f27e15de-0f33-4fdb-bb7d-2194c6620f31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:20:26.644961 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e15de-0f33-4fdb-bb7d-2194c6620f31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:20:26.648093 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e15de-0f33-4fdb-bb7d-2194c6620f31 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:20:26.676342 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1284/2542] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:20:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:21:17.275659 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f18e6-6694-4c6f-9984-a3736ee8caa7 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:21:17.304755 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f18e6-6694-4c6f-9984-a3736ee8caa7 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:21:17.309218 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163114a-9f3f-4498-bec1-d54caa22313e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:21:17.309875 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163114a-9f3f-4498-bec1-d54caa22313e service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:21:17.310162 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163114a-9f3f-4498-bec1-d54caa22313e service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:21:17.310437 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163114a-9f3f-4498-bec1-d54caa22313e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:21:17.312243 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9163114a-9f3f-4498-bec1-d54caa22313e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:21:17.333815 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163114a-9f3f-4498-bec1-d54caa22313e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:21:17.335414 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163114a-9f3f-4498-bec1-d54caa22313e service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:21:17.343477 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1259/2543] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:21:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:22:36.670331 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e15de-0f33-4fdb-bb7d-2194c6620f31 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:22:36.679694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e15de-0f33-4fdb-bb7d-2194c6620f31 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:22:36.684222 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7538d-92f2-46d4-9bd1-a310008a7fa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:22:36.684876 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7538d-92f2-46d4-9bd1-a310008a7fa7 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:22:36.685157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7538d-92f2-46d4-9bd1-a310008a7fa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:22:36.685428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7538d-92f2-46d4-9bd1-a310008a7fa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:22:36.687455 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0ed7538d-92f2-46d4-9bd1-a310008a7fa7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:22:36.748213 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7538d-92f2-46d4-9bd1-a310008a7fa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:22:36.749645 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7538d-92f2-46d4-9bd1-a310008a7fa7 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:22:36.759632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1285/2544] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:22:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:24:23.528227 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163114a-9f3f-4498-bec1-d54caa22313e service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:23.529867 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9163114a-9f3f-4498-bec1-d54caa22313e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:23.546018 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163114a-9f3f-4498-bec1-d54caa22313e service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:23.552001 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb745d3-e73f-4983-8f5f-eb5877c81eda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46e2703839e498da8f3e2c3fda1d61c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:23.552653 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb745d3-e73f-4983-8f5f-eb5877c81eda service placement] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:23.552927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb745d3-e73f-4983-8f5f-eb5877c81eda service placement] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:23.553198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb745d3-e73f-4983-8f5f-eb5877c81eda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:23.555170 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fcb745d3-e73f-4983-8f5f-eb5877c81eda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:23.567751 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb745d3-e73f-4983-8f5f-eb5877c81eda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:23.569361 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb745d3-e73f-4983-8f5f-eb5877c81eda service placement] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:23.579782 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1260/2545] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:24:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:24:26.237579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7538d-92f2-46d4-9bd1-a310008a7fa7 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:26.246495 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7538d-92f2-46d4-9bd1-a310008a7fa7 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:26.250593 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d484b1-230f-4333-a86f-516bfd993cf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:26.251278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d484b1-230f-4333-a86f-516bfd993cf6 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:26.251557 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d484b1-230f-4333-a86f-516bfd993cf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:26.252010 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d484b1-230f-4333-a86f-516bfd993cf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:26.260955 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d484b1-230f-4333-a86f-516bfd993cf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:26.262542 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d484b1-230f-4333-a86f-516bfd993cf6 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:26.272152 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1286/2546] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:24:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:25:22.216317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb745d3-e73f-4983-8f5f-eb5877c81eda service placement] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:22.217249 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fcb745d3-e73f-4983-8f5f-eb5877c81eda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:22.229251 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb745d3-e73f-4983-8f5f-eb5877c81eda service placement] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:22.233751 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8b199-561b-419d-b34c-a0a6d8619fe0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:22.234395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8b199-561b-419d-b34c-a0a6d8619fe0 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:22.234689 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8b199-561b-419d-b34c-a0a6d8619fe0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:22.234973 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8b199-561b-419d-b34c-a0a6d8619fe0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:22.244014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8b199-561b-419d-b34c-a0a6d8619fe0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:22.245437 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8b199-561b-419d-b34c-a0a6d8619fe0 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:22.255269 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1261/2547] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:25:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:25:26.417345 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d484b1-230f-4333-a86f-516bfd993cf6 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:26.427979 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d484b1-230f-4333-a86f-516bfd993cf6 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:26.432630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea5731-417a-46f1-be4e-e93997d48a1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:26.433278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea5731-417a-46f1-be4e-e93997d48a1d service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:26.433567 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea5731-417a-46f1-be4e-e93997d48a1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:26.433829 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea5731-417a-46f1-be4e-e93997d48a1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:26.445281 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea5731-417a-46f1-be4e-e93997d48a1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:26.446755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea5731-417a-46f1-be4e-e93997d48a1d service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:26.456085 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1287/2548] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:25:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:25:41.334379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8b199-561b-419d-b34c-a0a6d8619fe0 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:41.343720 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8b199-561b-419d-b34c-a0a6d8619fe0 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:41.347556 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefa917-8c7e-40a3-abe6-aba22560067f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:41.348189 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefa917-8c7e-40a3-abe6-aba22560067f service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:41.348470 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefa917-8c7e-40a3-abe6-aba22560067f service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:41.348742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefa917-8c7e-40a3-abe6-aba22560067f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:41.350510 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-caefa917-8c7e-40a3-abe6-aba22560067f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:41.383423 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefa917-8c7e-40a3-abe6-aba22560067f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:41.384843 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefa917-8c7e-40a3-abe6-aba22560067f service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:41.404057 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1262/2549] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:25:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:25:44.419748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea5731-417a-46f1-be4e-e93997d48a1d service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:44.421903 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e7ea5731-417a-46f1-be4e-e93997d48a1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:44.437998 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea5731-417a-46f1-be4e-e93997d48a1d service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:44.443417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d176e13-0a2b-4e36-8348-aa9bc39c8b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:44.444591 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d176e13-0a2b-4e36-8348-aa9bc39c8b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:44.445102 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d176e13-0a2b-4e36-8348-aa9bc39c8b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:44.445425 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d176e13-0a2b-4e36-8348-aa9bc39c8b88 admin admin] PATH_INFO: `/v3/users/cffc26233de74f0ea2c438f588be3ade` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:44.447120 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d176e13-0a2b-4e36-8348-aa9bc39c8b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cffc26233de74f0ea2c438f588be3ade)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:44.449433 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d176e13-0a2b-4e36-8348-aa9bc39c8b88 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:44.498534 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1d176e13-0a2b-4e36-8348-aa9bc39c8b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cffc26233de74f0ea2c438f588be3ade'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:25:44.510068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1d176e13-0a2b-4e36-8348-aa9bc39c8b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cffc26233de74f0ea2c438f588be3ade'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:25:44.510685 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1d176e13-0a2b-4e36-8348-aa9bc39c8b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cffc26233de74f0ea2c438f588be3ade'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:25:44.511319 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1d176e13-0a2b-4e36-8348-aa9bc39c8b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cffc26233de74f0ea2c438f588be3ade'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:25:44.519575 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1d176e13-0a2b-4e36-8348-aa9bc39c8b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cffc26233de74f0ea2c438f588be3ade'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:25:44.534579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1288/2550] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:25:44 2022] DELETE /identity/v3/users/cffc26233de74f0ea2c438f588be3ade => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:25:44.710266 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefa917-8c7e-40a3-abe6-aba22560067f service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:44.720745 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefa917-8c7e-40a3-abe6-aba22560067f service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:44.777941 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63fc41-04c2-442f-9b71-06f90f043e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:44.778801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63fc41-04c2-442f-9b71-06f90f043e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:44.779099 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63fc41-04c2-442f-9b71-06f90f043e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:44.779373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63fc41-04c2-442f-9b71-06f90f043e56 admin admin] PATH_INFO: `/v3/projects/59a2712ed9524f31a5d81224a99d4cf9` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:44.780581 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63fc41-04c2-442f-9b71-06f90f043e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59a2712ed9524f31a5d81224a99d4cf9)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:44.782526 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63fc41-04c2-442f-9b71-06f90f043e56 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:44.826662 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ee63fc41-04c2-442f-9b71-06f90f043e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59a2712ed9524f31a5d81224a99d4cf9', 'request_id': 'req-ee63fc41-04c2-442f-9b71-06f90f043e56'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:25:44.832714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ee63fc41-04c2-442f-9b71-06f90f043e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59a2712ed9524f31a5d81224a99d4cf9', 'request_id': 'req-ee63fc41-04c2-442f-9b71-06f90f043e56'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:25:44.843324 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ee63fc41-04c2-442f-9b71-06f90f043e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59a2712ed9524f31a5d81224a99d4cf9', 'request_id': 'req-ee63fc41-04c2-442f-9b71-06f90f043e56'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:25:44.853651 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ee63fc41-04c2-442f-9b71-06f90f043e56 admin admin] The token cache is being invalidate because project 59a2712ed9524f31a5d81224a99d4cf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:25:44.853938 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ee63fc41-04c2-442f-9b71-06f90f043e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:25:44.854587 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ee63fc41-04c2-442f-9b71-06f90f043e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:25:44.856341 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1263/2551] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:25:44 2022] DELETE /identity/v3/projects/59a2712ed9524f31a5d81224a99d4cf9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:25:44.863805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f17ae3-5e8d-4fa3-a619-79c5692d4d73 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:44.864094 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f17ae3-5e8d-4fa3-a619-79c5692d4d73 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:44.864371 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f17ae3-5e8d-4fa3-a619-79c5692d4d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:44.921390 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-45f17ae3-5e8d-4fa3-a619-79c5692d4d73 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:44.922685 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-45f17ae3-5e8d-4fa3-a619-79c5692d4d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:44.982029 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1289/2552] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:25:44.990112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efced13d-ce19-4622-9062-b6419e078143 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:44.990371 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efced13d-ce19-4622-9062-b6419e078143 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:44.990679 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efced13d-ce19-4622-9062-b6419e078143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:45.009745 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-efced13d-ce19-4622-9062-b6419e078143 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:45.010935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-efced13d-ce19-4622-9062-b6419e078143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:45.019641 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1264/2553] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:25:45.025038 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f17ae3-5e8d-4fa3-a619-79c5692d4d73 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:45.042971 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f17ae3-5e8d-4fa3-a619-79c5692d4d73 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:45.052751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bab1e-7538-49fb-be11-af2dd211de94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:45.053424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bab1e-7538-49fb-be11-af2dd211de94 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:45.053708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bab1e-7538-49fb-be11-af2dd211de94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:45.053983 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bab1e-7538-49fb-be11-af2dd211de94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:45.054727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bab1e-7538-49fb-be11-af2dd211de94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:45.055096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bab1e-7538-49fb-be11-af2dd211de94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:45.056739 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bab1e-7538-49fb-be11-af2dd211de94 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:45.069147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1290/2554] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 07:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:45.073783 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efced13d-ce19-4622-9062-b6419e078143 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:45.083165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efced13d-ce19-4622-9062-b6419e078143 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:45.088245 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c86852-a7e7-4d35-89da-072026b6566e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:45.088894 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c86852-a7e7-4d35-89da-072026b6566e admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:45.089180 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c86852-a7e7-4d35-89da-072026b6566e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:45.089424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c86852-a7e7-4d35-89da-072026b6566e admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:45.090174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c86852-a7e7-4d35-89da-072026b6566e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:45.092115 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c86852-a7e7-4d35-89da-072026b6566e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:45.118829 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1265/2555] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:25:45 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:25:45.123156 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bab1e-7538-49fb-be11-af2dd211de94 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:45.133311 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bab1e-7538-49fb-be11-af2dd211de94 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:45.201279 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d694993-95ef-43d2-88c5-7d0ce8bba152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:45.201951 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d694993-95ef-43d2-88c5-7d0ce8bba152 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:45.202234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d694993-95ef-43d2-88c5-7d0ce8bba152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:45.202511 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d694993-95ef-43d2-88c5-7d0ce8bba152 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:45.203235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d694993-95ef-43d2-88c5-7d0ce8bba152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:45.205151 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d694993-95ef-43d2-88c5-7d0ce8bba152 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:45.226429 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1291/2556] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:25:45 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:25:45.230718 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c86852-a7e7-4d35-89da-072026b6566e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:45.241156 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c86852-a7e7-4d35-89da-072026b6566e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:45.246206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca756e42-98eb-4842-b729-557374c32d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:45.246897 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca756e42-98eb-4842-b729-557374c32d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:45.247181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca756e42-98eb-4842-b729-557374c32d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:45.247467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca756e42-98eb-4842-b729-557374c32d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:45.248194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca756e42-98eb-4842-b729-557374c32d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:45.249784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca756e42-98eb-4842-b729-557374c32d5f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:45.260141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1266/2557] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:25:45.264288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d694993-95ef-43d2-88c5-7d0ce8bba152 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:45.275293 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d694993-95ef-43d2-88c5-7d0ce8bba152 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:45.281139 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b123e-983e-43cb-beda-b6bcb46aca5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:45.281870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b123e-983e-43cb-beda-b6bcb46aca5b admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:45.282133 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b123e-983e-43cb-beda-b6bcb46aca5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:45.282423 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b123e-983e-43cb-beda-b6bcb46aca5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:45.283187 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b123e-983e-43cb-beda-b6bcb46aca5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:45.284793 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b123e-983e-43cb-beda-b6bcb46aca5b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:45.296056 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1292/2558] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:25:45.300482 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca756e42-98eb-4842-b729-557374c32d5f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:45.310594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca756e42-98eb-4842-b729-557374c32d5f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:45.315823 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928f7fd-6177-4209-9df0-b1cb4275a568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:45.316701 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928f7fd-6177-4209-9df0-b1cb4275a568 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:45.317068 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928f7fd-6177-4209-9df0-b1cb4275a568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:45.317354 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928f7fd-6177-4209-9df0-b1cb4275a568 admin admin] PATH_INFO: `/v3/projects/ac4c5fc2283744e88d4e0336e89df445/users/76f92b3e93b54aaea742ffe176c5069e/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:45.331667 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928f7fd-6177-4209-9df0-b1cb4275a568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4c5fc2283744e88d4e0336e89df445, user_id=76f92b3e93b54aaea742ffe176c5069e, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:45.334389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928f7fd-6177-4209-9df0-b1cb4275a568 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:45.348966 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1267/2559] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:25:45 2022] PUT /identity/v3/projects/ac4c5fc2283744e88d4e0336e89df445/users/76f92b3e93b54aaea742ffe176c5069e/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:25:45.360006 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27ccd7-e86c-46b5-adc1-c0b38e2b0ec7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:45.360314 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27ccd7-e86c-46b5-adc1-c0b38e2b0ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:45.360573 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27ccd7-e86c-46b5-adc1-c0b38e2b0ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:45.389498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9a27ccd7-e86c-46b5-adc1-c0b38e2b0ec7 None None] MFA Rules not processed for user `76f92b3e93b54aaea742ffe176c5069e`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:45.390755 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9a27ccd7-e86c-46b5-adc1-c0b38e2b0ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:45.457679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1293/2560] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:25:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:25:45.462080 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928f7fd-6177-4209-9df0-b1cb4275a568 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:45.522452 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928f7fd-6177-4209-9df0-b1cb4275a568 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:45.527411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ce3cb-0337-4faf-83a8-e0fa13a07f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:45.528076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ce3cb-0337-4faf-83a8-e0fa13a07f20 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:45.528356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ce3cb-0337-4faf-83a8-e0fa13a07f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:45.528628 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ce3cb-0337-4faf-83a8-e0fa13a07f20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:45.529318 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ce3cb-0337-4faf-83a8-e0fa13a07f20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:45.531274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ce3cb-0337-4faf-83a8-e0fa13a07f20 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:45.562363 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1268/2561] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:25:45 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:25:45.568702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27ccd7-e86c-46b5-adc1-c0b38e2b0ec7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:45.583359 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27ccd7-e86c-46b5-adc1-c0b38e2b0ec7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:45.641828 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc6218-301c-4bf2-a460-f698bfc55ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:45.642511 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc6218-301c-4bf2-a460-f698bfc55ecd admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:45.642795 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc6218-301c-4bf2-a460-f698bfc55ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:45.643098 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc6218-301c-4bf2-a460-f698bfc55ecd admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:45.643795 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc6218-301c-4bf2-a460-f698bfc55ecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:45.645735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc6218-301c-4bf2-a460-f698bfc55ecd admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:45.673686 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1294/2562] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:25:45 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:25:45.679667 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ce3cb-0337-4faf-83a8-e0fa13a07f20 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:45.690240 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ce3cb-0337-4faf-83a8-e0fa13a07f20 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:45.695459 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef0243-3dd0-433e-b01f-d617e30b2159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:45.696152 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef0243-3dd0-433e-b01f-d617e30b2159 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:45.696436 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef0243-3dd0-433e-b01f-d617e30b2159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:45.696713 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef0243-3dd0-433e-b01f-d617e30b2159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:45.697538 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef0243-3dd0-433e-b01f-d617e30b2159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:45.699183 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef0243-3dd0-433e-b01f-d617e30b2159 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:45.710030 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1269/2563] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:25:45.714209 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc6218-301c-4bf2-a460-f698bfc55ecd admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:45.724114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc6218-301c-4bf2-a460-f698bfc55ecd admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:45.728950 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42307e7-1933-4aa6-be7a-cc431de34080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:45.729834 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42307e7-1933-4aa6-be7a-cc431de34080 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:45.730111 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42307e7-1933-4aa6-be7a-cc431de34080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:45.730384 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42307e7-1933-4aa6-be7a-cc431de34080 admin admin] PATH_INFO: `/v3/projects/e40a796946a54c32b9f3bfd8537c282c/users/00a380bcaebd48af93dfad2d87ba4112/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:45.745096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42307e7-1933-4aa6-be7a-cc431de34080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e40a796946a54c32b9f3bfd8537c282c, user_id=00a380bcaebd48af93dfad2d87ba4112, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:45.747824 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42307e7-1933-4aa6-be7a-cc431de34080 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:45.763790 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1295/2564] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:25:45 2022] PUT /identity/v3/projects/e40a796946a54c32b9f3bfd8537c282c/users/00a380bcaebd48af93dfad2d87ba4112/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:25:45.767894 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef0243-3dd0-433e-b01f-d617e30b2159 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:45.778391 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef0243-3dd0-433e-b01f-d617e30b2159 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:45.834857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656ebe1-7643-4637-b27d-5ef852a65b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:45.835558 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656ebe1-7643-4637-b27d-5ef852a65b46 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:45.835844 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656ebe1-7643-4637-b27d-5ef852a65b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:45.836089 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656ebe1-7643-4637-b27d-5ef852a65b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:45.836817 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656ebe1-7643-4637-b27d-5ef852a65b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:45.838478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656ebe1-7643-4637-b27d-5ef852a65b46 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:45.848320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1270/2565] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:25:45.852925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42307e7-1933-4aa6-be7a-cc431de34080 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:45.863916 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42307e7-1933-4aa6-be7a-cc431de34080 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:45.870180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8bf56-4ec2-4f56-823c-2aaa674891e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:45.871100 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8bf56-4ec2-4f56-823c-2aaa674891e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:45.871383 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8bf56-4ec2-4f56-823c-2aaa674891e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:45.871653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8bf56-4ec2-4f56-823c-2aaa674891e9 admin admin] PATH_INFO: `/v3/projects/e40a796946a54c32b9f3bfd8537c282c/users/00a380bcaebd48af93dfad2d87ba4112/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:45.873924 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8bf56-4ec2-4f56-823c-2aaa674891e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e40a796946a54c32b9f3bfd8537c282c, user_id=00a380bcaebd48af93dfad2d87ba4112, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:45.876664 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8bf56-4ec2-4f56-823c-2aaa674891e9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:45.888249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1296/2566] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:25:45 2022] PUT /identity/v3/projects/e40a796946a54c32b9f3bfd8537c282c/users/00a380bcaebd48af93dfad2d87ba4112/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:25:45.898367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabd8f2-c73b-4f46-892e-bda477c0e5a6 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:45.898590 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabd8f2-c73b-4f46-892e-bda477c0e5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:45.899227 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabd8f2-c73b-4f46-892e-bda477c0e5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:45.926893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2cabd8f2-c73b-4f46-892e-bda477c0e5a6 None None] MFA Rules not processed for user `00a380bcaebd48af93dfad2d87ba4112`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:45.928145 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2cabd8f2-c73b-4f46-892e-bda477c0e5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:46.003391 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1271/2567] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:25:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:25:46.014762 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8bf56-4ec2-4f56-823c-2aaa674891e9 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:46.016624 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c5b8bf56-4ec2-4f56-823c-2aaa674891e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:46.077129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8bf56-4ec2-4f56-823c-2aaa674891e9 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:46.081438 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217fdf8-75c5-4aa8-a0b0-462c50bafeb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:46.082194 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217fdf8-75c5-4aa8-a0b0-462c50bafeb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:46.082481 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217fdf8-75c5-4aa8-a0b0-462c50bafeb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:46.082749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217fdf8-75c5-4aa8-a0b0-462c50bafeb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:46.092036 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217fdf8-75c5-4aa8-a0b0-462c50bafeb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:46.093468 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217fdf8-75c5-4aa8-a0b0-462c50bafeb7 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:46.102980 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1297/2568] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:25:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:25:46.206892 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabd8f2-c73b-4f46-892e-bda477c0e5a6 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:46.217463 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabd8f2-c73b-4f46-892e-bda477c0e5a6 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:46.222610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba94cd9-5ca6-4627-aefa-f44f641407fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:46.223304 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba94cd9-5ca6-4627-aefa-f44f641407fa service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:46.223587 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba94cd9-5ca6-4627-aefa-f44f641407fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:46.223859 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba94cd9-5ca6-4627-aefa-f44f641407fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:46.284969 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba94cd9-5ca6-4627-aefa-f44f641407fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:46.286445 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba94cd9-5ca6-4627-aefa-f44f641407fa service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:46.296317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1272/2569] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:25:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:26:22.260351 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217fdf8-75c5-4aa8-a0b0-462c50bafeb7 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:22.262040 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8217fdf8-75c5-4aa8-a0b0-462c50bafeb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:22.323728 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217fdf8-75c5-4aa8-a0b0-462c50bafeb7 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:22.328389 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e8b4a-3786-4e8a-a00a-9d11ea367d63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:22.329048 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e8b4a-3786-4e8a-a00a-9d11ea367d63 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:22.329327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e8b4a-3786-4e8a-a00a-9d11ea367d63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:22.329596 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e8b4a-3786-4e8a-a00a-9d11ea367d63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:22.331747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7c1e8b4a-3786-4e8a-a00a-9d11ea367d63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:22.342108 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e8b4a-3786-4e8a-a00a-9d11ea367d63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:22.343589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e8b4a-3786-4e8a-a00a-9d11ea367d63 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:22.351861 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1298/2570] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:26:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:26:55.318407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba94cd9-5ca6-4627-aefa-f44f641407fa service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:55.328032 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba94cd9-5ca6-4627-aefa-f44f641407fa service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:55.331973 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695e544-1839-4ce6-8653-762a8c0563dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:55.332661 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695e544-1839-4ce6-8653-762a8c0563dc service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:55.332922 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695e544-1839-4ce6-8653-762a8c0563dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:55.333191 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695e544-1839-4ce6-8653-762a8c0563dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:55.335168 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a695e544-1839-4ce6-8653-762a8c0563dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:55.439225 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695e544-1839-4ce6-8653-762a8c0563dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:55.440679 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695e544-1839-4ce6-8653-762a8c0563dc service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:55.462097 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1273/2571] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:26:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:26:56.688779 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e8b4a-3786-4e8a-a00a-9d11ea367d63 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:56.690328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7c1e8b4a-3786-4e8a-a00a-9d11ea367d63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:56.701613 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e8b4a-3786-4e8a-a00a-9d11ea367d63 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:56.706010 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c6047-1687-4a10-8ca2-68e31e8fae8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:56.706699 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c6047-1687-4a10-8ca2-68e31e8fae8c service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:56.707006 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c6047-1687-4a10-8ca2-68e31e8fae8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:56.707444 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c6047-1687-4a10-8ca2-68e31e8fae8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:56.711741 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-986c6047-1687-4a10-8ca2-68e31e8fae8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:56.725971 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c6047-1687-4a10-8ca2-68e31e8fae8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:56.727540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c6047-1687-4a10-8ca2-68e31e8fae8c service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:56.739112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1299/2572] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:26:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:26:57.376124 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695e544-1839-4ce6-8653-762a8c0563dc service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:57.377061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a695e544-1839-4ce6-8653-762a8c0563dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:57.391170 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695e544-1839-4ce6-8653-762a8c0563dc service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:57.396947 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a92ac-5899-4ccf-96a9-3922e15d0597 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:57.397971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a92ac-5899-4ccf-96a9-3922e15d0597 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:57.398250 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a92ac-5899-4ccf-96a9-3922e15d0597 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:57.398513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a92ac-5899-4ccf-96a9-3922e15d0597 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:57.400548 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d14a92ac-5899-4ccf-96a9-3922e15d0597 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:57.413584 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a92ac-5899-4ccf-96a9-3922e15d0597 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:57.415249 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a92ac-5899-4ccf-96a9-3922e15d0597 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:57.427042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1274/2573] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:26:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:27:01.963144 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724599d-613d-4359-b9c9-2f8f39b2e287 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:01.963669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724599d-613d-4359-b9c9-2f8f39b2e287 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:01.963669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724599d-613d-4359-b9c9-2f8f39b2e287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:01.981408 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9724599d-613d-4359-b9c9-2f8f39b2e287 None None] MFA Rules not processed for user `17f57a9a926b4954acb4c002367474ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:27:01.982612 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9724599d-613d-4359-b9c9-2f8f39b2e287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:27:02.036019 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1300/2574] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:27:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:27:02.349750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a92ac-5899-4ccf-96a9-3922e15d0597 service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:02.359634 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a92ac-5899-4ccf-96a9-3922e15d0597 service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:02.363893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f98e3b-a0d0-426f-8f3e-691f6947c789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:02.364540 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f98e3b-a0d0-426f-8f3e-691f6947c789 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:02.364820 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f98e3b-a0d0-426f-8f3e-691f6947c789 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:02.365092 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f98e3b-a0d0-426f-8f3e-691f6947c789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:02.367171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-29f98e3b-a0d0-426f-8f3e-691f6947c789 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:27:02.376802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f98e3b-a0d0-426f-8f3e-691f6947c789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:02.378220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f98e3b-a0d0-426f-8f3e-691f6947c789 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:02.385974 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1275/2575] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:27:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:27:02.961451 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724599d-613d-4359-b9c9-2f8f39b2e287 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:02.963041 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9724599d-613d-4359-b9c9-2f8f39b2e287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:27:03.036834 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724599d-613d-4359-b9c9-2f8f39b2e287 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:03.042128 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da75dd3-012a-4a9a-98f7-16b851aef886 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46e2703839e498da8f3e2c3fda1d61c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:03.042788 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da75dd3-012a-4a9a-98f7-16b851aef886 service placement] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:03.043098 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da75dd3-012a-4a9a-98f7-16b851aef886 service placement] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:03.043396 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da75dd3-012a-4a9a-98f7-16b851aef886 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:03.045136 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6da75dd3-012a-4a9a-98f7-16b851aef886 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:27:03.056421 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da75dd3-012a-4a9a-98f7-16b851aef886 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:03.058008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da75dd3-012a-4a9a-98f7-16b851aef886 service placement] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:03.067807 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1301/2576] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:27:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:27:10.838995 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f98e3b-a0d0-426f-8f3e-691f6947c789 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:10.854028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f98e3b-a0d0-426f-8f3e-691f6947c789 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:10.859692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5771ff-ffea-4646-8e4f-395d7d53d15b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:10.860338 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5771ff-ffea-4646-8e4f-395d7d53d15b service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:10.860615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5771ff-ffea-4646-8e4f-395d7d53d15b service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:10.860883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5771ff-ffea-4646-8e4f-395d7d53d15b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:10.862639 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4f5771ff-ffea-4646-8e4f-395d7d53d15b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:27:10.874861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5771ff-ffea-4646-8e4f-395d7d53d15b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:10.876459 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5771ff-ffea-4646-8e4f-395d7d53d15b service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:10.886635 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1276/2577] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:27:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:27:36.766409 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da75dd3-012a-4a9a-98f7-16b851aef886 service placement] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:36.768433 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6da75dd3-012a-4a9a-98f7-16b851aef886 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:27:36.781231 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da75dd3-012a-4a9a-98f7-16b851aef886 service placement] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:36.785725 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1835eeb-810c-46e7-9cd6-141790ed8e33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:36.786372 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1835eeb-810c-46e7-9cd6-141790ed8e33 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:36.786652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1835eeb-810c-46e7-9cd6-141790ed8e33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:36.786921 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1835eeb-810c-46e7-9cd6-141790ed8e33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:36.788973 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e1835eeb-810c-46e7-9cd6-141790ed8e33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:27:36.850466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1835eeb-810c-46e7-9cd6-141790ed8e33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:36.851956 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1835eeb-810c-46e7-9cd6-141790ed8e33 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:36.871433 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1302/2578] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:27:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:28:26.896802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5771ff-ffea-4646-8e4f-395d7d53d15b service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:26.908353 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5771ff-ffea-4646-8e4f-395d7d53d15b service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:26.912952 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdea62-ff88-47a9-a6ff-7f358fbd565d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:26.913596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdea62-ff88-47a9-a6ff-7f358fbd565d service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:26.913879 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdea62-ff88-47a9-a6ff-7f358fbd565d service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:26.914144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdea62-ff88-47a9-a6ff-7f358fbd565d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:26.916333 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f3fdea62-ff88-47a9-a6ff-7f358fbd565d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:28:27.002660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdea62-ff88-47a9-a6ff-7f358fbd565d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:27.004147 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdea62-ff88-47a9-a6ff-7f358fbd565d service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:27.013878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1277/2579] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:28:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:28:27.535695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1835eeb-810c-46e7-9cd6-141790ed8e33 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:27.537352 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e1835eeb-810c-46e7-9cd6-141790ed8e33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:28:27.575385 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1835eeb-810c-46e7-9cd6-141790ed8e33 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:27.580269 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fee63f-4305-4a8d-a9dc-f606b2955d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:27.581147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fee63f-4305-4a8d-a9dc-f606b2955d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:27.581426 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fee63f-4305-4a8d-a9dc-f606b2955d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:27.581699 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fee63f-4305-4a8d-a9dc-f606b2955d45 admin admin] PATH_INFO: `/v3/users/e50be91ec9bf4ad8ad6f876e2caec585` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:27.594258 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fee63f-4305-4a8d-a9dc-f606b2955d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e50be91ec9bf4ad8ad6f876e2caec585)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:27.596231 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fee63f-4305-4a8d-a9dc-f606b2955d45 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:27.664694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-45fee63f-4305-4a8d-a9dc-f606b2955d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e50be91ec9bf4ad8ad6f876e2caec585'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:28:27.682760 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-45fee63f-4305-4a8d-a9dc-f606b2955d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e50be91ec9bf4ad8ad6f876e2caec585'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:28:27.683580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-45fee63f-4305-4a8d-a9dc-f606b2955d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e50be91ec9bf4ad8ad6f876e2caec585'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:28:27.684298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-45fee63f-4305-4a8d-a9dc-f606b2955d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e50be91ec9bf4ad8ad6f876e2caec585'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:28:27.694824 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-45fee63f-4305-4a8d-a9dc-f606b2955d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e50be91ec9bf4ad8ad6f876e2caec585'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:28:27.707165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1303/2580] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:28:27 2022] DELETE /identity/v3/users/e50be91ec9bf4ad8ad6f876e2caec585 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:28:27.892884 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdea62-ff88-47a9-a6ff-7f358fbd565d service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:27.903108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdea62-ff88-47a9-a6ff-7f358fbd565d service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:27.958951 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c51e4-e143-4055-a26a-f14bb3045a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:27.959851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c51e4-e143-4055-a26a-f14bb3045a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:27.960128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c51e4-e143-4055-a26a-f14bb3045a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:27.960406 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c51e4-e143-4055-a26a-f14bb3045a6a admin admin] PATH_INFO: `/v3/projects/76515aac5bf247ef8eef3986cc3ce75d` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:27.971503 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c51e4-e143-4055-a26a-f14bb3045a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=76515aac5bf247ef8eef3986cc3ce75d)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:27.973463 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c51e4-e143-4055-a26a-f14bb3045a6a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:28.021975 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-935c51e4-e143-4055-a26a-f14bb3045a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76515aac5bf247ef8eef3986cc3ce75d', 'request_id': 'req-935c51e4-e143-4055-a26a-f14bb3045a6a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:28:28.028550 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-935c51e4-e143-4055-a26a-f14bb3045a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76515aac5bf247ef8eef3986cc3ce75d', 'request_id': 'req-935c51e4-e143-4055-a26a-f14bb3045a6a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:28:28.037220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-935c51e4-e143-4055-a26a-f14bb3045a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76515aac5bf247ef8eef3986cc3ce75d', 'request_id': 'req-935c51e4-e143-4055-a26a-f14bb3045a6a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:28:28.047144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-935c51e4-e143-4055-a26a-f14bb3045a6a admin admin] The token cache is being invalidate because project 76515aac5bf247ef8eef3986cc3ce75d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:28:28.047424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-935c51e4-e143-4055-a26a-f14bb3045a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:28:28.048108 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-935c51e4-e143-4055-a26a-f14bb3045a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:28:28.051844 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1278/2581] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:28:27 2022] DELETE /identity/v3/projects/76515aac5bf247ef8eef3986cc3ce75d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:29:26.136004 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fee63f-4305-4a8d-a9dc-f606b2955d45 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:26.137674 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-45fee63f-4305-4a8d-a9dc-f606b2955d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:26.239894 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fee63f-4305-4a8d-a9dc-f606b2955d45 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:26.290867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fb9e5-94b9-4a41-9d8d-e64be3fdbaae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:26.291709 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fb9e5-94b9-4a41-9d8d-e64be3fdbaae service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:26.291962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fb9e5-94b9-4a41-9d8d-e64be3fdbaae service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:26.292415 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fb9e5-94b9-4a41-9d8d-e64be3fdbaae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:26.294644 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-179fb9e5-94b9-4a41-9d8d-e64be3fdbaae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:26.372851 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179fb9e5-94b9-4a41-9d8d-e64be3fdbaae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:26.374362 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179fb9e5-94b9-4a41-9d8d-e64be3fdbaae service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:26.392358 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1304/2582] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:29:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:29:30.519776 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c51e4-e143-4055-a26a-f14bb3045a6a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:30.521516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-935c51e4-e143-4055-a26a-f14bb3045a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:30.639507 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c51e4-e143-4055-a26a-f14bb3045a6a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:30.645888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bd6d5-9ecb-4f14-92c4-b1b7e3f67f5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46e2703839e498da8f3e2c3fda1d61c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:30.646551 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bd6d5-9ecb-4f14-92c4-b1b7e3f67f5c service placement] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:30.646828 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bd6d5-9ecb-4f14-92c4-b1b7e3f67f5c service placement] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:30.647138 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bd6d5-9ecb-4f14-92c4-b1b7e3f67f5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:30.649175 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-979bd6d5-9ecb-4f14-92c4-b1b7e3f67f5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:30.661064 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bd6d5-9ecb-4f14-92c4-b1b7e3f67f5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:30.662660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bd6d5-9ecb-4f14-92c4-b1b7e3f67f5c service placement] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:30.672680 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1279/2583] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:29:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:29:51.183524 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fb9e5-94b9-4a41-9d8d-e64be3fdbaae service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:51.186322 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-179fb9e5-94b9-4a41-9d8d-e64be3fdbaae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:51.277757 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fb9e5-94b9-4a41-9d8d-e64be3fdbaae service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:51.282421 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda3c68-7948-4672-a371-e20a457bf196 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '281c923b01a143dbb79d8c0ea04f55b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:51.283123 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda3c68-7948-4672-a371-e20a457bf196 service glance] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:51.283402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda3c68-7948-4672-a371-e20a457bf196 service glance] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:51.283700 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda3c68-7948-4672-a371-e20a457bf196 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:51.285874 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4dda3c68-7948-4672-a371-e20a457bf196 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:51.322096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-4dda3c68-7948-4672-a371-e20a457bf196 service glance] Could not find project: d6f5e54830ef491aaf74e752ff1ab77e.: keystone.exception.ProjectNotFound: Could not find project: d6f5e54830ef491aaf74e752ff1ab77e. May 11 07:29:51.322096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:29:51.322096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:29:51.322096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:29:51.322096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:29:51.322096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:29:51.322096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:29:51.322096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:29:51.322096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:29:51.322096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:29:51.322096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:29:51.322096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:29:51.322096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get May 11 07:29:51.322096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') May 11 07:29:51.322096 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call May 11 07:29:51.323968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() May 11 07:29:51.323968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data May 11 07:29:51.323968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( May 11 07:29:51.323968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:29:51.323968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:29:51.323968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token May 11 07:29:51.323968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application token = self._validate_token(token_id) May 11 07:29:51.323968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:29:51.323968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:29:51.323968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:29:51.323968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:29:51.323968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:29:51.323968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 07:29:51.323968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:29:51.323968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 07:29:51.323968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:29:51.323968 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:29:51.325914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:29:51.325914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 07:29:51.325914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:29:51.325914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 07:29:51.325914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token May 11 07:29:51.325914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) May 11 07:29:51.325914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint May 11 07:29:51.325914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._validate_token_resources() May 11 07:29:51.325914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources May 11 07:29:51.325914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): May 11 07:29:51.325914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project May 11 07:29:51.325914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( May 11 07:29:51.325914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:29:51.325914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:29:51.325914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:29:51.325914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:29:51.325914 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:29:51.328168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:29:51.328168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:29:51.328168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 11 07:29:51.328168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:29:51.328168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 11 07:29:51.328168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:29:51.328168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:29:51.328168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:29:51.328168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 11 07:29:51.328168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:29:51.328168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 11 07:29:51.328168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:29:51.328168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:29:51.328168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:29:51.328168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:29:51.328168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:29:51.328168 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:29:51.330339 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d6f5e54830ef491aaf74e752ff1ab77e. May 11 07:29:51.330339 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 11 07:29:51.330339 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1305/2584] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:29:51 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 11 07:29:51.916616 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bd6d5-9ecb-4f14-92c4-b1b7e3f67f5c service placement] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:51.918342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-979bd6d5-9ecb-4f14-92c4-b1b7e3f67f5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:51.930008 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bd6d5-9ecb-4f14-92c4-b1b7e3f67f5c service placement] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:51.934009 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09b975-95da-488f-a7dc-9534467f2800 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '281c923b01a143dbb79d8c0ea04f55b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:51.934708 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09b975-95da-488f-a7dc-9534467f2800 service glance] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:51.934920 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09b975-95da-488f-a7dc-9534467f2800 service glance] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:51.935222 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09b975-95da-488f-a7dc-9534467f2800 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:51.937555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ff09b975-95da-488f-a7dc-9534467f2800 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:51.951241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-ff09b975-95da-488f-a7dc-9534467f2800 service glance] Could not find project: 57566b6ed2b94469a58ea60c27a1e2b3.: keystone.exception.ProjectNotFound: Could not find project: 57566b6ed2b94469a58ea60c27a1e2b3. May 11 07:29:51.951241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:29:51.951241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:29:51.951241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:29:51.951241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:29:51.951241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:29:51.951241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:29:51.951241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:29:51.951241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:29:51.951241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:29:51.951241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:29:51.951241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:29:51.951241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get May 11 07:29:51.951241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') May 11 07:29:51.951241 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call May 11 07:29:51.952305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() May 11 07:29:51.952305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data May 11 07:29:51.952305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( May 11 07:29:51.952305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:29:51.952305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:29:51.952305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token May 11 07:29:51.952305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application token = self._validate_token(token_id) May 11 07:29:51.952305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:29:51.952305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:29:51.952305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:29:51.952305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:29:51.952305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:29:51.952305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 07:29:51.952305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:29:51.952305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 07:29:51.952305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:29:51.952305 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:29:51.953595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:29:51.953595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 07:29:51.953595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:29:51.953595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 07:29:51.953595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token May 11 07:29:51.953595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) May 11 07:29:51.953595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint May 11 07:29:51.953595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._validate_token_resources() May 11 07:29:51.953595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources May 11 07:29:51.953595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): May 11 07:29:51.953595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project May 11 07:29:51.953595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( May 11 07:29:51.953595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:29:51.953595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:29:51.953595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:29:51.953595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:29:51.953595 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:29:51.954683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:29:51.954683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:29:51.954683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 11 07:29:51.954683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:29:51.954683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 11 07:29:51.954683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:29:51.954683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:29:51.954683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:29:51.954683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 11 07:29:51.954683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:29:51.954683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 11 07:29:51.954683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:29:51.954683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:29:51.954683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:29:51.954683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:29:51.954683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:29:51.954683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:29:51.955792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 57566b6ed2b94469a58ea60c27a1e2b3. May 11 07:29:51.955792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 11 07:29:51.955792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1280/2585] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:29:51 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 11 07:29:53.814705 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda3c68-7948-4672-a371-e20a457bf196 service glance] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:53.816433 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4dda3c68-7948-4672-a371-e20a457bf196 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:53.887155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda3c68-7948-4672-a371-e20a457bf196 service glance] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:53.892390 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa00987-9536-4ac5-ad2d-a25d4e5898b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:53.893310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa00987-9536-4ac5-ad2d-a25d4e5898b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:53.893594 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa00987-9536-4ac5-ad2d-a25d4e5898b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:53.893868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa00987-9536-4ac5-ad2d-a25d4e5898b8 admin admin] PATH_INFO: `/v3/users/76f92b3e93b54aaea742ffe176c5069e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:53.895568 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa00987-9536-4ac5-ad2d-a25d4e5898b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76f92b3e93b54aaea742ffe176c5069e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:53.897520 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa00987-9536-4ac5-ad2d-a25d4e5898b8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:53.950702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-baa00987-9536-4ac5-ad2d-a25d4e5898b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76f92b3e93b54aaea742ffe176c5069e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:53.962899 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-baa00987-9536-4ac5-ad2d-a25d4e5898b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76f92b3e93b54aaea742ffe176c5069e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:53.963586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-baa00987-9536-4ac5-ad2d-a25d4e5898b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76f92b3e93b54aaea742ffe176c5069e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:53.964202 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-baa00987-9536-4ac5-ad2d-a25d4e5898b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76f92b3e93b54aaea742ffe176c5069e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:53.973086 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-baa00987-9536-4ac5-ad2d-a25d4e5898b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76f92b3e93b54aaea742ffe176c5069e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:53.986201 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1306/2586] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:29:53 2022] DELETE /identity/v3/users/76f92b3e93b54aaea742ffe176c5069e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:29:53.990223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da201115-407f-445d-96b4-437227017512 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:53.990658 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da201115-407f-445d-96b4-437227017512 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:53.991034 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da201115-407f-445d-96b4-437227017512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:54.009670 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-da201115-407f-445d-96b4-437227017512 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:29:54.011056 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-da201115-407f-445d-96b4-437227017512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:54.073588 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1281/2587] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:29:54.083626 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa00987-9536-4ac5-ad2d-a25d4e5898b8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:54.085260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-baa00987-9536-4ac5-ad2d-a25d4e5898b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:54.146567 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa00987-9536-4ac5-ad2d-a25d4e5898b8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:54.150328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68fe52-9b75-4d15-8630-986f61e29c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:54.151002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68fe52-9b75-4d15-8630-986f61e29c7d service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:54.151284 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68fe52-9b75-4d15-8630-986f61e29c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:54.151552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68fe52-9b75-4d15-8630-986f61e29c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:54.160620 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68fe52-9b75-4d15-8630-986f61e29c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:54.162052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68fe52-9b75-4d15-8630-986f61e29c7d service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:54.171307 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1307/2588] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:29:54.439112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da201115-407f-445d-96b4-437227017512 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:54.440761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-da201115-407f-445d-96b4-437227017512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:54.455498 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da201115-407f-445d-96b4-437227017512 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:54.462778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215db41-7a2a-4f0a-a502-9234c1f71ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:54.464859 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215db41-7a2a-4f0a-a502-9234c1f71ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:54.465146 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215db41-7a2a-4f0a-a502-9234c1f71ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:54.465418 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215db41-7a2a-4f0a-a502-9234c1f71ccd admin admin] PATH_INFO: `/v3/projects/ac4c5fc2283744e88d4e0336e89df445` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:54.466775 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215db41-7a2a-4f0a-a502-9234c1f71ccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac4c5fc2283744e88d4e0336e89df445)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:54.468766 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215db41-7a2a-4f0a-a502-9234c1f71ccd admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:54.521146 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6215db41-7a2a-4f0a-a502-9234c1f71ccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac4c5fc2283744e88d4e0336e89df445', 'request_id': 'req-6215db41-7a2a-4f0a-a502-9234c1f71ccd'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:54.527115 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6215db41-7a2a-4f0a-a502-9234c1f71ccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac4c5fc2283744e88d4e0336e89df445', 'request_id': 'req-6215db41-7a2a-4f0a-a502-9234c1f71ccd'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:54.536063 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6215db41-7a2a-4f0a-a502-9234c1f71ccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac4c5fc2283744e88d4e0336e89df445', 'request_id': 'req-6215db41-7a2a-4f0a-a502-9234c1f71ccd'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:54.547120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6215db41-7a2a-4f0a-a502-9234c1f71ccd admin admin] The token cache is being invalidate because project ac4c5fc2283744e88d4e0336e89df445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:29:54.547499 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6215db41-7a2a-4f0a-a502-9234c1f71ccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:54.548141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6215db41-7a2a-4f0a-a502-9234c1f71ccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:54.549869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1282/2589] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:29:54 2022] DELETE /identity/v3/projects/ac4c5fc2283744e88d4e0336e89df445 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:29:54.553935 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68fe52-9b75-4d15-8630-986f61e29c7d service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:54.563540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68fe52-9b75-4d15-8630-986f61e29c7d service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:54.632029 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0b2c0-1061-41b8-ae7c-14a4f4a987d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:54.632911 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0b2c0-1061-41b8-ae7c-14a4f4a987d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:54.633190 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0b2c0-1061-41b8-ae7c-14a4f4a987d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:54.633462 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0b2c0-1061-41b8-ae7c-14a4f4a987d3 admin admin] PATH_INFO: `/v3/users/00a380bcaebd48af93dfad2d87ba4112` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:54.634880 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0b2c0-1061-41b8-ae7c-14a4f4a987d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a380bcaebd48af93dfad2d87ba4112)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:54.636596 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0b2c0-1061-41b8-ae7c-14a4f4a987d3 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:54.687267 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1ef0b2c0-1061-41b8-ae7c-14a4f4a987d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a380bcaebd48af93dfad2d87ba4112'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:54.698546 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1ef0b2c0-1061-41b8-ae7c-14a4f4a987d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a380bcaebd48af93dfad2d87ba4112'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:54.699264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1ef0b2c0-1061-41b8-ae7c-14a4f4a987d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a380bcaebd48af93dfad2d87ba4112'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:54.699877 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1ef0b2c0-1061-41b8-ae7c-14a4f4a987d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a380bcaebd48af93dfad2d87ba4112'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:54.709301 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1ef0b2c0-1061-41b8-ae7c-14a4f4a987d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a380bcaebd48af93dfad2d87ba4112'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:54.721226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1308/2590] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:29:54 2022] DELETE /identity/v3/users/00a380bcaebd48af93dfad2d87ba4112 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:29:55.004338 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215db41-7a2a-4f0a-a502-9234c1f71ccd admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:55.005983 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6215db41-7a2a-4f0a-a502-9234c1f71ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:55.020037 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215db41-7a2a-4f0a-a502-9234c1f71ccd admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:55.078308 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0816b86-22e6-459d-8ec0-10685a7ba2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:55.079217 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0816b86-22e6-459d-8ec0-10685a7ba2a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:55.079491 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0816b86-22e6-459d-8ec0-10685a7ba2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:55.079766 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0816b86-22e6-459d-8ec0-10685a7ba2a0 admin admin] PATH_INFO: `/v3/projects/e40a796946a54c32b9f3bfd8537c282c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:55.081028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0816b86-22e6-459d-8ec0-10685a7ba2a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e40a796946a54c32b9f3bfd8537c282c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:55.083166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0816b86-22e6-459d-8ec0-10685a7ba2a0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:55.137652 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f0816b86-22e6-459d-8ec0-10685a7ba2a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e40a796946a54c32b9f3bfd8537c282c', 'request_id': 'req-f0816b86-22e6-459d-8ec0-10685a7ba2a0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:55.145503 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f0816b86-22e6-459d-8ec0-10685a7ba2a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e40a796946a54c32b9f3bfd8537c282c', 'request_id': 'req-f0816b86-22e6-459d-8ec0-10685a7ba2a0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:55.157398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f0816b86-22e6-459d-8ec0-10685a7ba2a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e40a796946a54c32b9f3bfd8537c282c', 'request_id': 'req-f0816b86-22e6-459d-8ec0-10685a7ba2a0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:55.172516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f0816b86-22e6-459d-8ec0-10685a7ba2a0 admin admin] The token cache is being invalidate because project e40a796946a54c32b9f3bfd8537c282c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:29:55.172953 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f0816b86-22e6-459d-8ec0-10685a7ba2a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:55.173872 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f0816b86-22e6-459d-8ec0-10685a7ba2a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:55.176523 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1283/2591] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:29:55 2022] DELETE /identity/v3/projects/e40a796946a54c32b9f3bfd8537c282c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:29:55.181497 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37220609-3ccb-4b2b-87b7-20ea63b3af19 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:55.181962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37220609-3ccb-4b2b-87b7-20ea63b3af19 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:55.182051 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37220609-3ccb-4b2b-87b7-20ea63b3af19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:55.201657 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-37220609-3ccb-4b2b-87b7-20ea63b3af19 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:29:55.202843 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-37220609-3ccb-4b2b-87b7-20ea63b3af19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:55.276247 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1309/2592] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:29:55.284196 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fafc6-d9d9-45ac-b95f-f3075b887235 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:55.284577 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fafc6-d9d9-45ac-b95f-f3075b887235 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:55.287477 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fafc6-d9d9-45ac-b95f-f3075b887235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:55.309769 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fb7fafc6-d9d9-45ac-b95f-f3075b887235 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:29:55.311012 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fb7fafc6-d9d9-45ac-b95f-f3075b887235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:55.319701 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1284/2593] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:29:55.323892 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37220609-3ccb-4b2b-87b7-20ea63b3af19 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:55.333612 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37220609-3ccb-4b2b-87b7-20ea63b3af19 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:55.338435 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb0d34-2104-483d-96a1-88a15f1e3c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:55.339129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb0d34-2104-483d-96a1-88a15f1e3c31 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:55.339407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb0d34-2104-483d-96a1-88a15f1e3c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:55.339679 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb0d34-2104-483d-96a1-88a15f1e3c31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:55.340409 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb0d34-2104-483d-96a1-88a15f1e3c31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:29:55.340711 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb0d34-2104-483d-96a1-88a15f1e3c31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:55.342343 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb0d34-2104-483d-96a1-88a15f1e3c31 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:55.353521 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1310/2594] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 07:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:29:55.357936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fafc6-d9d9-45ac-b95f-f3075b887235 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:55.367480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fafc6-d9d9-45ac-b95f-f3075b887235 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:55.372503 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6a54a-930d-43ee-91f7-6fa66bc85cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:55.373172 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6a54a-930d-43ee-91f7-6fa66bc85cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:55.373450 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6a54a-930d-43ee-91f7-6fa66bc85cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:55.373722 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6a54a-930d-43ee-91f7-6fa66bc85cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:55.374415 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6a54a-930d-43ee-91f7-6fa66bc85cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:55.376346 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6a54a-930d-43ee-91f7-6fa66bc85cd6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:55.415727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1285/2595] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:29:55 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:29:55.420034 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb0d34-2104-483d-96a1-88a15f1e3c31 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:55.430349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb0d34-2104-483d-96a1-88a15f1e3c31 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:55.492448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530d2ee-88fb-41da-a22e-692a1662ff09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:55.493163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530d2ee-88fb-41da-a22e-692a1662ff09 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:55.493467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530d2ee-88fb-41da-a22e-692a1662ff09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:55.493818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530d2ee-88fb-41da-a22e-692a1662ff09 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:55.494867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530d2ee-88fb-41da-a22e-692a1662ff09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:55.497827 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530d2ee-88fb-41da-a22e-692a1662ff09 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:55.522342 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1311/2596] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:29:55 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:29:55.526662 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6a54a-930d-43ee-91f7-6fa66bc85cd6 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:55.537229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6a54a-930d-43ee-91f7-6fa66bc85cd6 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:55.542683 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7e168-2108-474f-901e-b5948f852864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:55.543385 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7e168-2108-474f-901e-b5948f852864 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:55.543664 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7e168-2108-474f-901e-b5948f852864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:55.543956 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7e168-2108-474f-901e-b5948f852864 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:55.544688 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7e168-2108-474f-901e-b5948f852864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:55.546286 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7e168-2108-474f-901e-b5948f852864 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:55.556803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1286/2597] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:29:55.561044 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530d2ee-88fb-41da-a22e-692a1662ff09 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:55.571757 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530d2ee-88fb-41da-a22e-692a1662ff09 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:55.577492 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a8aec-2df4-43af-8445-b60765364210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:55.578159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a8aec-2df4-43af-8445-b60765364210 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:55.578450 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a8aec-2df4-43af-8445-b60765364210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:55.578733 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a8aec-2df4-43af-8445-b60765364210 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:55.579508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a8aec-2df4-43af-8445-b60765364210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:55.581132 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a8aec-2df4-43af-8445-b60765364210 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:55.591140 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1312/2598] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:29:55.595171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7e168-2108-474f-901e-b5948f852864 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:55.606162 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7e168-2108-474f-901e-b5948f852864 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:55.612177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5626301-7ff6-425d-981f-13c544134ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:55.613055 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5626301-7ff6-425d-981f-13c544134ca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:55.613337 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5626301-7ff6-425d-981f-13c544134ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:55.613606 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5626301-7ff6-425d-981f-13c544134ca2 admin admin] PATH_INFO: `/v3/projects/f9c3202f0f1645d297754759fc3df471/users/4c4f0d22cacd493fab9dd0b67bb25a1f/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:55.630091 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5626301-7ff6-425d-981f-13c544134ca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c3202f0f1645d297754759fc3df471, user_id=4c4f0d22cacd493fab9dd0b67bb25a1f, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:55.632803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5626301-7ff6-425d-981f-13c544134ca2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:55.648964 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1287/2599] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:29:55 2022] PUT /identity/v3/projects/f9c3202f0f1645d297754759fc3df471/users/4c4f0d22cacd493fab9dd0b67bb25a1f/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:29:55.659777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ce400-5067-40a1-b583-4a5af29fa98f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:55.660232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ce400-5067-40a1-b583-4a5af29fa98f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:55.660592 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ce400-5067-40a1-b583-4a5af29fa98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:55.687788 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-502ce400-5067-40a1-b583-4a5af29fa98f None None] MFA Rules not processed for user `4c4f0d22cacd493fab9dd0b67bb25a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:29:55.689053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-502ce400-5067-40a1-b583-4a5af29fa98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:55.750619 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1313/2600] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:29:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:29:55.755795 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5626301-7ff6-425d-981f-13c544134ca2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:55.822692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5626301-7ff6-425d-981f-13c544134ca2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:55.827875 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b607ed-e2d5-4f1a-b080-0530d9cee9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:55.828553 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b607ed-e2d5-4f1a-b080-0530d9cee9ae admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:55.828810 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b607ed-e2d5-4f1a-b080-0530d9cee9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:55.829083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b607ed-e2d5-4f1a-b080-0530d9cee9ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:55.829770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b607ed-e2d5-4f1a-b080-0530d9cee9ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:55.831800 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b607ed-e2d5-4f1a-b080-0530d9cee9ae admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:55.864429 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1288/2601] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:29:55 2022] POST /identity/v3/projects => generated 389 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:29:55.868685 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ce400-5067-40a1-b583-4a5af29fa98f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:55.879929 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ce400-5067-40a1-b583-4a5af29fa98f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:55.938232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1095469-1405-41dd-8fff-76e2028aeb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:55.938828 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1095469-1405-41dd-8fff-76e2028aeb89 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:55.939137 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1095469-1405-41dd-8fff-76e2028aeb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:55.939412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1095469-1405-41dd-8fff-76e2028aeb89 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:55.940100 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1095469-1405-41dd-8fff-76e2028aeb89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:55.942086 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1095469-1405-41dd-8fff-76e2028aeb89 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:55.963799 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1314/2602] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:29:55 2022] POST /identity/v3/users => generated 301 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:29:55.967904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b607ed-e2d5-4f1a-b080-0530d9cee9ae admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:55.978747 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b607ed-e2d5-4f1a-b080-0530d9cee9ae admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:55.984092 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fa4a7-0d8f-4aae-9191-9d59e68ebcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:55.984753 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fa4a7-0d8f-4aae-9191-9d59e68ebcd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:55.985059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fa4a7-0d8f-4aae-9191-9d59e68ebcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:55.985329 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fa4a7-0d8f-4aae-9191-9d59e68ebcd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:55.986055 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fa4a7-0d8f-4aae-9191-9d59e68ebcd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:55.987746 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fa4a7-0d8f-4aae-9191-9d59e68ebcd6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:55.998811 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1289/2603] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:29:56.002872 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1095469-1405-41dd-8fff-76e2028aeb89 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:56.013341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1095469-1405-41dd-8fff-76e2028aeb89 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:56.019259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec04a6-c4a0-45dd-981f-a7f52768627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:56.020255 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec04a6-c4a0-45dd-981f-a7f52768627f admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:56.020537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec04a6-c4a0-45dd-981f-a7f52768627f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:56.020811 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec04a6-c4a0-45dd-981f-a7f52768627f admin admin] PATH_INFO: `/v3/projects/da073518359842f3adc6bd7ef87a7bf6/users/f639af7854bb4bc7a58e49fa61bb76ee/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:56.036749 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec04a6-c4a0-45dd-981f-a7f52768627f admin admin] RBAC: Authorizing `identity:create_grant(project_id=da073518359842f3adc6bd7ef87a7bf6, user_id=f639af7854bb4bc7a58e49fa61bb76ee, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:56.039442 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec04a6-c4a0-45dd-981f-a7f52768627f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:56.056024 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1315/2604] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:29:56 2022] PUT /identity/v3/projects/da073518359842f3adc6bd7ef87a7bf6/users/f639af7854bb4bc7a58e49fa61bb76ee/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:29:56.060096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fa4a7-0d8f-4aae-9191-9d59e68ebcd6 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:56.070157 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fa4a7-0d8f-4aae-9191-9d59e68ebcd6 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:56.129507 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc1b7b-0885-4af7-a820-e89144641457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:56.130170 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc1b7b-0885-4af7-a820-e89144641457 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:56.130446 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc1b7b-0885-4af7-a820-e89144641457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:56.130711 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc1b7b-0885-4af7-a820-e89144641457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:56.131472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc1b7b-0885-4af7-a820-e89144641457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:56.133085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc1b7b-0885-4af7-a820-e89144641457 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:56.143198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1290/2605] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:29:56.147925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec04a6-c4a0-45dd-981f-a7f52768627f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:56.158981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec04a6-c4a0-45dd-981f-a7f52768627f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:56.165049 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296746e0-be0f-44b1-b387-e331ecb43fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:56.165951 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296746e0-be0f-44b1-b387-e331ecb43fe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:56.166266 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296746e0-be0f-44b1-b387-e331ecb43fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:56.166541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296746e0-be0f-44b1-b387-e331ecb43fe0 admin admin] PATH_INFO: `/v3/projects/da073518359842f3adc6bd7ef87a7bf6/users/f639af7854bb4bc7a58e49fa61bb76ee/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:56.168807 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296746e0-be0f-44b1-b387-e331ecb43fe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da073518359842f3adc6bd7ef87a7bf6, user_id=f639af7854bb4bc7a58e49fa61bb76ee, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:56.171507 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296746e0-be0f-44b1-b387-e331ecb43fe0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:56.182308 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1316/2606] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:29:56 2022] PUT /identity/v3/projects/da073518359842f3adc6bd7ef87a7bf6/users/f639af7854bb4bc7a58e49fa61bb76ee/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:29:56.195856 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bad75-0652-48db-8713-261dcd4cfec1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:56.196026 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bad75-0652-48db-8713-261dcd4cfec1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:56.196309 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bad75-0652-48db-8713-261dcd4cfec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:56.223250 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ba1bad75-0652-48db-8713-261dcd4cfec1 None None] MFA Rules not processed for user `f639af7854bb4bc7a58e49fa61bb76ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:29:56.224513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ba1bad75-0652-48db-8713-261dcd4cfec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:56.300782 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1291/2607] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:29:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:29:56.311573 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296746e0-be0f-44b1-b387-e331ecb43fe0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:56.313358 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-296746e0-be0f-44b1-b387-e331ecb43fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:56.372154 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296746e0-be0f-44b1-b387-e331ecb43fe0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:56.376327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c515a0e-968b-4fc2-8160-f8a343f8a4c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:56.377020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c515a0e-968b-4fc2-8160-f8a343f8a4c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:56.377328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c515a0e-968b-4fc2-8160-f8a343f8a4c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:56.377606 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c515a0e-968b-4fc2-8160-f8a343f8a4c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:56.387412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c515a0e-968b-4fc2-8160-f8a343f8a4c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:56.388860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c515a0e-968b-4fc2-8160-f8a343f8a4c6 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:56.399023 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1317/2608] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:29:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:29:56.528948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1bad75-0652-48db-8713-261dcd4cfec1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:56.589352 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1bad75-0652-48db-8713-261dcd4cfec1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:56.594514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a3ad0-4d2c-4993-bc9e-edbfe829c950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:56.595416 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a3ad0-4d2c-4993-bc9e-edbfe829c950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:56.595691 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a3ad0-4d2c-4993-bc9e-edbfe829c950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:56.595962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a3ad0-4d2c-4993-bc9e-edbfe829c950 admin admin] PATH_INFO: `/v3/users/4c4f0d22cacd493fab9dd0b67bb25a1f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:56.597171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a3ad0-4d2c-4993-bc9e-edbfe829c950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c4f0d22cacd493fab9dd0b67bb25a1f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:56.599229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a3ad0-4d2c-4993-bc9e-edbfe829c950 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:56.647055 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b53a3ad0-4d2c-4993-bc9e-edbfe829c950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c4f0d22cacd493fab9dd0b67bb25a1f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:56.659325 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b53a3ad0-4d2c-4993-bc9e-edbfe829c950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c4f0d22cacd493fab9dd0b67bb25a1f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:56.660029 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b53a3ad0-4d2c-4993-bc9e-edbfe829c950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c4f0d22cacd493fab9dd0b67bb25a1f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:56.660672 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b53a3ad0-4d2c-4993-bc9e-edbfe829c950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c4f0d22cacd493fab9dd0b67bb25a1f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:56.668811 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b53a3ad0-4d2c-4993-bc9e-edbfe829c950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c4f0d22cacd493fab9dd0b67bb25a1f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:56.680566 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1292/2609] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:29:56 2022] DELETE /identity/v3/users/4c4f0d22cacd493fab9dd0b67bb25a1f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:29:56.685139 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11105db-854c-4080-856f-a14847b2e4b6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:56.685430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11105db-854c-4080-856f-a14847b2e4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:56.685711 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11105db-854c-4080-856f-a14847b2e4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:56.703623 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a11105db-854c-4080-856f-a14847b2e4b6 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:29:56.704773 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a11105db-854c-4080-856f-a14847b2e4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:56.763575 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1318/2610] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:29:56.773776 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a3ad0-4d2c-4993-bc9e-edbfe829c950 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:56.775220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b53a3ad0-4d2c-4993-bc9e-edbfe829c950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:56.831979 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a3ad0-4d2c-4993-bc9e-edbfe829c950 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:56.836188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959c259-962a-4471-88ff-fe927ba731cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:56.836846 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959c259-962a-4471-88ff-fe927ba731cf service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:56.837138 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959c259-962a-4471-88ff-fe927ba731cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:56.837405 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959c259-962a-4471-88ff-fe927ba731cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:56.847093 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959c259-962a-4471-88ff-fe927ba731cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:56.848581 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959c259-962a-4471-88ff-fe927ba731cf service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:56.858212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1293/2611] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:29:57.144290 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11105db-854c-4080-856f-a14847b2e4b6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:57.145986 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a11105db-854c-4080-856f-a14847b2e4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:57.160249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11105db-854c-4080-856f-a14847b2e4b6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:57.165400 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b00a87-24ca-455f-81fa-0cbd1b0eff9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:57.166333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b00a87-24ca-455f-81fa-0cbd1b0eff9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:57.166706 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b00a87-24ca-455f-81fa-0cbd1b0eff9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:57.167005 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b00a87-24ca-455f-81fa-0cbd1b0eff9a admin admin] PATH_INFO: `/v3/projects/f9c3202f0f1645d297754759fc3df471` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:57.168537 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b00a87-24ca-455f-81fa-0cbd1b0eff9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c3202f0f1645d297754759fc3df471)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:57.170509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b00a87-24ca-455f-81fa-0cbd1b0eff9a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:57.216363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-41b00a87-24ca-455f-81fa-0cbd1b0eff9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c3202f0f1645d297754759fc3df471', 'request_id': 'req-41b00a87-24ca-455f-81fa-0cbd1b0eff9a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:57.222267 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-41b00a87-24ca-455f-81fa-0cbd1b0eff9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c3202f0f1645d297754759fc3df471', 'request_id': 'req-41b00a87-24ca-455f-81fa-0cbd1b0eff9a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:57.231037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-41b00a87-24ca-455f-81fa-0cbd1b0eff9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c3202f0f1645d297754759fc3df471', 'request_id': 'req-41b00a87-24ca-455f-81fa-0cbd1b0eff9a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:57.244740 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-41b00a87-24ca-455f-81fa-0cbd1b0eff9a admin admin] The token cache is being invalidate because project f9c3202f0f1645d297754759fc3df471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:29:57.246026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-41b00a87-24ca-455f-81fa-0cbd1b0eff9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:57.246700 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-41b00a87-24ca-455f-81fa-0cbd1b0eff9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:57.248622 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1319/2612] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:29:57 2022] DELETE /identity/v3/projects/f9c3202f0f1645d297754759fc3df471 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:29:57.252742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959c259-962a-4471-88ff-fe927ba731cf service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:57.263184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959c259-962a-4471-88ff-fe927ba731cf service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:57.328200 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca89d3-83d5-4c14-ae8f-657d68dcdcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:57.329080 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca89d3-83d5-4c14-ae8f-657d68dcdcff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:57.329360 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca89d3-83d5-4c14-ae8f-657d68dcdcff admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:57.329626 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca89d3-83d5-4c14-ae8f-657d68dcdcff admin admin] PATH_INFO: `/v3/users/f639af7854bb4bc7a58e49fa61bb76ee` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:57.330840 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca89d3-83d5-4c14-ae8f-657d68dcdcff admin admin] RBAC: Authorizing `identity:delete_user(user_id=f639af7854bb4bc7a58e49fa61bb76ee)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:57.332892 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca89d3-83d5-4c14-ae8f-657d68dcdcff admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:57.379770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-22ca89d3-83d5-4c14-ae8f-657d68dcdcff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f639af7854bb4bc7a58e49fa61bb76ee'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:57.391014 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-22ca89d3-83d5-4c14-ae8f-657d68dcdcff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f639af7854bb4bc7a58e49fa61bb76ee'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:57.391737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-22ca89d3-83d5-4c14-ae8f-657d68dcdcff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f639af7854bb4bc7a58e49fa61bb76ee'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:57.392497 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-22ca89d3-83d5-4c14-ae8f-657d68dcdcff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f639af7854bb4bc7a58e49fa61bb76ee'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:57.401963 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-22ca89d3-83d5-4c14-ae8f-657d68dcdcff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f639af7854bb4bc7a58e49fa61bb76ee'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:57.414256 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1294/2613] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:29:57 2022] DELETE /identity/v3/users/f639af7854bb4bc7a58e49fa61bb76ee => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:29:57.682800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b00a87-24ca-455f-81fa-0cbd1b0eff9a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:57.684350 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-41b00a87-24ca-455f-81fa-0cbd1b0eff9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:57.699856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b00a87-24ca-455f-81fa-0cbd1b0eff9a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:57.756544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074c0a1-0c9a-4c54-b618-8f67aa628814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:57.757518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074c0a1-0c9a-4c54-b618-8f67aa628814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:57.757738 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074c0a1-0c9a-4c54-b618-8f67aa628814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:57.758013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074c0a1-0c9a-4c54-b618-8f67aa628814 admin admin] PATH_INFO: `/v3/projects/da073518359842f3adc6bd7ef87a7bf6` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:57.759361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074c0a1-0c9a-4c54-b618-8f67aa628814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da073518359842f3adc6bd7ef87a7bf6)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:57.761283 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074c0a1-0c9a-4c54-b618-8f67aa628814 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:57.808294 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0074c0a1-0c9a-4c54-b618-8f67aa628814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da073518359842f3adc6bd7ef87a7bf6', 'request_id': 'req-0074c0a1-0c9a-4c54-b618-8f67aa628814'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:57.814322 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0074c0a1-0c9a-4c54-b618-8f67aa628814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da073518359842f3adc6bd7ef87a7bf6', 'request_id': 'req-0074c0a1-0c9a-4c54-b618-8f67aa628814'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:57.824425 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0074c0a1-0c9a-4c54-b618-8f67aa628814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da073518359842f3adc6bd7ef87a7bf6', 'request_id': 'req-0074c0a1-0c9a-4c54-b618-8f67aa628814'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:57.834786 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0074c0a1-0c9a-4c54-b618-8f67aa628814 admin admin] The token cache is being invalidate because project da073518359842f3adc6bd7ef87a7bf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:29:57.835105 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0074c0a1-0c9a-4c54-b618-8f67aa628814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:57.835720 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0074c0a1-0c9a-4c54-b618-8f67aa628814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:29:57.837271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1320/2614] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:29:57 2022] DELETE /identity/v3/projects/da073518359842f3adc6bd7ef87a7bf6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:29:57.842262 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cbbe0-7fa8-4e01-b3f5-09b13713139b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:57.842551 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cbbe0-7fa8-4e01-b3f5-09b13713139b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:57.842831 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cbbe0-7fa8-4e01-b3f5-09b13713139b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:57.862456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-339cbbe0-7fa8-4e01-b3f5-09b13713139b None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:29:57.863723 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-339cbbe0-7fa8-4e01-b3f5-09b13713139b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:57.929436 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1295/2615] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:29:57.993127 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b1669-d285-477e-987e-5404f2c2f7d7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:57.993410 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b1669-d285-477e-987e-5404f2c2f7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:57.993814 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b1669-d285-477e-987e-5404f2c2f7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:58.017737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f87b1669-d285-477e-987e-5404f2c2f7d7 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:29:58.019247 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f87b1669-d285-477e-987e-5404f2c2f7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:58.027994 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1321/2616] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:29:58.032269 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339cbbe0-7fa8-4e01-b3f5-09b13713139b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:58.042519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339cbbe0-7fa8-4e01-b3f5-09b13713139b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:58.048484 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175b853-a711-4222-b6d5-ee770a6201c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:58.049153 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175b853-a711-4222-b6d5-ee770a6201c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:58.049441 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175b853-a711-4222-b6d5-ee770a6201c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:58.049688 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175b853-a711-4222-b6d5-ee770a6201c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:58.050443 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175b853-a711-4222-b6d5-ee770a6201c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:29:58.050754 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175b853-a711-4222-b6d5-ee770a6201c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:58.052519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175b853-a711-4222-b6d5-ee770a6201c7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:58.064661 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1296/2617] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 07:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:29:58.069255 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b1669-d285-477e-987e-5404f2c2f7d7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:58.079239 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b1669-d285-477e-987e-5404f2c2f7d7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:58.084498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98758479-3d66-4f54-b993-716b23cb5917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:58.085165 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98758479-3d66-4f54-b993-716b23cb5917 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:58.085443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98758479-3d66-4f54-b993-716b23cb5917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:58.085714 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98758479-3d66-4f54-b993-716b23cb5917 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:58.086407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98758479-3d66-4f54-b993-716b23cb5917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:58.088340 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98758479-3d66-4f54-b993-716b23cb5917 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:58.117397 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1322/2618] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:29:58 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:29:58.121667 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175b853-a711-4222-b6d5-ee770a6201c7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:58.131634 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175b853-a711-4222-b6d5-ee770a6201c7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:58.192004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ce326-b823-4fb5-9ac2-3d00c5beed19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:58.192682 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ce326-b823-4fb5-9ac2-3d00c5beed19 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:58.192950 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ce326-b823-4fb5-9ac2-3d00c5beed19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:58.193252 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ce326-b823-4fb5-9ac2-3d00c5beed19 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:58.193950 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ce326-b823-4fb5-9ac2-3d00c5beed19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:58.195959 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ce326-b823-4fb5-9ac2-3d00c5beed19 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:58.220515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1297/2619] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:29:58 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:29:58.224685 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98758479-3d66-4f54-b993-716b23cb5917 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:58.235517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98758479-3d66-4f54-b993-716b23cb5917 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:58.240750 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9a31f-dea6-41d9-a1f3-5b7361b892f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:58.241411 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9a31f-dea6-41d9-a1f3-5b7361b892f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:58.241733 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9a31f-dea6-41d9-a1f3-5b7361b892f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:58.242019 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9a31f-dea6-41d9-a1f3-5b7361b892f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:58.242738 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9a31f-dea6-41d9-a1f3-5b7361b892f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:58.244389 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9a31f-dea6-41d9-a1f3-5b7361b892f5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:58.254774 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1323/2620] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:29:58.258728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ce326-b823-4fb5-9ac2-3d00c5beed19 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:58.269293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ce326-b823-4fb5-9ac2-3d00c5beed19 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:58.274200 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf48ce-027b-49c7-b892-ef7f39d000f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:58.274854 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf48ce-027b-49c7-b892-ef7f39d000f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:58.275172 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf48ce-027b-49c7-b892-ef7f39d000f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:58.275451 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf48ce-027b-49c7-b892-ef7f39d000f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:58.276177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf48ce-027b-49c7-b892-ef7f39d000f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:58.277771 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf48ce-027b-49c7-b892-ef7f39d000f0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:58.289151 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1298/2621] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:29:58.293535 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9a31f-dea6-41d9-a1f3-5b7361b892f5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:58.305393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9a31f-dea6-41d9-a1f3-5b7361b892f5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:58.310221 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e593846-3b2b-4c48-999b-36aebd0f72b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:58.311197 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e593846-3b2b-4c48-999b-36aebd0f72b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:58.311503 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e593846-3b2b-4c48-999b-36aebd0f72b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:58.311761 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e593846-3b2b-4c48-999b-36aebd0f72b7 admin admin] PATH_INFO: `/v3/projects/eb3ecf55ff5440648c96138e20ff7a8e/users/0bd8825042674e8d9b4d236962de73bc/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:58.326084 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e593846-3b2b-4c48-999b-36aebd0f72b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb3ecf55ff5440648c96138e20ff7a8e, user_id=0bd8825042674e8d9b4d236962de73bc, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:58.328794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e593846-3b2b-4c48-999b-36aebd0f72b7 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:58.343112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1324/2622] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:29:58 2022] PUT /identity/v3/projects/eb3ecf55ff5440648c96138e20ff7a8e/users/0bd8825042674e8d9b4d236962de73bc/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:29:58.348227 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72530bf7-4c24-495e-9645-50a17cc3016d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:58.348514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72530bf7-4c24-495e-9645-50a17cc3016d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:58.348789 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72530bf7-4c24-495e-9645-50a17cc3016d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:58.366989 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-72530bf7-4c24-495e-9645-50a17cc3016d None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:29:58.368214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-72530bf7-4c24-495e-9645-50a17cc3016d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:58.432384 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1299/2623] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:29:58.442010 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e593846-3b2b-4c48-999b-36aebd0f72b7 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:58.443918 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4e593846-3b2b-4c48-999b-36aebd0f72b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:58.503087 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e593846-3b2b-4c48-999b-36aebd0f72b7 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:58.507835 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de26aed-9e45-43e2-9511-71be6d893f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:58.508488 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de26aed-9e45-43e2-9511-71be6d893f2d service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:58.508768 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de26aed-9e45-43e2-9511-71be6d893f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:58.509046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de26aed-9e45-43e2-9511-71be6d893f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:58.519416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de26aed-9e45-43e2-9511-71be6d893f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:58.520788 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de26aed-9e45-43e2-9511-71be6d893f2d service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:58.530389 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1325/2624] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:29:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:29:59.197701 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca05817-a429-4b88-b032-1979bee638f2 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:59.197997 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca05817-a429-4b88-b032-1979bee638f2 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:59.198281 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca05817-a429-4b88-b032-1979bee638f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:59.225347 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-dca05817-a429-4b88-b032-1979bee638f2 None None] MFA Rules not processed for user `0bd8825042674e8d9b4d236962de73bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:29:59.226582 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-dca05817-a429-4b88-b032-1979bee638f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:29:59.298622 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1300/2625] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:29:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:29:59.303453 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de26aed-9e45-43e2-9511-71be6d893f2d service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:59.314589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de26aed-9e45-43e2-9511-71be6d893f2d service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:59.320081 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbf254-5195-4179-b9b7-17eb94e38739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:59.320823 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbf254-5195-4179-b9b7-17eb94e38739 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:59.321024 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbf254-5195-4179-b9b7-17eb94e38739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:59.321293 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbf254-5195-4179-b9b7-17eb94e38739 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:59.322291 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbf254-5195-4179-b9b7-17eb94e38739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:59.324275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbf254-5195-4179-b9b7-17eb94e38739 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:59.352026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1326/2626] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:29:59 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:29:59.356263 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca05817-a429-4b88-b032-1979bee638f2 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:59.367475 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca05817-a429-4b88-b032-1979bee638f2 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:59.427458 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1871f4-5eaf-4dad-b350-4a2695ffe1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:59.428136 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1871f4-5eaf-4dad-b350-4a2695ffe1a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:59.428422 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1871f4-5eaf-4dad-b350-4a2695ffe1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:59.428700 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1871f4-5eaf-4dad-b350-4a2695ffe1a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:59.429406 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1871f4-5eaf-4dad-b350-4a2695ffe1a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:59.431373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1871f4-5eaf-4dad-b350-4a2695ffe1a9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:59.455090 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1301/2627] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:29:59 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:29:59.459683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbf254-5195-4179-b9b7-17eb94e38739 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:59.470627 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbf254-5195-4179-b9b7-17eb94e38739 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:59.475532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a1553-fc26-4d11-a6ce-6055e868a3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:59.476203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a1553-fc26-4d11-a6ce-6055e868a3fc admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:59.476490 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a1553-fc26-4d11-a6ce-6055e868a3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:59.476764 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a1553-fc26-4d11-a6ce-6055e868a3fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:59.477515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a1553-fc26-4d11-a6ce-6055e868a3fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:59.479356 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a1553-fc26-4d11-a6ce-6055e868a3fc admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:59.491454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1327/2628] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:29:59.495841 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1871f4-5eaf-4dad-b350-4a2695ffe1a9 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:59.507102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1871f4-5eaf-4dad-b350-4a2695ffe1a9 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:59.512015 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6aae9-001a-4508-a0db-511f386054fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:59.512923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6aae9-001a-4508-a0db-511f386054fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:59.513205 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6aae9-001a-4508-a0db-511f386054fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:59.513481 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6aae9-001a-4508-a0db-511f386054fa admin admin] PATH_INFO: `/v3/projects/cf0b391ddf024594a51494d6c9073a1a/users/c7ff5d1d5ba74ff5a961b6d210486712/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:59.528584 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6aae9-001a-4508-a0db-511f386054fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0b391ddf024594a51494d6c9073a1a, user_id=c7ff5d1d5ba74ff5a961b6d210486712, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:59.531318 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6aae9-001a-4508-a0db-511f386054fa admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:59.549542 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1302/2629] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:29:59 2022] PUT /identity/v3/projects/cf0b391ddf024594a51494d6c9073a1a/users/c7ff5d1d5ba74ff5a961b6d210486712/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:29:59.550754 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a1553-fc26-4d11-a6ce-6055e868a3fc admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:59.561415 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a1553-fc26-4d11-a6ce-6055e868a3fc admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:59.620227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324cf97-b1fe-46e3-ae83-b6fb2e04adb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:59.620825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324cf97-b1fe-46e3-ae83-b6fb2e04adb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:59.621103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324cf97-b1fe-46e3-ae83-b6fb2e04adb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:59.621376 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324cf97-b1fe-46e3-ae83-b6fb2e04adb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:59.622110 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324cf97-b1fe-46e3-ae83-b6fb2e04adb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:59.623794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324cf97-b1fe-46e3-ae83-b6fb2e04adb6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:59.633864 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1328/2630] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:29:59.638233 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6aae9-001a-4508-a0db-511f386054fa admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:29:59.649803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6aae9-001a-4508-a0db-511f386054fa admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:29:59.655813 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d391b-6333-4ec6-89f6-82cd70fd855e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:29:59.656709 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d391b-6333-4ec6-89f6-82cd70fd855e admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:29:59.656990 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d391b-6333-4ec6-89f6-82cd70fd855e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:29:59.657300 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d391b-6333-4ec6-89f6-82cd70fd855e admin admin] PATH_INFO: `/v3/projects/cf0b391ddf024594a51494d6c9073a1a/users/c7ff5d1d5ba74ff5a961b6d210486712/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:29:59.659448 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d391b-6333-4ec6-89f6-82cd70fd855e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0b391ddf024594a51494d6c9073a1a, user_id=c7ff5d1d5ba74ff5a961b6d210486712, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:29:59.662096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d391b-6333-4ec6-89f6-82cd70fd855e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:29:59.672666 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1303/2631] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:29:59 2022] PUT /identity/v3/projects/cf0b391ddf024594a51494d6c9073a1a/users/c7ff5d1d5ba74ff5a961b6d210486712/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:30:00.278427 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096274b-afa1-4830-b93f-3e344044856a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:00.278815 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096274b-afa1-4830-b93f-3e344044856a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:00.279173 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096274b-afa1-4830-b93f-3e344044856a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:00.306986 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b096274b-afa1-4830-b93f-3e344044856a None None] MFA Rules not processed for user `c7ff5d1d5ba74ff5a961b6d210486712`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:00.308235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b096274b-afa1-4830-b93f-3e344044856a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:00.383887 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1329/2632] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:30:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:00.395741 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d391b-6333-4ec6-89f6-82cd70fd855e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:00.397703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c16d391b-6333-4ec6-89f6-82cd70fd855e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:00.457102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d391b-6333-4ec6-89f6-82cd70fd855e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:00.461539 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405dea8-ce3a-4343-baac-cb6d76f9fd76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:00.462177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405dea8-ce3a-4343-baac-cb6d76f9fd76 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:00.462455 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405dea8-ce3a-4343-baac-cb6d76f9fd76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:00.462724 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405dea8-ce3a-4343-baac-cb6d76f9fd76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:00.517230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5405dea8-ce3a-4343-baac-cb6d76f9fd76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:00.518663 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5405dea8-ce3a-4343-baac-cb6d76f9fd76 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:00.527922 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1304/2633] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:30:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:30:01.884118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096274b-afa1-4830-b93f-3e344044856a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:01.896019 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096274b-afa1-4830-b93f-3e344044856a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:01.900275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade2f27-eedd-4c69-8577-8020a05540ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:01.900931 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade2f27-eedd-4c69-8577-8020a05540ea service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:01.901218 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade2f27-eedd-4c69-8577-8020a05540ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:01.901498 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade2f27-eedd-4c69-8577-8020a05540ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:01.911055 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade2f27-eedd-4c69-8577-8020a05540ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:01.912554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade2f27-eedd-4c69-8577-8020a05540ea service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:01.922452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1330/2634] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:30:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:30:09.708654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29bba1-ee6b-47e5-92ac-72227a202d4a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:09.709129 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29bba1-ee6b-47e5-92ac-72227a202d4a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:09.709233 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29bba1-ee6b-47e5-92ac-72227a202d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:09.768136 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-6b29bba1-ee6b-47e5-92ac-72227a202d4a None None] MFA Rules not processed for user `99cbf80fc74c4183a6eed3e97f7196f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:09.769724 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6b29bba1-ee6b-47e5-92ac-72227a202d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:09.838717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1305/2635] 10.222.0.77 () {58 vars in 1009 bytes} [Wed May 11 07:30:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:30:09.895219 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade2f27-eedd-4c69-8577-8020a05540ea service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:09.896836 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cade2f27-eedd-4c69-8577-8020a05540ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:09.989872 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade2f27-eedd-4c69-8577-8020a05540ea service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:09.997050 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb21dc-013b-4743-98f0-5831f23d03e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f726f58d30734be7abf15400bff89533', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:09.997703 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb21dc-013b-4743-98f0-5831f23d03e2 service swift] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:09.997986 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb21dc-013b-4743-98f0-5831f23d03e2 service swift] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:09.998244 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb21dc-013b-4743-98f0-5831f23d03e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:10.006741 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb21dc-013b-4743-98f0-5831f23d03e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:10.008406 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb21dc-013b-4743-98f0-5831f23d03e2 service swift] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:10.016507 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1331/2636] 10.222.0.77 () {60 vars in 1384 bytes} [Wed May 11 07:30:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:30:16.390357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29bba1-ee6b-47e5-92ac-72227a202d4a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:16.468058 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29bba1-ee6b-47e5-92ac-72227a202d4a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:16.476456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51c4bc-b67d-4c5c-9703-10efe2752524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:16.477716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51c4bc-b67d-4c5c-9703-10efe2752524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:16.478163 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51c4bc-b67d-4c5c-9703-10efe2752524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:16.478442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51c4bc-b67d-4c5c-9703-10efe2752524 admin admin] PATH_INFO: `/v3/users/0bd8825042674e8d9b4d236962de73bc` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:16.479720 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51c4bc-b67d-4c5c-9703-10efe2752524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bd8825042674e8d9b4d236962de73bc)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:16.481688 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51c4bc-b67d-4c5c-9703-10efe2752524 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:16.537458 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7f51c4bc-b67d-4c5c-9703-10efe2752524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bd8825042674e8d9b4d236962de73bc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:16.550573 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7f51c4bc-b67d-4c5c-9703-10efe2752524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bd8825042674e8d9b4d236962de73bc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:16.551356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7f51c4bc-b67d-4c5c-9703-10efe2752524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bd8825042674e8d9b4d236962de73bc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:16.552008 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7f51c4bc-b67d-4c5c-9703-10efe2752524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bd8825042674e8d9b4d236962de73bc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:16.562270 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7f51c4bc-b67d-4c5c-9703-10efe2752524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bd8825042674e8d9b4d236962de73bc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:16.574293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1306/2637] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:30:16 2022] DELETE /identity/v3/users/0bd8825042674e8d9b4d236962de73bc => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:30:16.811591 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb21dc-013b-4743-98f0-5831f23d03e2 service swift] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:16.826231 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb21dc-013b-4743-98f0-5831f23d03e2 service swift] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:16.918304 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972eb55f-e450-4ec8-b8cb-3da0e267586c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:16.919386 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eb55f-e450-4ec8-b8cb-3da0e267586c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:16.919765 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eb55f-e450-4ec8-b8cb-3da0e267586c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:16.920136 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eb55f-e450-4ec8-b8cb-3da0e267586c admin admin] PATH_INFO: `/v3/projects/eb3ecf55ff5440648c96138e20ff7a8e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:16.921974 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972eb55f-e450-4ec8-b8cb-3da0e267586c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb3ecf55ff5440648c96138e20ff7a8e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:16.925708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972eb55f-e450-4ec8-b8cb-3da0e267586c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:16.978655 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-972eb55f-e450-4ec8-b8cb-3da0e267586c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb3ecf55ff5440648c96138e20ff7a8e', 'request_id': 'req-972eb55f-e450-4ec8-b8cb-3da0e267586c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:16.985818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-972eb55f-e450-4ec8-b8cb-3da0e267586c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb3ecf55ff5440648c96138e20ff7a8e', 'request_id': 'req-972eb55f-e450-4ec8-b8cb-3da0e267586c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:16.998801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-972eb55f-e450-4ec8-b8cb-3da0e267586c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb3ecf55ff5440648c96138e20ff7a8e', 'request_id': 'req-972eb55f-e450-4ec8-b8cb-3da0e267586c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:17.011789 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-972eb55f-e450-4ec8-b8cb-3da0e267586c admin admin] The token cache is being invalidate because project eb3ecf55ff5440648c96138e20ff7a8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:30:17.012087 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-972eb55f-e450-4ec8-b8cb-3da0e267586c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:17.013080 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-972eb55f-e450-4ec8-b8cb-3da0e267586c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:17.014777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1332/2638] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:30:16 2022] DELETE /identity/v3/projects/eb3ecf55ff5440648c96138e20ff7a8e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:30:17.019428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51c4bc-b67d-4c5c-9703-10efe2752524 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:17.021077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7f51c4bc-b67d-4c5c-9703-10efe2752524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:17.035270 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51c4bc-b67d-4c5c-9703-10efe2752524 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:17.102465 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161640d-f876-4205-86bc-53f7053f04ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:17.103485 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161640d-f876-4205-86bc-53f7053f04ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:17.103830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161640d-f876-4205-86bc-53f7053f04ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:17.104171 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161640d-f876-4205-86bc-53f7053f04ca admin admin] PATH_INFO: `/v3/users/c7ff5d1d5ba74ff5a961b6d210486712` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:17.105569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161640d-f876-4205-86bc-53f7053f04ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7ff5d1d5ba74ff5a961b6d210486712)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:17.108739 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161640d-f876-4205-86bc-53f7053f04ca admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:17.163929 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e161640d-f876-4205-86bc-53f7053f04ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7ff5d1d5ba74ff5a961b6d210486712'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:17.179463 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e161640d-f876-4205-86bc-53f7053f04ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7ff5d1d5ba74ff5a961b6d210486712'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:17.180232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e161640d-f876-4205-86bc-53f7053f04ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7ff5d1d5ba74ff5a961b6d210486712'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:17.180858 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e161640d-f876-4205-86bc-53f7053f04ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7ff5d1d5ba74ff5a961b6d210486712'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:17.190148 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e161640d-f876-4205-86bc-53f7053f04ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7ff5d1d5ba74ff5a961b6d210486712'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:17.205140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1307/2639] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:30:17 2022] DELETE /identity/v3/users/c7ff5d1d5ba74ff5a961b6d210486712 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:30:17.414464 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972eb55f-e450-4ec8-b8cb-3da0e267586c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:17.416183 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-972eb55f-e450-4ec8-b8cb-3da0e267586c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:17.456761 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972eb55f-e450-4ec8-b8cb-3da0e267586c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:17.519152 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ba559-e989-447a-91cf-9de08fc3be1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:17.520329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ba559-e989-447a-91cf-9de08fc3be1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:17.520789 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ba559-e989-447a-91cf-9de08fc3be1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:17.521221 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ba559-e989-447a-91cf-9de08fc3be1e admin admin] PATH_INFO: `/v3/projects/cf0b391ddf024594a51494d6c9073a1a` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:17.522424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ba559-e989-447a-91cf-9de08fc3be1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf0b391ddf024594a51494d6c9073a1a)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:17.524434 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ba559-e989-447a-91cf-9de08fc3be1e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:17.580414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-586ba559-e989-447a-91cf-9de08fc3be1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf0b391ddf024594a51494d6c9073a1a', 'request_id': 'req-586ba559-e989-447a-91cf-9de08fc3be1e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:17.587205 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-586ba559-e989-447a-91cf-9de08fc3be1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf0b391ddf024594a51494d6c9073a1a', 'request_id': 'req-586ba559-e989-447a-91cf-9de08fc3be1e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:17.597135 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-586ba559-e989-447a-91cf-9de08fc3be1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf0b391ddf024594a51494d6c9073a1a', 'request_id': 'req-586ba559-e989-447a-91cf-9de08fc3be1e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:17.608664 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-586ba559-e989-447a-91cf-9de08fc3be1e admin admin] The token cache is being invalidate because project cf0b391ddf024594a51494d6c9073a1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:30:17.608664 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-586ba559-e989-447a-91cf-9de08fc3be1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:17.609415 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-586ba559-e989-447a-91cf-9de08fc3be1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:17.611100 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1333/2640] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:30:17 2022] DELETE /identity/v3/projects/cf0b391ddf024594a51494d6c9073a1a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:30:17.616076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5f5bf-8dac-470a-a069-ddea73a4cea5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:17.616586 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5f5bf-8dac-470a-a069-ddea73a4cea5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:17.616690 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5f5bf-8dac-470a-a069-ddea73a4cea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:17.636197 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-05b5f5bf-8dac-470a-a069-ddea73a4cea5 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:17.637545 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-05b5f5bf-8dac-470a-a069-ddea73a4cea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:17.702714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1308/2641] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:17.710800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f5f00-977a-4dbd-aecc-215d8b8651c6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:17.711129 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f5f00-977a-4dbd-aecc-215d8b8651c6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:17.711481 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f5f00-977a-4dbd-aecc-215d8b8651c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:17.731964 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bb5f5f00-977a-4dbd-aecc-215d8b8651c6 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:17.733228 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bb5f5f00-977a-4dbd-aecc-215d8b8651c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:17.741356 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1334/2642] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:17.745856 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5f5bf-8dac-470a-a069-ddea73a4cea5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:17.758397 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5f5bf-8dac-470a-a069-ddea73a4cea5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:17.763213 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e846a8-0079-40d8-9ef4-00d7b8d23926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:17.763851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e846a8-0079-40d8-9ef4-00d7b8d23926 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:17.764138 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e846a8-0079-40d8-9ef4-00d7b8d23926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:17.764417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e846a8-0079-40d8-9ef4-00d7b8d23926 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:17.765184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e846a8-0079-40d8-9ef4-00d7b8d23926 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:30:17.765525 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e846a8-0079-40d8-9ef4-00d7b8d23926 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:17.767202 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e846a8-0079-40d8-9ef4-00d7b8d23926 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:17.780739 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1309/2643] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 07:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:30:17.785219 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f5f00-977a-4dbd-aecc-215d8b8651c6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:17.794675 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f5f00-977a-4dbd-aecc-215d8b8651c6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:17.801642 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4321d0-6aa2-4a2a-ab92-e34f6feda0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:17.802419 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4321d0-6aa2-4a2a-ab92-e34f6feda0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:17.802777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4321d0-6aa2-4a2a-ab92-e34f6feda0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:17.803171 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4321d0-6aa2-4a2a-ab92-e34f6feda0e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:17.803958 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4321d0-6aa2-4a2a-ab92-e34f6feda0e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:17.807801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4321d0-6aa2-4a2a-ab92-e34f6feda0e5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:17.844360 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1335/2644] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:30:17 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:30:17.847098 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e846a8-0079-40d8-9ef4-00d7b8d23926 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:17.858491 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e846a8-0079-40d8-9ef4-00d7b8d23926 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:17.920764 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffbe3e-046e-4f46-8898-650225da8139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:17.921462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffbe3e-046e-4f46-8898-650225da8139 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:17.922054 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffbe3e-046e-4f46-8898-650225da8139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:17.922334 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffbe3e-046e-4f46-8898-650225da8139 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:17.923074 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffbe3e-046e-4f46-8898-650225da8139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:17.925013 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffbe3e-046e-4f46-8898-650225da8139 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:17.953132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1310/2645] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:30:17 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:30:17.957217 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4321d0-6aa2-4a2a-ab92-e34f6feda0e5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:17.969993 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4321d0-6aa2-4a2a-ab92-e34f6feda0e5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:17.975824 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b46c9-c808-4944-baee-038a43bdd57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:17.976523 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b46c9-c808-4944-baee-038a43bdd57f admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:17.976807 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b46c9-c808-4944-baee-038a43bdd57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:17.977158 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b46c9-c808-4944-baee-038a43bdd57f admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:17.977907 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b46c9-c808-4944-baee-038a43bdd57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:17.979583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b46c9-c808-4944-baee-038a43bdd57f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:17.993648 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1336/2646] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:30:17.995863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffbe3e-046e-4f46-8898-650225da8139 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:18.006316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffbe3e-046e-4f46-8898-650225da8139 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:18.015234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786aac6-cf09-489e-a52a-0d3d8948dbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:18.015234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786aac6-cf09-489e-a52a-0d3d8948dbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:18.015234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786aac6-cf09-489e-a52a-0d3d8948dbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:18.015234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786aac6-cf09-489e-a52a-0d3d8948dbb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:18.015744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786aac6-cf09-489e-a52a-0d3d8948dbb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:18.015836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786aac6-cf09-489e-a52a-0d3d8948dbb5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:18.032709 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1311/2647] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:30:18.037091 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b46c9-c808-4944-baee-038a43bdd57f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:18.048314 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b46c9-c808-4944-baee-038a43bdd57f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:18.055381 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48f598-95b4-4ae0-856a-158ec7e152c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:18.056344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48f598-95b4-4ae0-856a-158ec7e152c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:18.056632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48f598-95b4-4ae0-856a-158ec7e152c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:18.056908 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48f598-95b4-4ae0-856a-158ec7e152c2 admin admin] PATH_INFO: `/v3/projects/c48996974ea04b11abdda1a35990d20c/users/862435be6bf14787ba280a4b437cd387/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:18.077618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48f598-95b4-4ae0-856a-158ec7e152c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48996974ea04b11abdda1a35990d20c, user_id=862435be6bf14787ba280a4b437cd387, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:18.081473 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48f598-95b4-4ae0-856a-158ec7e152c2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:18.122808 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1337/2648] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:30:18 2022] PUT /identity/v3/projects/c48996974ea04b11abdda1a35990d20c/users/862435be6bf14787ba280a4b437cd387/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:30:18.131851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f92e8c-c505-41f4-8c6f-8e3ea80740e8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:18.132142 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f92e8c-c505-41f4-8c6f-8e3ea80740e8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:18.132423 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f92e8c-c505-41f4-8c6f-8e3ea80740e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:18.161398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e3f92e8c-c505-41f4-8c6f-8e3ea80740e8 None None] MFA Rules not processed for user `862435be6bf14787ba280a4b437cd387`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:18.162678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e3f92e8c-c505-41f4-8c6f-8e3ea80740e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:18.230532 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1312/2649] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:30:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:18.242225 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48f598-95b4-4ae0-856a-158ec7e152c2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:18.244579 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ad48f598-95b4-4ae0-856a-158ec7e152c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:18.318273 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48f598-95b4-4ae0-856a-158ec7e152c2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:18.324462 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf143f-6874-4387-8079-0107ef6c0a80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:18.325134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf143f-6874-4387-8079-0107ef6c0a80 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:18.325416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf143f-6874-4387-8079-0107ef6c0a80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:18.325695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf143f-6874-4387-8079-0107ef6c0a80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:18.335425 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf143f-6874-4387-8079-0107ef6c0a80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:18.337002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf143f-6874-4387-8079-0107ef6c0a80 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:18.347292 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1338/2650] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:30:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:30:23.044803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f92e8c-c505-41f4-8c6f-8e3ea80740e8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:23.046306 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e3f92e8c-c505-41f4-8c6f-8e3ea80740e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:23.059411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f92e8c-c505-41f4-8c6f-8e3ea80740e8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:23.064005 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00674489-1a35-44b6-b525-5c1ef3ab3a3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:23.064647 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00674489-1a35-44b6-b525-5c1ef3ab3a3e service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:23.064923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00674489-1a35-44b6-b525-5c1ef3ab3a3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:23.065194 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00674489-1a35-44b6-b525-5c1ef3ab3a3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:23.067348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-00674489-1a35-44b6-b525-5c1ef3ab3a3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:23.156001 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00674489-1a35-44b6-b525-5c1ef3ab3a3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:23.159304 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00674489-1a35-44b6-b525-5c1ef3ab3a3e service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:23.180920 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1313/2651] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:30:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:30:29.588437 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2584f-40a7-4d5f-a5ac-01b34d25c3e4 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:29.588979 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2584f-40a7-4d5f-a5ac-01b34d25c3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:29.588979 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2584f-40a7-4d5f-a5ac-01b34d25c3e4 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:29.590381 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1339/2652] 10.222.0.77 () {54 vars in 921 bytes} [Wed May 11 07:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:30:29.596527 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db470e-2d09-44d9-80f1-3517bc0c7699 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:29.597018 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db470e-2d09-44d9-80f1-3517bc0c7699 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:29.597133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db470e-2d09-44d9-80f1-3517bc0c7699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:29.635733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-02db470e-2d09-44d9-80f1-3517bc0c7699 None None] MFA Rules not processed for user `edf9d57de89a4701ba1a5b079d0ad348`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:29.636942 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-02db470e-2d09-44d9-80f1-3517bc0c7699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:29.701467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1314/2653] 10.222.0.77 () {58 vars in 1018 bytes} [Wed May 11 07:30:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:29.714460 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2584f-40a7-4d5f-a5ac-01b34d25c3e4 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:29.716257 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f5b2584f-40a7-4d5f-a5ac-01b34d25c3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:29.778669 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2584f-40a7-4d5f-a5ac-01b34d25c3e4 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:29.785820 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5bceb-4bf6-4999-adb3-51ef15d62280 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '281c923b01a143dbb79d8c0ea04f55b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:29.786599 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5bceb-4bf6-4999-adb3-51ef15d62280 service glance] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:29.786882 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5bceb-4bf6-4999-adb3-51ef15d62280 service glance] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:29.787214 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5bceb-4bf6-4999-adb3-51ef15d62280 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:29.798412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5bceb-4bf6-4999-adb3-51ef15d62280 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:29.800071 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5bceb-4bf6-4999-adb3-51ef15d62280 service glance] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:29.812237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1340/2654] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:30:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:30:29.883955 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6924f8-d83b-4ac2-83dd-ac95c458f2bc None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:29.884275 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6924f8-d83b-4ac2-83dd-ac95c458f2bc None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:29.884554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6924f8-d83b-4ac2-83dd-ac95c458f2bc None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:29.886000 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1315/2655] 10.222.0.77 () {54 vars in 921 bytes} [Wed May 11 07:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:30:29.891357 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c78901-5f3a-4e86-b44c-0b000712059d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:29.891645 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c78901-5f3a-4e86-b44c-0b000712059d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:29.891938 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c78901-5f3a-4e86-b44c-0b000712059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:29.928841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a0c78901-5f3a-4e86-b44c-0b000712059d None None] MFA Rules not processed for user `3c92f4b777a644ad8055f15b1a8bd0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:29.930053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a0c78901-5f3a-4e86-b44c-0b000712059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:29.979072 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1341/2656] 10.222.0.77 () {58 vars in 1018 bytes} [Wed May 11 07:30:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:29.991089 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6924f8-d83b-4ac2-83dd-ac95c458f2bc None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:29.992991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bc6924f8-d83b-4ac2-83dd-ac95c458f2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:30.006766 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6924f8-d83b-4ac2-83dd-ac95c458f2bc None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:30.010470 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff419f29-b03e-465f-b1b2-3f5eb15deb4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:30.011152 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff419f29-b03e-465f-b1b2-3f5eb15deb4d service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:30.011438 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff419f29-b03e-465f-b1b2-3f5eb15deb4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:30.011716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff419f29-b03e-465f-b1b2-3f5eb15deb4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:30.019433 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff419f29-b03e-465f-b1b2-3f5eb15deb4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:30.020881 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff419f29-b03e-465f-b1b2-3f5eb15deb4d service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:30.028622 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1316/2657] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:30:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:30:30.124227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca0d87-2323-43bd-a143-6adb729b6e59 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:30.124515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca0d87-2323-43bd-a143-6adb729b6e59 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:30.124791 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca0d87-2323-43bd-a143-6adb729b6e59 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:30.126187 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1342/2658] 10.222.0.77 () {54 vars in 921 bytes} [Wed May 11 07:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:30:30.132247 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff19d7d-ee8a-465a-b062-a4bd2116a3b8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:30.132570 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff19d7d-ee8a-465a-b062-a4bd2116a3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:30.133274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff19d7d-ee8a-465a-b062-a4bd2116a3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:30.153368 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8ff19d7d-ee8a-465a-b062-a4bd2116a3b8 None None] MFA Rules not processed for user `edf9d57de89a4701ba1a5b079d0ad348`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:30.154610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8ff19d7d-ee8a-465a-b062-a4bd2116a3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:30.163985 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1317/2659] 10.222.0.77 () {58 vars in 1018 bytes} [Wed May 11 07:30:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:30.179563 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca0d87-2323-43bd-a143-6adb729b6e59 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:30.181371 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2bca0d87-2323-43bd-a143-6adb729b6e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:30.194333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca0d87-2323-43bd-a143-6adb729b6e59 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:30.198008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2adbf-3328-47e8-b4c9-c11bb555fd5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:30.198655 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2adbf-3328-47e8-b4c9-c11bb555fd5a service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:30.198934 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2adbf-3328-47e8-b4c9-c11bb555fd5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:30.199231 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2adbf-3328-47e8-b4c9-c11bb555fd5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:30.211137 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2adbf-3328-47e8-b4c9-c11bb555fd5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:30.212567 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2adbf-3328-47e8-b4c9-c11bb555fd5a service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:30.223581 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1343/2660] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:30:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:30:32.456011 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b34fb0-dfd0-4899-8f00-c56da629d8fb None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:32.456498 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b34fb0-dfd0-4899-8f00-c56da629d8fb None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:32.456498 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b34fb0-dfd0-4899-8f00-c56da629d8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:32.478639 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-01b34fb0-dfd0-4899-8f00-c56da629d8fb None None] MFA Rules not processed for user `99cbf80fc74c4183a6eed3e97f7196f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:32.479912 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-01b34fb0-dfd0-4899-8f00-c56da629d8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:32.537076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1318/2661] 10.222.0.77 () {58 vars in 1009 bytes} [Wed May 11 07:30:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:32.549353 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2adbf-3328-47e8-b4c9-c11bb555fd5a service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:32.550845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2af2adbf-3328-47e8-b4c9-c11bb555fd5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:32.618609 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2adbf-3328-47e8-b4c9-c11bb555fd5a service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:32.624268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf898f-75cc-4943-a7a6-4492085455f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f726f58d30734be7abf15400bff89533', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:32.624923 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf898f-75cc-4943-a7a6-4492085455f3 service swift] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:32.625201 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf898f-75cc-4943-a7a6-4492085455f3 service swift] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:32.625477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf898f-75cc-4943-a7a6-4492085455f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:32.633583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf898f-75cc-4943-a7a6-4492085455f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:32.635222 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf898f-75cc-4943-a7a6-4492085455f3 service swift] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:32.643584 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1344/2662] 10.222.0.77 () {60 vars in 1384 bytes} [Wed May 11 07:30:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:30:55.720820 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b34fb0-dfd0-4899-8f00-c56da629d8fb None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:55.788174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b34fb0-dfd0-4899-8f00-c56da629d8fb None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:55.793047 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730ded3-0686-4c29-93f1-827ef484810a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:55.793940 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730ded3-0686-4c29-93f1-827ef484810a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:55.794214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730ded3-0686-4c29-93f1-827ef484810a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:55.794483 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730ded3-0686-4c29-93f1-827ef484810a admin admin] PATH_INFO: `/v3/users/862435be6bf14787ba280a4b437cd387` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:55.795753 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730ded3-0686-4c29-93f1-827ef484810a admin admin] RBAC: Authorizing `identity:delete_user(user_id=862435be6bf14787ba280a4b437cd387)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:55.797737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730ded3-0686-4c29-93f1-827ef484810a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:55.845620 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9730ded3-0686-4c29-93f1-827ef484810a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '862435be6bf14787ba280a4b437cd387'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:55.857434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9730ded3-0686-4c29-93f1-827ef484810a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '862435be6bf14787ba280a4b437cd387'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:55.858158 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9730ded3-0686-4c29-93f1-827ef484810a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '862435be6bf14787ba280a4b437cd387'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:55.858805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9730ded3-0686-4c29-93f1-827ef484810a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '862435be6bf14787ba280a4b437cd387'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:55.867653 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9730ded3-0686-4c29-93f1-827ef484810a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '862435be6bf14787ba280a4b437cd387'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:55.880991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1319/2663] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:30:55 2022] DELETE /identity/v3/users/862435be6bf14787ba280a4b437cd387 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:30:55.885595 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb7af9-26a6-4bbb-9b98-c90c64c05444 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:55.886108 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb7af9-26a6-4bbb-9b98-c90c64c05444 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:55.886218 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb7af9-26a6-4bbb-9b98-c90c64c05444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:55.906363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d0bb7af9-26a6-4bbb-9b98-c90c64c05444 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:55.908469 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d0bb7af9-26a6-4bbb-9b98-c90c64c05444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:55.973131 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1345/2664] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:30:55.982916 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730ded3-0686-4c29-93f1-827ef484810a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:55.984452 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9730ded3-0686-4c29-93f1-827ef484810a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:56.046098 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730ded3-0686-4c29-93f1-827ef484810a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:56.049863 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267300ec-f552-410f-b938-d40f2d848896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:56.050515 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267300ec-f552-410f-b938-d40f2d848896 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:56.050796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267300ec-f552-410f-b938-d40f2d848896 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:56.051934 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267300ec-f552-410f-b938-d40f2d848896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:56.062081 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267300ec-f552-410f-b938-d40f2d848896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:56.063616 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267300ec-f552-410f-b938-d40f2d848896 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:56.073610 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1320/2665] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:30:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:30:56.429141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb7af9-26a6-4bbb-9b98-c90c64c05444 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:56.430618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d0bb7af9-26a6-4bbb-9b98-c90c64c05444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:56.446079 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb7af9-26a6-4bbb-9b98-c90c64c05444 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:56.452539 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc91238-711b-46a8-b1f9-ecb24c467d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:56.453409 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc91238-711b-46a8-b1f9-ecb24c467d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:56.453687 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc91238-711b-46a8-b1f9-ecb24c467d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:56.454020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc91238-711b-46a8-b1f9-ecb24c467d92 admin admin] PATH_INFO: `/v3/projects/c48996974ea04b11abdda1a35990d20c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:56.455423 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc91238-711b-46a8-b1f9-ecb24c467d92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c48996974ea04b11abdda1a35990d20c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:56.457327 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc91238-711b-46a8-b1f9-ecb24c467d92 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:56.507512 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1cc91238-711b-46a8-b1f9-ecb24c467d92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48996974ea04b11abdda1a35990d20c', 'request_id': 'req-1cc91238-711b-46a8-b1f9-ecb24c467d92'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:56.513772 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1cc91238-711b-46a8-b1f9-ecb24c467d92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48996974ea04b11abdda1a35990d20c', 'request_id': 'req-1cc91238-711b-46a8-b1f9-ecb24c467d92'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:56.521731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1cc91238-711b-46a8-b1f9-ecb24c467d92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48996974ea04b11abdda1a35990d20c', 'request_id': 'req-1cc91238-711b-46a8-b1f9-ecb24c467d92'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:56.531909 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1cc91238-711b-46a8-b1f9-ecb24c467d92 admin admin] The token cache is being invalidate because project c48996974ea04b11abdda1a35990d20c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:30:56.532326 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1cc91238-711b-46a8-b1f9-ecb24c467d92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:56.533074 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1cc91238-711b-46a8-b1f9-ecb24c467d92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:30:56.534837 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1346/2666] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:30:56 2022] DELETE /identity/v3/projects/c48996974ea04b11abdda1a35990d20c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:30:56.540051 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163db38d-8368-4b78-853b-e3085d41d1a7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:56.540336 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163db38d-8368-4b78-853b-e3085d41d1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:56.540607 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163db38d-8368-4b78-853b-e3085d41d1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:56.559498 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-163db38d-8368-4b78-853b-e3085d41d1a7 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:56.560715 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-163db38d-8368-4b78-853b-e3085d41d1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:56.620159 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1321/2667] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:56.633139 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1574b11-c800-4dd2-8311-54e8f76c9167 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:56.633503 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1574b11-c800-4dd2-8311-54e8f76c9167 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:56.633782 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1574b11-c800-4dd2-8311-54e8f76c9167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:56.657300 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d1574b11-c800-4dd2-8311-54e8f76c9167 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:56.658592 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d1574b11-c800-4dd2-8311-54e8f76c9167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:56.667260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1347/2668] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:30:56.671566 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163db38d-8368-4b78-853b-e3085d41d1a7 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:56.682080 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163db38d-8368-4b78-853b-e3085d41d1a7 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:56.686816 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0fbef-7da7-447e-a873-8134a56e4be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:56.687517 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0fbef-7da7-447e-a873-8134a56e4be3 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:56.687798 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0fbef-7da7-447e-a873-8134a56e4be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:56.688071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0fbef-7da7-447e-a873-8134a56e4be3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:56.688898 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0fbef-7da7-447e-a873-8134a56e4be3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:30:56.689200 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0fbef-7da7-447e-a873-8134a56e4be3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:56.690798 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0fbef-7da7-447e-a873-8134a56e4be3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:56.702692 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1322/2669] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 07:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:30:56.707228 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1574b11-c800-4dd2-8311-54e8f76c9167 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:56.716821 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1574b11-c800-4dd2-8311-54e8f76c9167 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:56.721754 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569439d1-d53e-4869-b687-542f8e1095da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:56.722410 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569439d1-d53e-4869-b687-542f8e1095da admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:56.722687 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569439d1-d53e-4869-b687-542f8e1095da admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:56.723010 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569439d1-d53e-4869-b687-542f8e1095da admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:56.723692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569439d1-d53e-4869-b687-542f8e1095da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:56.725594 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569439d1-d53e-4869-b687-542f8e1095da admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:56.753103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1348/2670] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:30:56 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:30:56.757268 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0fbef-7da7-447e-a873-8134a56e4be3 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:56.768293 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0fbef-7da7-447e-a873-8134a56e4be3 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:56.825330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea080ce-2128-4bb0-8a40-c99ddc6d74fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:56.826048 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea080ce-2128-4bb0-8a40-c99ddc6d74fb admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:56.826356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea080ce-2128-4bb0-8a40-c99ddc6d74fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:56.826630 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea080ce-2128-4bb0-8a40-c99ddc6d74fb admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:56.827524 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea080ce-2128-4bb0-8a40-c99ddc6d74fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:56.829548 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea080ce-2128-4bb0-8a40-c99ddc6d74fb admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:56.850667 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1323/2671] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:30:56 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:30:56.854726 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569439d1-d53e-4869-b687-542f8e1095da admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:56.865904 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569439d1-d53e-4869-b687-542f8e1095da admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:56.870604 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80c323-9ace-44f0-b8dc-1d973b2cebcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:56.871338 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80c323-9ace-44f0-b8dc-1d973b2cebcf admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:56.871623 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80c323-9ace-44f0-b8dc-1d973b2cebcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:56.871951 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80c323-9ace-44f0-b8dc-1d973b2cebcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:56.872617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80c323-9ace-44f0-b8dc-1d973b2cebcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:56.874274 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80c323-9ace-44f0-b8dc-1d973b2cebcf admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:56.885412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1349/2672] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:30:56.889449 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea080ce-2128-4bb0-8a40-c99ddc6d74fb admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:56.900053 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea080ce-2128-4bb0-8a40-c99ddc6d74fb admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:56.905150 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a9933-e625-4cc2-b64b-6565a41fdc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:56.905812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a9933-e625-4cc2-b64b-6565a41fdc79 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:56.906092 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a9933-e625-4cc2-b64b-6565a41fdc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:56.906377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a9933-e625-4cc2-b64b-6565a41fdc79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:56.907184 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a9933-e625-4cc2-b64b-6565a41fdc79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:56.908779 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a9933-e625-4cc2-b64b-6565a41fdc79 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:56.919196 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1324/2673] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:30:56.923235 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80c323-9ace-44f0-b8dc-1d973b2cebcf admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:56.933415 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80c323-9ace-44f0-b8dc-1d973b2cebcf admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:56.940314 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f9290-1f34-40de-b2f9-a36b9c2d3c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:56.941411 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f9290-1f34-40de-b2f9-a36b9c2d3c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:56.941809 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f9290-1f34-40de-b2f9-a36b9c2d3c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:56.942140 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f9290-1f34-40de-b2f9-a36b9c2d3c51 admin admin] PATH_INFO: `/v3/projects/7048ea382df44fd4ad63835572d3bdba/users/cba75fd033534325a8a1c025cc849190/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:56.957834 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f9290-1f34-40de-b2f9-a36b9c2d3c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7048ea382df44fd4ad63835572d3bdba, user_id=cba75fd033534325a8a1c025cc849190, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:56.960513 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f9290-1f34-40de-b2f9-a36b9c2d3c51 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:56.978345 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1350/2674] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:30:56 2022] PUT /identity/v3/projects/7048ea382df44fd4ad63835572d3bdba/users/cba75fd033534325a8a1c025cc849190/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:30:56.988902 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aadcaf-8dca-4b2c-b55b-8332372dbb90 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:56.989204 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aadcaf-8dca-4b2c-b55b-8332372dbb90 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:56.989473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aadcaf-8dca-4b2c-b55b-8332372dbb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:57.015871 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a3aadcaf-8dca-4b2c-b55b-8332372dbb90 None None] MFA Rules not processed for user `cba75fd033534325a8a1c025cc849190`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:57.017118 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a3aadcaf-8dca-4b2c-b55b-8332372dbb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:57.080445 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1325/2675] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:30:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:57.091342 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f9290-1f34-40de-b2f9-a36b9c2d3c51 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:57.093341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ac8f9290-1f34-40de-b2f9-a36b9c2d3c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:57.150504 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f9290-1f34-40de-b2f9-a36b9c2d3c51 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:57.154445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c490f-0b32-4381-a1a8-6f8a0201f7a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:57.155185 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c490f-0b32-4381-a1a8-6f8a0201f7a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:57.155496 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c490f-0b32-4381-a1a8-6f8a0201f7a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:57.155773 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c490f-0b32-4381-a1a8-6f8a0201f7a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:57.164745 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c490f-0b32-4381-a1a8-6f8a0201f7a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:57.166206 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c490f-0b32-4381-a1a8-6f8a0201f7a2 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:57.177138 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1351/2676] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:30:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:00.245789 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aadcaf-8dca-4b2c-b55b-8332372dbb90 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:00.317623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aadcaf-8dca-4b2c-b55b-8332372dbb90 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:00.322661 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d940de-f09a-4d0c-8988-e98529cf6137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:00.323576 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d940de-f09a-4d0c-8988-e98529cf6137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:00.323856 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d940de-f09a-4d0c-8988-e98529cf6137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:00.324130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d940de-f09a-4d0c-8988-e98529cf6137 admin admin] PATH_INFO: `/v3/users/cba75fd033534325a8a1c025cc849190` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:00.325375 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d940de-f09a-4d0c-8988-e98529cf6137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cba75fd033534325a8a1c025cc849190)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:00.327626 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d940de-f09a-4d0c-8988-e98529cf6137 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:00.382329 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-44d940de-f09a-4d0c-8988-e98529cf6137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cba75fd033534325a8a1c025cc849190'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:31:00.395914 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-44d940de-f09a-4d0c-8988-e98529cf6137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cba75fd033534325a8a1c025cc849190'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:31:00.396578 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-44d940de-f09a-4d0c-8988-e98529cf6137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cba75fd033534325a8a1c025cc849190'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:31:00.397216 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-44d940de-f09a-4d0c-8988-e98529cf6137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cba75fd033534325a8a1c025cc849190'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:31:00.408441 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-44d940de-f09a-4d0c-8988-e98529cf6137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cba75fd033534325a8a1c025cc849190'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:31:00.421114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1326/2677] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:31:00 2022] DELETE /identity/v3/users/cba75fd033534325a8a1c025cc849190 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:31:00.425971 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de3cc4-edfa-4cc5-8d16-84eab9c7e458 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:00.426480 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de3cc4-edfa-4cc5-8d16-84eab9c7e458 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:00.426572 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de3cc4-edfa-4cc5-8d16-84eab9c7e458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:00.446321 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-28de3cc4-edfa-4cc5-8d16-84eab9c7e458 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:00.447595 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-28de3cc4-edfa-4cc5-8d16-84eab9c7e458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:00.506163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1352/2678] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:00.516072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d940de-f09a-4d0c-8988-e98529cf6137 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:00.518016 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-44d940de-f09a-4d0c-8988-e98529cf6137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:00.575947 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d940de-f09a-4d0c-8988-e98529cf6137 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:00.580140 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ce60d-90a0-4127-95a0-787f206408dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:00.580814 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ce60d-90a0-4127-95a0-787f206408dd service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:00.581098 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ce60d-90a0-4127-95a0-787f206408dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:00.581364 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ce60d-90a0-4127-95a0-787f206408dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:00.591221 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ce60d-90a0-4127-95a0-787f206408dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:00.592652 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ce60d-90a0-4127-95a0-787f206408dd service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:00.602103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1327/2679] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:00.959521 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de3cc4-edfa-4cc5-8d16-84eab9c7e458 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:00.961084 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-28de3cc4-edfa-4cc5-8d16-84eab9c7e458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:00.976033 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de3cc4-edfa-4cc5-8d16-84eab9c7e458 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:00.981580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633ea17-3d1c-4c19-aacf-1dc9f727b643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:00.992172 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633ea17-3d1c-4c19-aacf-1dc9f727b643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:00.992459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633ea17-3d1c-4c19-aacf-1dc9f727b643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:00.992737 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633ea17-3d1c-4c19-aacf-1dc9f727b643 admin admin] PATH_INFO: `/v3/projects/7048ea382df44fd4ad63835572d3bdba` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:00.994216 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633ea17-3d1c-4c19-aacf-1dc9f727b643 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7048ea382df44fd4ad63835572d3bdba)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:00.996420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633ea17-3d1c-4c19-aacf-1dc9f727b643 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:01.044431 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c633ea17-3d1c-4c19-aacf-1dc9f727b643 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7048ea382df44fd4ad63835572d3bdba', 'request_id': 'req-c633ea17-3d1c-4c19-aacf-1dc9f727b643'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:31:01.050820 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c633ea17-3d1c-4c19-aacf-1dc9f727b643 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7048ea382df44fd4ad63835572d3bdba', 'request_id': 'req-c633ea17-3d1c-4c19-aacf-1dc9f727b643'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:31:01.060194 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c633ea17-3d1c-4c19-aacf-1dc9f727b643 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7048ea382df44fd4ad63835572d3bdba', 'request_id': 'req-c633ea17-3d1c-4c19-aacf-1dc9f727b643'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:31:01.071565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c633ea17-3d1c-4c19-aacf-1dc9f727b643 admin admin] The token cache is being invalidate because project 7048ea382df44fd4ad63835572d3bdba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:31:01.071854 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c633ea17-3d1c-4c19-aacf-1dc9f727b643 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:31:01.072601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c633ea17-3d1c-4c19-aacf-1dc9f727b643 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:31:01.074288 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1353/2680] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:31:00 2022] DELETE /identity/v3/projects/7048ea382df44fd4ad63835572d3bdba => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:31:08.556232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46d4b6-a2e8-445c-977d-55e78cf210a4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:08.556688 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46d4b6-a2e8-445c-977d-55e78cf210a4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:08.556786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46d4b6-a2e8-445c-977d-55e78cf210a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:08.575017 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2d46d4b6-a2e8-445c-977d-55e78cf210a4 None None] MFA Rules not processed for user `99cbf80fc74c4183a6eed3e97f7196f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:08.576298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2d46d4b6-a2e8-445c-977d-55e78cf210a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:08.633815 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1328/2681] 10.222.0.77 () {58 vars in 967 bytes} [Wed May 11 07:31:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:08.658177 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633ea17-3d1c-4c19-aacf-1dc9f727b643 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:08.659748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c633ea17-3d1c-4c19-aacf-1dc9f727b643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:08.741187 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633ea17-3d1c-4c19-aacf-1dc9f727b643 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:08.747102 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec4733-5893-42cb-9eda-e183387f807d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f726f58d30734be7abf15400bff89533', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:08.747752 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec4733-5893-42cb-9eda-e183387f807d service swift] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:08.748035 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec4733-5893-42cb-9eda-e183387f807d service swift] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:08.748308 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec4733-5893-42cb-9eda-e183387f807d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:08.756801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec4733-5893-42cb-9eda-e183387f807d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:08.758382 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec4733-5893-42cb-9eda-e183387f807d service swift] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:08.766484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1354/2682] 10.222.0.77 () {60 vars in 1384 bytes} [Wed May 11 07:31:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:31:28.229555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46d4b6-a2e8-445c-977d-55e78cf210a4 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:28.231303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2d46d4b6-a2e8-445c-977d-55e78cf210a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:28.314627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46d4b6-a2e8-445c-977d-55e78cf210a4 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:28.319143 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2243f60-9294-41a1-9780-ff9d24a24385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:28.319804 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2243f60-9294-41a1-9780-ff9d24a24385 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:28.320081 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2243f60-9294-41a1-9780-ff9d24a24385 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:28.320351 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2243f60-9294-41a1-9780-ff9d24a24385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:28.322452 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d2243f60-9294-41a1-9780-ff9d24a24385 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:28.332679 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2243f60-9294-41a1-9780-ff9d24a24385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:28.334067 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2243f60-9294-41a1-9780-ff9d24a24385 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:28.342128 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1329/2683] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:31:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:06.689716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec4733-5893-42cb-9eda-e183387f807d service swift] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:06.699081 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec4733-5893-42cb-9eda-e183387f807d service swift] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:06.702757 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3476a-1585-4404-bc4a-37cf59cdfe52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:06.703431 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3476a-1585-4404-bc4a-37cf59cdfe52 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:06.703743 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3476a-1585-4404-bc4a-37cf59cdfe52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:06.704022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3476a-1585-4404-bc4a-37cf59cdfe52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:06.705793 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4cb3476a-1585-4404-bc4a-37cf59cdfe52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:06.774435 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3476a-1585-4404-bc4a-37cf59cdfe52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:06.776074 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3476a-1585-4404-bc4a-37cf59cdfe52 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:06.787020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1355/2684] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:32:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:07.978547 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2243f60-9294-41a1-9780-ff9d24a24385 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:07.980744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d2243f60-9294-41a1-9780-ff9d24a24385 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:07.996332 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2243f60-9294-41a1-9780-ff9d24a24385 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:08.001269 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075bbbf-b082-4429-83c3-601c63f1be87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:08.001902 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075bbbf-b082-4429-83c3-601c63f1be87 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:08.002178 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075bbbf-b082-4429-83c3-601c63f1be87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:08.002445 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075bbbf-b082-4429-83c3-601c63f1be87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:08.004725 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2075bbbf-b082-4429-83c3-601c63f1be87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:08.018834 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075bbbf-b082-4429-83c3-601c63f1be87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:08.020274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075bbbf-b082-4429-83c3-601c63f1be87 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:08.031125 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1330/2685] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:32:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:09.406581 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3476a-1585-4404-bc4a-37cf59cdfe52 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:09.408057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4cb3476a-1585-4404-bc4a-37cf59cdfe52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:09.424379 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3476a-1585-4404-bc4a-37cf59cdfe52 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:09.430197 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d38d01-dae1-4d72-a6de-808e42152876 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:09.430870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d38d01-dae1-4d72-a6de-808e42152876 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:09.431186 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d38d01-dae1-4d72-a6de-808e42152876 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:09.431777 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d38d01-dae1-4d72-a6de-808e42152876 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:09.433271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-62d38d01-dae1-4d72-a6de-808e42152876 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:09.447606 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d38d01-dae1-4d72-a6de-808e42152876 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:09.449415 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d38d01-dae1-4d72-a6de-808e42152876 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:09.471827 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1356/2686] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:32:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:13.396083 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075bbbf-b082-4429-83c3-601c63f1be87 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:13.405245 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075bbbf-b082-4429-83c3-601c63f1be87 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:13.409847 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f63587-7ed0-4785-83f6-83d2bb5654b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:13.410488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f63587-7ed0-4785-83f6-83d2bb5654b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:13.410768 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f63587-7ed0-4785-83f6-83d2bb5654b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:13.411072 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f63587-7ed0-4785-83f6-83d2bb5654b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:13.413369 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-35f63587-7ed0-4785-83f6-83d2bb5654b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:13.477488 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f63587-7ed0-4785-83f6-83d2bb5654b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:13.479008 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f63587-7ed0-4785-83f6-83d2bb5654b8 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:13.488672 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1331/2687] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:32:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:16.714789 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d38d01-dae1-4d72-a6de-808e42152876 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:16.716276 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-62d38d01-dae1-4d72-a6de-808e42152876 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:16.731112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d38d01-dae1-4d72-a6de-808e42152876 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:16.735864 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff9059-06e5-4524-b980-679037a4f18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:16.736927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff9059-06e5-4524-b980-679037a4f18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:16.737390 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff9059-06e5-4524-b980-679037a4f18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:16.737662 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff9059-06e5-4524-b980-679037a4f18f admin admin] PATH_INFO: `/v3/users/17f57a9a926b4954acb4c002367474ec` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:16.738866 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff9059-06e5-4524-b980-679037a4f18f admin admin] RBAC: Authorizing `identity:delete_user(user_id=17f57a9a926b4954acb4c002367474ec)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:16.740844 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff9059-06e5-4524-b980-679037a4f18f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:16.789595 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a1ff9059-06e5-4524-b980-679037a4f18f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17f57a9a926b4954acb4c002367474ec'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:16.801123 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a1ff9059-06e5-4524-b980-679037a4f18f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17f57a9a926b4954acb4c002367474ec'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:16.801818 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a1ff9059-06e5-4524-b980-679037a4f18f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17f57a9a926b4954acb4c002367474ec'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:16.802464 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a1ff9059-06e5-4524-b980-679037a4f18f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17f57a9a926b4954acb4c002367474ec'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:16.810890 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a1ff9059-06e5-4524-b980-679037a4f18f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17f57a9a926b4954acb4c002367474ec'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:16.822593 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1357/2688] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:32:16 2022] DELETE /identity/v3/users/17f57a9a926b4954acb4c002367474ec => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:32:17.263578 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f63587-7ed0-4785-83f6-83d2bb5654b8 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:17.274292 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f63587-7ed0-4785-83f6-83d2bb5654b8 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:17.335112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c9970-5442-4d9e-96d5-0d67b23f3b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:17.336003 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c9970-5442-4d9e-96d5-0d67b23f3b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:17.336285 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c9970-5442-4d9e-96d5-0d67b23f3b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:17.336557 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c9970-5442-4d9e-96d5-0d67b23f3b8e admin admin] PATH_INFO: `/v3/projects/77fc86227d494376b6634da64720bbbc` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:17.337869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c9970-5442-4d9e-96d5-0d67b23f3b8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=77fc86227d494376b6634da64720bbbc)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:17.339844 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c9970-5442-4d9e-96d5-0d67b23f3b8e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:17.386377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b17c9970-5442-4d9e-96d5-0d67b23f3b8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77fc86227d494376b6634da64720bbbc', 'request_id': 'req-b17c9970-5442-4d9e-96d5-0d67b23f3b8e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:17.392568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b17c9970-5442-4d9e-96d5-0d67b23f3b8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77fc86227d494376b6634da64720bbbc', 'request_id': 'req-b17c9970-5442-4d9e-96d5-0d67b23f3b8e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:17.401565 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b17c9970-5442-4d9e-96d5-0d67b23f3b8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77fc86227d494376b6634da64720bbbc', 'request_id': 'req-b17c9970-5442-4d9e-96d5-0d67b23f3b8e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:17.411807 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b17c9970-5442-4d9e-96d5-0d67b23f3b8e admin admin] The token cache is being invalidate because project 77fc86227d494376b6634da64720bbbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:32:17.412085 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b17c9970-5442-4d9e-96d5-0d67b23f3b8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:17.412716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b17c9970-5442-4d9e-96d5-0d67b23f3b8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:17.414231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1332/2689] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:32:17 2022] DELETE /identity/v3/projects/77fc86227d494376b6634da64720bbbc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:32:17.419433 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d06c20-64db-4fc7-bd3f-0102576788c0 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:17.419726 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d06c20-64db-4fc7-bd3f-0102576788c0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:17.420008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d06c20-64db-4fc7-bd3f-0102576788c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:17.437650 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-18d06c20-64db-4fc7-bd3f-0102576788c0 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:17.438843 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-18d06c20-64db-4fc7-bd3f-0102576788c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:17.496134 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1358/2690] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:32:17.504302 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e6684-e989-4224-9679-4d276bd08e34 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:17.504587 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e6684-e989-4224-9679-4d276bd08e34 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:17.504864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e6684-e989-4224-9679-4d276bd08e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:17.524990 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-806e6684-e989-4224-9679-4d276bd08e34 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:17.526277 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-806e6684-e989-4224-9679-4d276bd08e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:17.537459 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1333/2691] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:17.541665 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d06c20-64db-4fc7-bd3f-0102576788c0 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:17.552541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d06c20-64db-4fc7-bd3f-0102576788c0 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:17.562034 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc491728-6704-4e2c-b042-1337963e97e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:17.562686 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc491728-6704-4e2c-b042-1337963e97e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:17.562987 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc491728-6704-4e2c-b042-1337963e97e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:17.563271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc491728-6704-4e2c-b042-1337963e97e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:17.564007 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc491728-6704-4e2c-b042-1337963e97e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:32:17.564337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc491728-6704-4e2c-b042-1337963e97e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:17.565974 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc491728-6704-4e2c-b042-1337963e97e0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:17.580908 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1359/2692] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 07:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:32:17.587577 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e6684-e989-4224-9679-4d276bd08e34 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:17.596953 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e6684-e989-4224-9679-4d276bd08e34 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:17.603661 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063baf8-310f-4724-8cf4-e8602d6efe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:17.604479 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063baf8-310f-4724-8cf4-e8602d6efe74 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:17.604757 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063baf8-310f-4724-8cf4-e8602d6efe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:17.605026 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063baf8-310f-4724-8cf4-e8602d6efe74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:17.605747 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063baf8-310f-4724-8cf4-e8602d6efe74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:17.607693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063baf8-310f-4724-8cf4-e8602d6efe74 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:17.640079 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1334/2693] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:32:17 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:32:17.647017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc491728-6704-4e2c-b042-1337963e97e0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:17.659080 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc491728-6704-4e2c-b042-1337963e97e0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:17.721131 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef2551-654d-48ba-844c-e7f9497db634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:17.721774 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef2551-654d-48ba-844c-e7f9497db634 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:17.722059 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef2551-654d-48ba-844c-e7f9497db634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:17.722333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef2551-654d-48ba-844c-e7f9497db634 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:17.723108 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef2551-654d-48ba-844c-e7f9497db634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:17.725051 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef2551-654d-48ba-844c-e7f9497db634 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:17.746031 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1360/2694] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:32:17 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:32:17.750132 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063baf8-310f-4724-8cf4-e8602d6efe74 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:17.761292 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063baf8-310f-4724-8cf4-e8602d6efe74 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:17.767228 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929453db-6128-41ab-975d-e3fd338d06ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:17.768281 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929453db-6128-41ab-975d-e3fd338d06ab admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:17.768560 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929453db-6128-41ab-975d-e3fd338d06ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:17.768827 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929453db-6128-41ab-975d-e3fd338d06ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:17.769550 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929453db-6128-41ab-975d-e3fd338d06ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:17.771176 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929453db-6128-41ab-975d-e3fd338d06ab admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:17.781616 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1335/2695] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:32:17.785651 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef2551-654d-48ba-844c-e7f9497db634 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:17.796005 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef2551-654d-48ba-844c-e7f9497db634 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:17.801615 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8b883-2503-41de-8418-1ad446623e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:17.802278 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8b883-2503-41de-8418-1ad446623e06 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:17.802574 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8b883-2503-41de-8418-1ad446623e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:17.802846 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8b883-2503-41de-8418-1ad446623e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:17.803614 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8b883-2503-41de-8418-1ad446623e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:17.805228 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8b883-2503-41de-8418-1ad446623e06 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:17.815267 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1361/2696] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:32:17.819880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929453db-6128-41ab-975d-e3fd338d06ab admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:17.830802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929453db-6128-41ab-975d-e3fd338d06ab admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:17.836676 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f86e95-8901-43e3-9f79-60a411cc47a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:17.837546 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f86e95-8901-43e3-9f79-60a411cc47a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:17.837824 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f86e95-8901-43e3-9f79-60a411cc47a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:17.838098 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f86e95-8901-43e3-9f79-60a411cc47a0 admin admin] PATH_INFO: `/v3/projects/1721f3a9039d4499bf533b780a8edef6/users/ba04295e2d494fc3a145b8ff94df90de/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:17.853188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f86e95-8901-43e3-9f79-60a411cc47a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1721f3a9039d4499bf533b780a8edef6, user_id=ba04295e2d494fc3a145b8ff94df90de, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:17.855871 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f86e95-8901-43e3-9f79-60a411cc47a0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:17.872396 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1336/2697] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:32:17 2022] PUT /identity/v3/projects/1721f3a9039d4499bf533b780a8edef6/users/ba04295e2d494fc3a145b8ff94df90de/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:32:17.883225 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a018be-27fd-467f-bc0e-3d078630a4a0 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:17.883517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a018be-27fd-467f-bc0e-3d078630a4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:17.883797 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a018be-27fd-467f-bc0e-3d078630a4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:17.912897 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-61a018be-27fd-467f-bc0e-3d078630a4a0 None None] MFA Rules not processed for user `ba04295e2d494fc3a145b8ff94df90de`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:17.914141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-61a018be-27fd-467f-bc0e-3d078630a4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:17.990426 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1362/2698] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:32:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:32:18.002024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f86e95-8901-43e3-9f79-60a411cc47a0 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:18.004025 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-98f86e95-8901-43e3-9f79-60a411cc47a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:18.080372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f86e95-8901-43e3-9f79-60a411cc47a0 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:18.086953 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce159132-4d13-4037-94a9-aae938e10a53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:18.087624 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce159132-4d13-4037-94a9-aae938e10a53 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:18.087913 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce159132-4d13-4037-94a9-aae938e10a53 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:18.088191 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce159132-4d13-4037-94a9-aae938e10a53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:18.096395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce159132-4d13-4037-94a9-aae938e10a53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:18.097986 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce159132-4d13-4037-94a9-aae938e10a53 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:18.107434 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1337/2699] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:32:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:27.560001 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a018be-27fd-467f-bc0e-3d078630a4a0 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:27.622703 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a018be-27fd-467f-bc0e-3d078630a4a0 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:27.627717 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86d321-792c-4a19-af40-ad7c06e014d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:27.628599 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86d321-792c-4a19-af40-ad7c06e014d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:27.628881 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86d321-792c-4a19-af40-ad7c06e014d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:27.629157 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86d321-792c-4a19-af40-ad7c06e014d6 admin admin] PATH_INFO: `/v3/users/ba04295e2d494fc3a145b8ff94df90de` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:27.630481 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86d321-792c-4a19-af40-ad7c06e014d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba04295e2d494fc3a145b8ff94df90de)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:27.632452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86d321-792c-4a19-af40-ad7c06e014d6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:27.682740 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ef86d321-792c-4a19-af40-ad7c06e014d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba04295e2d494fc3a145b8ff94df90de'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:27.695144 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ef86d321-792c-4a19-af40-ad7c06e014d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba04295e2d494fc3a145b8ff94df90de'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:27.696029 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ef86d321-792c-4a19-af40-ad7c06e014d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba04295e2d494fc3a145b8ff94df90de'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:27.696948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ef86d321-792c-4a19-af40-ad7c06e014d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba04295e2d494fc3a145b8ff94df90de'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:27.706883 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ef86d321-792c-4a19-af40-ad7c06e014d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba04295e2d494fc3a145b8ff94df90de'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:27.718931 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1363/2700] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:32:27 2022] DELETE /identity/v3/users/ba04295e2d494fc3a145b8ff94df90de => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:32:27.723850 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f384d9-595f-471c-b2fe-f5b3197aad7d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:27.724356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f384d9-595f-471c-b2fe-f5b3197aad7d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:27.724356 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f384d9-595f-471c-b2fe-f5b3197aad7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:27.741623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-52f384d9-595f-471c-b2fe-f5b3197aad7d None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:27.742913 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-52f384d9-595f-471c-b2fe-f5b3197aad7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:27.802735 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1338/2701] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:27.812539 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86d321-792c-4a19-af40-ad7c06e014d6 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:27.814070 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ef86d321-792c-4a19-af40-ad7c06e014d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:27.882152 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86d321-792c-4a19-af40-ad7c06e014d6 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:27.887037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7b7b8-36de-4285-bede-20cb23607ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:27.887726 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7b7b8-36de-4285-bede-20cb23607ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:27.888004 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7b7b8-36de-4285-bede-20cb23607ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:27.888271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7b7b8-36de-4285-bede-20cb23607ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:27.899263 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7b7b8-36de-4285-bede-20cb23607ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:27.900707 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7b7b8-36de-4285-bede-20cb23607ff0 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:27.910340 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1364/2702] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:28.184349 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f384d9-595f-471c-b2fe-f5b3197aad7d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:28.185858 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-52f384d9-595f-471c-b2fe-f5b3197aad7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:28.198568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f384d9-595f-471c-b2fe-f5b3197aad7d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:28.204181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc29ce2-cca5-497f-b8fa-aa039eaf53a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:28.204935 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc29ce2-cca5-497f-b8fa-aa039eaf53a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:28.205206 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc29ce2-cca5-497f-b8fa-aa039eaf53a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:28.205476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc29ce2-cca5-497f-b8fa-aa039eaf53a1 admin admin] PATH_INFO: `/v3/projects/1721f3a9039d4499bf533b780a8edef6` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:28.206771 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc29ce2-cca5-497f-b8fa-aa039eaf53a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1721f3a9039d4499bf533b780a8edef6)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:28.208850 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc29ce2-cca5-497f-b8fa-aa039eaf53a1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:28.257567 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ffc29ce2-cca5-497f-b8fa-aa039eaf53a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1721f3a9039d4499bf533b780a8edef6', 'request_id': 'req-ffc29ce2-cca5-497f-b8fa-aa039eaf53a1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:28.263604 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ffc29ce2-cca5-497f-b8fa-aa039eaf53a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1721f3a9039d4499bf533b780a8edef6', 'request_id': 'req-ffc29ce2-cca5-497f-b8fa-aa039eaf53a1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:28.274155 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ffc29ce2-cca5-497f-b8fa-aa039eaf53a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1721f3a9039d4499bf533b780a8edef6', 'request_id': 'req-ffc29ce2-cca5-497f-b8fa-aa039eaf53a1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:28.285157 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ffc29ce2-cca5-497f-b8fa-aa039eaf53a1 admin admin] The token cache is being invalidate because project 1721f3a9039d4499bf533b780a8edef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:32:28.285448 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ffc29ce2-cca5-497f-b8fa-aa039eaf53a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:28.286097 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ffc29ce2-cca5-497f-b8fa-aa039eaf53a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:28.287729 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1339/2703] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:32:28 2022] DELETE /identity/v3/projects/1721f3a9039d4499bf533b780a8edef6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:32:28.292775 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4a20d-ad7d-4c6f-b3ac-0f94c436b1f0 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:28.293115 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4a20d-ad7d-4c6f-b3ac-0f94c436b1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:28.293397 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4a20d-ad7d-4c6f-b3ac-0f94c436b1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:28.311819 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-71d4a20d-ad7d-4c6f-b3ac-0f94c436b1f0 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:28.313036 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-71d4a20d-ad7d-4c6f-b3ac-0f94c436b1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:28.374823 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1365/2704] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:28.383217 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd45072-4a44-4eda-8ee1-fc7ece9fe695 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:28.383504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd45072-4a44-4eda-8ee1-fc7ece9fe695 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:28.383876 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd45072-4a44-4eda-8ee1-fc7ece9fe695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:28.403806 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8fd45072-4a44-4eda-8ee1-fc7ece9fe695 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:28.405029 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8fd45072-4a44-4eda-8ee1-fc7ece9fe695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:28.414525 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1340/2705] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:28.419106 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4a20d-ad7d-4c6f-b3ac-0f94c436b1f0 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:28.429128 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4a20d-ad7d-4c6f-b3ac-0f94c436b1f0 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:28.434691 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9dbb7-074c-4fe1-aa6c-1d8407afddc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:28.435438 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9dbb7-074c-4fe1-aa6c-1d8407afddc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:28.435717 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9dbb7-074c-4fe1-aa6c-1d8407afddc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:28.436003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9dbb7-074c-4fe1-aa6c-1d8407afddc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:28.436725 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9dbb7-074c-4fe1-aa6c-1d8407afddc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:32:28.437058 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9dbb7-074c-4fe1-aa6c-1d8407afddc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:28.438651 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9dbb7-074c-4fe1-aa6c-1d8407afddc2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:28.450538 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1366/2706] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 07:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:32:28.454720 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd45072-4a44-4eda-8ee1-fc7ece9fe695 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:28.464068 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd45072-4a44-4eda-8ee1-fc7ece9fe695 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:28.470144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf5438-1026-4e09-ac02-ea49e77f72eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:28.470800 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf5438-1026-4e09-ac02-ea49e77f72eb admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:28.471133 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf5438-1026-4e09-ac02-ea49e77f72eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:28.471405 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf5438-1026-4e09-ac02-ea49e77f72eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:28.472095 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf5438-1026-4e09-ac02-ea49e77f72eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:28.474050 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf5438-1026-4e09-ac02-ea49e77f72eb admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:28.502234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1341/2707] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:32:28 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:32:28.506337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9dbb7-074c-4fe1-aa6c-1d8407afddc2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:28.516680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9dbb7-074c-4fe1-aa6c-1d8407afddc2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:28.577324 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48682c-b052-44a0-9d3a-b36b27bfb49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:28.578003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48682c-b052-44a0-9d3a-b36b27bfb49a admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:28.578449 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48682c-b052-44a0-9d3a-b36b27bfb49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:28.578846 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48682c-b052-44a0-9d3a-b36b27bfb49a admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:28.579979 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48682c-b052-44a0-9d3a-b36b27bfb49a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:28.582602 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48682c-b052-44a0-9d3a-b36b27bfb49a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:28.610499 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1367/2708] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:32:28 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:32:28.616408 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf5438-1026-4e09-ac02-ea49e77f72eb admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:28.627367 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf5438-1026-4e09-ac02-ea49e77f72eb admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:28.632975 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f1f5d-ee2c-45df-a796-67b48cbfc4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:28.633647 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f1f5d-ee2c-45df-a796-67b48cbfc4ae admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:28.633931 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f1f5d-ee2c-45df-a796-67b48cbfc4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:28.634205 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f1f5d-ee2c-45df-a796-67b48cbfc4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:28.634942 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f1f5d-ee2c-45df-a796-67b48cbfc4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:28.636639 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f1f5d-ee2c-45df-a796-67b48cbfc4ae admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:28.647475 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1342/2709] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:32:28.651591 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48682c-b052-44a0-9d3a-b36b27bfb49a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:28.661690 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48682c-b052-44a0-9d3a-b36b27bfb49a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:28.666998 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec5b27-2b4c-4c2f-bd62-78b3152e78cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:28.667667 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec5b27-2b4c-4c2f-bd62-78b3152e78cf admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:28.667954 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec5b27-2b4c-4c2f-bd62-78b3152e78cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:28.668227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec5b27-2b4c-4c2f-bd62-78b3152e78cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:28.668954 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec5b27-2b4c-4c2f-bd62-78b3152e78cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:28.670610 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec5b27-2b4c-4c2f-bd62-78b3152e78cf admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:28.680924 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1368/2710] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:32:28.685144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f1f5d-ee2c-45df-a796-67b48cbfc4ae admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:28.695646 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f1f5d-ee2c-45df-a796-67b48cbfc4ae admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:28.701247 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df00e0-a804-4706-9af1-f5b1cdfa6018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:28.702122 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df00e0-a804-4706-9af1-f5b1cdfa6018 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:28.702397 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df00e0-a804-4706-9af1-f5b1cdfa6018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:28.702669 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df00e0-a804-4706-9af1-f5b1cdfa6018 admin admin] PATH_INFO: `/v3/projects/83149f3a8eea49668e9529757eb41bef/users/cb997a1285c547ab80d7f8bfa8a2d458/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:28.716913 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df00e0-a804-4706-9af1-f5b1cdfa6018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83149f3a8eea49668e9529757eb41bef, user_id=cb997a1285c547ab80d7f8bfa8a2d458, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:28.719585 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df00e0-a804-4706-9af1-f5b1cdfa6018 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:28.735428 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1343/2711] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:32:28 2022] PUT /identity/v3/projects/83149f3a8eea49668e9529757eb41bef/users/cb997a1285c547ab80d7f8bfa8a2d458/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:32:28.792891 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1177a-127e-4660-8883-64960db6d1c3 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:28.793174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1177a-127e-4660-8883-64960db6d1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:28.793423 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1177a-127e-4660-8883-64960db6d1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:28.819536 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-20e1177a-127e-4660-8883-64960db6d1c3 None None] MFA Rules not processed for user `cb997a1285c547ab80d7f8bfa8a2d458`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:28.820730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-20e1177a-127e-4660-8883-64960db6d1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:28.881380 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1369/2712] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:32:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:28.886261 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df00e0-a804-4706-9af1-f5b1cdfa6018 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:28.960565 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df00e0-a804-4706-9af1-f5b1cdfa6018 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:28.965680 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b70f3-e3f2-4991-973a-3e06b86bf147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:28.966325 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b70f3-e3f2-4991-973a-3e06b86bf147 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:28.966605 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b70f3-e3f2-4991-973a-3e06b86bf147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:28.966880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b70f3-e3f2-4991-973a-3e06b86bf147 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:28.967614 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b70f3-e3f2-4991-973a-3e06b86bf147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:28.969658 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b70f3-e3f2-4991-973a-3e06b86bf147 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:29.009261 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1344/2713] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:32:28 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:32:29.014022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1177a-127e-4660-8883-64960db6d1c3 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:29.025817 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1177a-127e-4660-8883-64960db6d1c3 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:29.085820 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bf0a1-7c03-42a9-8b93-abe41c04bb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:29.086507 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bf0a1-7c03-42a9-8b93-abe41c04bb08 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:29.086790 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bf0a1-7c03-42a9-8b93-abe41c04bb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:29.087106 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bf0a1-7c03-42a9-8b93-abe41c04bb08 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:29.087798 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bf0a1-7c03-42a9-8b93-abe41c04bb08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:29.089741 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bf0a1-7c03-42a9-8b93-abe41c04bb08 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:29.110727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1370/2714] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:32:29 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:32:29.114986 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b70f3-e3f2-4991-973a-3e06b86bf147 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:29.125991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b70f3-e3f2-4991-973a-3e06b86bf147 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:29.131240 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d4d90-f551-4919-9f55-2f4d847679b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:29.131956 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d4d90-f551-4919-9f55-2f4d847679b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:29.132238 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d4d90-f551-4919-9f55-2f4d847679b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:29.132520 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d4d90-f551-4919-9f55-2f4d847679b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:29.133327 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d4d90-f551-4919-9f55-2f4d847679b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:29.134928 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d4d90-f551-4919-9f55-2f4d847679b3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:29.149996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1345/2715] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:32:29.155970 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bf0a1-7c03-42a9-8b93-abe41c04bb08 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:29.170145 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bf0a1-7c03-42a9-8b93-abe41c04bb08 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:29.175502 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7aefc-56cb-40bb-ac18-a9c15466b0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:29.176172 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7aefc-56cb-40bb-ac18-a9c15466b0bd admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:29.176455 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7aefc-56cb-40bb-ac18-a9c15466b0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:29.176733 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7aefc-56cb-40bb-ac18-a9c15466b0bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:29.177470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7aefc-56cb-40bb-ac18-a9c15466b0bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:29.179107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7aefc-56cb-40bb-ac18-a9c15466b0bd admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:29.189534 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1371/2716] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:32:29.193726 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d4d90-f551-4919-9f55-2f4d847679b3 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:29.204098 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d4d90-f551-4919-9f55-2f4d847679b3 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:29.208997 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65f25a-f16e-43ef-89f6-da8b2ac5826f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:29.209887 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65f25a-f16e-43ef-89f6-da8b2ac5826f admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:29.210172 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65f25a-f16e-43ef-89f6-da8b2ac5826f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:29.210448 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65f25a-f16e-43ef-89f6-da8b2ac5826f admin admin] PATH_INFO: `/v3/projects/2a420a2e9770484291776ccba81d300f/users/ef1a8b8e5097493181c430c86fc6efc2/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:29.225230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65f25a-f16e-43ef-89f6-da8b2ac5826f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a420a2e9770484291776ccba81d300f, user_id=ef1a8b8e5097493181c430c86fc6efc2, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:29.227943 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65f25a-f16e-43ef-89f6-da8b2ac5826f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:29.242805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1346/2717] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:32:29 2022] PUT /identity/v3/projects/2a420a2e9770484291776ccba81d300f/users/ef1a8b8e5097493181c430c86fc6efc2/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:32:29.253181 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d5f31-3b69-401d-9a3f-5c7262a1a32c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:29.253481 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d5f31-3b69-401d-9a3f-5c7262a1a32c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:29.253758 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d5f31-3b69-401d-9a3f-5c7262a1a32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:29.281625 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-473d5f31-3b69-401d-9a3f-5c7262a1a32c None None] MFA Rules not processed for user `ef1a8b8e5097493181c430c86fc6efc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:29.282822 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-473d5f31-3b69-401d-9a3f-5c7262a1a32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:29.349989 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1372/2718] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:32:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:29.356274 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65f25a-f16e-43ef-89f6-da8b2ac5826f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:29.429459 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65f25a-f16e-43ef-89f6-da8b2ac5826f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:29.436745 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571853ad-e9ab-489b-b780-f550c6db9969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:29.437407 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571853ad-e9ab-489b-b780-f550c6db9969 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:29.437671 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571853ad-e9ab-489b-b780-f550c6db9969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:29.437959 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571853ad-e9ab-489b-b780-f550c6db9969 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:29.438625 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571853ad-e9ab-489b-b780-f550c6db9969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:29.440611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571853ad-e9ab-489b-b780-f550c6db9969 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:29.471803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1347/2719] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:32:29 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:32:29.476005 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d5f31-3b69-401d-9a3f-5c7262a1a32c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:29.486922 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d5f31-3b69-401d-9a3f-5c7262a1a32c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:29.550195 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931db1a9-ab1e-4b5e-beef-118872e2df04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:29.551211 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931db1a9-ab1e-4b5e-beef-118872e2df04 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:29.551619 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931db1a9-ab1e-4b5e-beef-118872e2df04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:29.552013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931db1a9-ab1e-4b5e-beef-118872e2df04 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:29.553245 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931db1a9-ab1e-4b5e-beef-118872e2df04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:29.555216 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931db1a9-ab1e-4b5e-beef-118872e2df04 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:29.579509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1373/2720] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:32:29 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:32:29.583459 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571853ad-e9ab-489b-b780-f550c6db9969 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:29.593548 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571853ad-e9ab-489b-b780-f550c6db9969 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:29.598516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2022d1-944e-4236-9f82-896573ce6b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:29.599196 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2022d1-944e-4236-9f82-896573ce6b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:29.599477 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2022d1-944e-4236-9f82-896573ce6b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:29.599744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2022d1-944e-4236-9f82-896573ce6b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:29.600543 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2022d1-944e-4236-9f82-896573ce6b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:29.602091 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2022d1-944e-4236-9f82-896573ce6b25 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:29.612484 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1348/2721] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:32:29.616655 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931db1a9-ab1e-4b5e-beef-118872e2df04 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:29.626724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931db1a9-ab1e-4b5e-beef-118872e2df04 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:29.631815 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a4e7c-2f46-406b-ade5-7c780d24e175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:29.632706 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a4e7c-2f46-406b-ade5-7c780d24e175 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:29.633004 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a4e7c-2f46-406b-ade5-7c780d24e175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:29.633304 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a4e7c-2f46-406b-ade5-7c780d24e175 admin admin] PATH_INFO: `/v3/projects/3d419df1cb6b4168afdf7bb844596147/users/12843084d60a4fdba201955a8a707547/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:29.648554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a4e7c-2f46-406b-ade5-7c780d24e175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d419df1cb6b4168afdf7bb844596147, user_id=12843084d60a4fdba201955a8a707547, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:29.651209 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a4e7c-2f46-406b-ade5-7c780d24e175 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:29.666946 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1374/2722] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:32:29 2022] PUT /identity/v3/projects/3d419df1cb6b4168afdf7bb844596147/users/12843084d60a4fdba201955a8a707547/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:32:29.671093 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2022d1-944e-4236-9f82-896573ce6b25 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:29.681535 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2022d1-944e-4236-9f82-896573ce6b25 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:29.737260 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0f753-64b1-4310-85d4-36d8551de1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:29.737903 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0f753-64b1-4310-85d4-36d8551de1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:29.738180 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0f753-64b1-4310-85d4-36d8551de1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:29.738447 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0f753-64b1-4310-85d4-36d8551de1d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:29.739198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0f753-64b1-4310-85d4-36d8551de1d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:29.740793 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0f753-64b1-4310-85d4-36d8551de1d3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:29.751141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1349/2723] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:32:29.756852 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a4e7c-2f46-406b-ade5-7c780d24e175 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:29.768147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a4e7c-2f46-406b-ade5-7c780d24e175 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:29.773182 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590def2c-311d-4fe0-b42f-bed46af4731f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:29.774067 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590def2c-311d-4fe0-b42f-bed46af4731f admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:29.774349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590def2c-311d-4fe0-b42f-bed46af4731f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:29.774620 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590def2c-311d-4fe0-b42f-bed46af4731f admin admin] PATH_INFO: `/v3/projects/3d419df1cb6b4168afdf7bb844596147/users/12843084d60a4fdba201955a8a707547/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:29.776765 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590def2c-311d-4fe0-b42f-bed46af4731f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d419df1cb6b4168afdf7bb844596147, user_id=12843084d60a4fdba201955a8a707547, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:29.779414 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590def2c-311d-4fe0-b42f-bed46af4731f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:29.789977 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1375/2724] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:32:29 2022] PUT /identity/v3/projects/3d419df1cb6b4168afdf7bb844596147/users/12843084d60a4fdba201955a8a707547/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:32:29.801330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043164bd-0653-4ab3-8f5b-5c563b66eaaa None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:29.801619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043164bd-0653-4ab3-8f5b-5c563b66eaaa None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:29.801921 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043164bd-0653-4ab3-8f5b-5c563b66eaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:29.829082 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-043164bd-0653-4ab3-8f5b-5c563b66eaaa None None] MFA Rules not processed for user `12843084d60a4fdba201955a8a707547`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:29.830295 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-043164bd-0653-4ab3-8f5b-5c563b66eaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:29.905923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1350/2725] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:32:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:29.916794 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590def2c-311d-4fe0-b42f-bed46af4731f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:29.918638 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-590def2c-311d-4fe0-b42f-bed46af4731f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:29.980435 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590def2c-311d-4fe0-b42f-bed46af4731f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:29.985269 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dac99d-6799-4d06-8933-27d6c446c311 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:29.985926 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dac99d-6799-4d06-8933-27d6c446c311 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:29.986206 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dac99d-6799-4d06-8933-27d6c446c311 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:29.986462 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dac99d-6799-4d06-8933-27d6c446c311 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:29.996054 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dac99d-6799-4d06-8933-27d6c446c311 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:29.997494 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dac99d-6799-4d06-8933-27d6c446c311 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:30.006951 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1376/2726] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:32:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:30.510463 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043164bd-0653-4ab3-8f5b-5c563b66eaaa None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:30.512151 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-043164bd-0653-4ab3-8f5b-5c563b66eaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:30.525086 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043164bd-0653-4ab3-8f5b-5c563b66eaaa None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:30.529118 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddde16-e05d-4121-8c20-baae024234df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:30.529759 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddde16-e05d-4121-8c20-baae024234df service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:30.530041 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddde16-e05d-4121-8c20-baae024234df service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:30.530308 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddde16-e05d-4121-8c20-baae024234df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:30.588904 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eddde16-e05d-4121-8c20-baae024234df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:30.591577 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eddde16-e05d-4121-8c20-baae024234df service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:30.605275 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1351/2727] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:32:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:34.657979 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dac99d-6799-4d06-8933-27d6c446c311 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:34.666838 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dac99d-6799-4d06-8933-27d6c446c311 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:34.670895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3eeca0-dae1-4396-9c31-31fd93b43984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:34.671562 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3eeca0-dae1-4396-9c31-31fd93b43984 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:34.671842 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3eeca0-dae1-4396-9c31-31fd93b43984 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:34.672117 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3eeca0-dae1-4396-9c31-31fd93b43984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:34.727957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3eeca0-dae1-4396-9c31-31fd93b43984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:34.729409 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3eeca0-dae1-4396-9c31-31fd93b43984 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:34.738533 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1377/2728] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:32:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:36.877760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddde16-e05d-4121-8c20-baae024234df service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:36.957627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddde16-e05d-4121-8c20-baae024234df service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:36.967174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40651cb-0570-4e60-b2ce-afcbd782918e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:36.968115 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40651cb-0570-4e60-b2ce-afcbd782918e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:36.968393 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40651cb-0570-4e60-b2ce-afcbd782918e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:36.968663 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40651cb-0570-4e60-b2ce-afcbd782918e admin admin] PATH_INFO: `/v3/users/cb997a1285c547ab80d7f8bfa8a2d458` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:36.969968 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40651cb-0570-4e60-b2ce-afcbd782918e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb997a1285c547ab80d7f8bfa8a2d458)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:36.972024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40651cb-0570-4e60-b2ce-afcbd782918e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:37.030398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d40651cb-0570-4e60-b2ce-afcbd782918e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb997a1285c547ab80d7f8bfa8a2d458'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:37.049259 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d40651cb-0570-4e60-b2ce-afcbd782918e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb997a1285c547ab80d7f8bfa8a2d458'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:37.050017 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d40651cb-0570-4e60-b2ce-afcbd782918e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb997a1285c547ab80d7f8bfa8a2d458'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:37.050664 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d40651cb-0570-4e60-b2ce-afcbd782918e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb997a1285c547ab80d7f8bfa8a2d458'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:37.060899 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d40651cb-0570-4e60-b2ce-afcbd782918e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb997a1285c547ab80d7f8bfa8a2d458'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:37.075339 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1352/2729] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:32:36 2022] DELETE /identity/v3/users/cb997a1285c547ab80d7f8bfa8a2d458 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:32:37.080250 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0328915-5e5d-49c3-929a-2a1e475725bf None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:37.080766 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0328915-5e5d-49c3-929a-2a1e475725bf None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:37.080766 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0328915-5e5d-49c3-929a-2a1e475725bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:37.101688 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b0328915-5e5d-49c3-929a-2a1e475725bf None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:37.102921 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b0328915-5e5d-49c3-929a-2a1e475725bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:37.177638 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1378/2730] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:37.188243 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40651cb-0570-4e60-b2ce-afcbd782918e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:37.190636 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d40651cb-0570-4e60-b2ce-afcbd782918e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:37.265507 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40651cb-0570-4e60-b2ce-afcbd782918e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:37.271809 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba0722-2b6e-4d7a-83c9-b5134d3ae2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:37.272801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba0722-2b6e-4d7a-83c9-b5134d3ae2ca service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:37.273232 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba0722-2b6e-4d7a-83c9-b5134d3ae2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:37.273681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba0722-2b6e-4d7a-83c9-b5134d3ae2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:37.286618 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba0722-2b6e-4d7a-83c9-b5134d3ae2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:37.288623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba0722-2b6e-4d7a-83c9-b5134d3ae2ca service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:37.301120 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1353/2731] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:37.594361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0328915-5e5d-49c3-929a-2a1e475725bf None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:37.596159 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b0328915-5e5d-49c3-929a-2a1e475725bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:37.612964 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0328915-5e5d-49c3-929a-2a1e475725bf None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:37.618271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bb813-3a29-4ecb-a681-4dde0a8d08bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:37.619440 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bb813-3a29-4ecb-a681-4dde0a8d08bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:37.619868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bb813-3a29-4ecb-a681-4dde0a8d08bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:37.620153 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bb813-3a29-4ecb-a681-4dde0a8d08bb admin admin] PATH_INFO: `/v3/projects/83149f3a8eea49668e9529757eb41bef` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:37.622843 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6bb813-3a29-4ecb-a681-4dde0a8d08bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=83149f3a8eea49668e9529757eb41bef)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:37.625250 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6bb813-3a29-4ecb-a681-4dde0a8d08bb admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:37.682916 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5d6bb813-3a29-4ecb-a681-4dde0a8d08bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83149f3a8eea49668e9529757eb41bef', 'request_id': 'req-5d6bb813-3a29-4ecb-a681-4dde0a8d08bb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:37.691105 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5d6bb813-3a29-4ecb-a681-4dde0a8d08bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83149f3a8eea49668e9529757eb41bef', 'request_id': 'req-5d6bb813-3a29-4ecb-a681-4dde0a8d08bb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:37.701505 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5d6bb813-3a29-4ecb-a681-4dde0a8d08bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83149f3a8eea49668e9529757eb41bef', 'request_id': 'req-5d6bb813-3a29-4ecb-a681-4dde0a8d08bb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:37.715677 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5d6bb813-3a29-4ecb-a681-4dde0a8d08bb admin admin] The token cache is being invalidate because project 83149f3a8eea49668e9529757eb41bef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:32:37.716005 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5d6bb813-3a29-4ecb-a681-4dde0a8d08bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:37.716747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5d6bb813-3a29-4ecb-a681-4dde0a8d08bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:37.718445 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1379/2732] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:32:37 2022] DELETE /identity/v3/projects/83149f3a8eea49668e9529757eb41bef => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:32:37.723289 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba0722-2b6e-4d7a-83c9-b5134d3ae2ca service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:37.737735 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba0722-2b6e-4d7a-83c9-b5134d3ae2ca service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:37.799022 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde567e0-4684-45e6-af87-7bbdc86852e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:37.800419 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde567e0-4684-45e6-af87-7bbdc86852e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:37.800797 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde567e0-4684-45e6-af87-7bbdc86852e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:37.801159 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde567e0-4684-45e6-af87-7bbdc86852e4 admin admin] PATH_INFO: `/v3/users/ef1a8b8e5097493181c430c86fc6efc2` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:37.803280 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde567e0-4684-45e6-af87-7bbdc86852e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef1a8b8e5097493181c430c86fc6efc2)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:37.806257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde567e0-4684-45e6-af87-7bbdc86852e4 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:37.855680 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dde567e0-4684-45e6-af87-7bbdc86852e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef1a8b8e5097493181c430c86fc6efc2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:37.867139 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dde567e0-4684-45e6-af87-7bbdc86852e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef1a8b8e5097493181c430c86fc6efc2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:37.867822 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dde567e0-4684-45e6-af87-7bbdc86852e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef1a8b8e5097493181c430c86fc6efc2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:37.868440 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dde567e0-4684-45e6-af87-7bbdc86852e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef1a8b8e5097493181c430c86fc6efc2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:37.877392 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dde567e0-4684-45e6-af87-7bbdc86852e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef1a8b8e5097493181c430c86fc6efc2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:37.890089 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1354/2733] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:32:37 2022] DELETE /identity/v3/users/ef1a8b8e5097493181c430c86fc6efc2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:32:38.161263 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bb813-3a29-4ecb-a681-4dde0a8d08bb admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:38.162735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5d6bb813-3a29-4ecb-a681-4dde0a8d08bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:38.176429 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bb813-3a29-4ecb-a681-4dde0a8d08bb admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:38.239633 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db63daa-3275-4137-ad77-67a387e56387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:38.240500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db63daa-3275-4137-ad77-67a387e56387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:38.240819 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db63daa-3275-4137-ad77-67a387e56387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:38.241053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db63daa-3275-4137-ad77-67a387e56387 admin admin] PATH_INFO: `/v3/projects/2a420a2e9770484291776ccba81d300f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:38.242339 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db63daa-3275-4137-ad77-67a387e56387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a420a2e9770484291776ccba81d300f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:38.244291 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db63daa-3275-4137-ad77-67a387e56387 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:38.292849 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1db63daa-3275-4137-ad77-67a387e56387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a420a2e9770484291776ccba81d300f', 'request_id': 'req-1db63daa-3275-4137-ad77-67a387e56387'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:38.299145 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1db63daa-3275-4137-ad77-67a387e56387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a420a2e9770484291776ccba81d300f', 'request_id': 'req-1db63daa-3275-4137-ad77-67a387e56387'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:38.309389 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1db63daa-3275-4137-ad77-67a387e56387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a420a2e9770484291776ccba81d300f', 'request_id': 'req-1db63daa-3275-4137-ad77-67a387e56387'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:38.319697 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1db63daa-3275-4137-ad77-67a387e56387 admin admin] The token cache is being invalidate because project 2a420a2e9770484291776ccba81d300f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:32:38.319985 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1db63daa-3275-4137-ad77-67a387e56387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:38.320722 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1db63daa-3275-4137-ad77-67a387e56387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:38.322366 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1380/2734] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:32:38 2022] DELETE /identity/v3/projects/2a420a2e9770484291776ccba81d300f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:32:38.327192 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde567e0-4684-45e6-af87-7bbdc86852e4 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:38.329456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-dde567e0-4684-45e6-af87-7bbdc86852e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:38.346343 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde567e0-4684-45e6-af87-7bbdc86852e4 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:38.408323 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db122a0-1fe3-44d2-b19d-5a6eaf674e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:38.409217 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db122a0-1fe3-44d2-b19d-5a6eaf674e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:38.409492 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db122a0-1fe3-44d2-b19d-5a6eaf674e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:38.409781 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db122a0-1fe3-44d2-b19d-5a6eaf674e8d admin admin] PATH_INFO: `/v3/users/12843084d60a4fdba201955a8a707547` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:38.411006 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db122a0-1fe3-44d2-b19d-5a6eaf674e8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=12843084d60a4fdba201955a8a707547)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:38.413307 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db122a0-1fe3-44d2-b19d-5a6eaf674e8d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:38.462070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-0db122a0-1fe3-44d2-b19d-5a6eaf674e8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12843084d60a4fdba201955a8a707547'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:38.473245 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-0db122a0-1fe3-44d2-b19d-5a6eaf674e8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12843084d60a4fdba201955a8a707547'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:38.473895 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-0db122a0-1fe3-44d2-b19d-5a6eaf674e8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12843084d60a4fdba201955a8a707547'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:38.474481 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-0db122a0-1fe3-44d2-b19d-5a6eaf674e8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12843084d60a4fdba201955a8a707547'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:38.482883 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-0db122a0-1fe3-44d2-b19d-5a6eaf674e8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12843084d60a4fdba201955a8a707547'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:38.495214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1355/2735] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:32:38 2022] DELETE /identity/v3/users/12843084d60a4fdba201955a8a707547 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:32:38.782867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db63daa-3275-4137-ad77-67a387e56387 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:38.784358 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1db63daa-3275-4137-ad77-67a387e56387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:38.797560 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db63daa-3275-4137-ad77-67a387e56387 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:38.854285 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77edd03-cf89-47c3-92b4-bfac59c6fa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:38.855262 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77edd03-cf89-47c3-92b4-bfac59c6fa51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:38.855477 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77edd03-cf89-47c3-92b4-bfac59c6fa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:38.855746 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77edd03-cf89-47c3-92b4-bfac59c6fa51 admin admin] PATH_INFO: `/v3/projects/3d419df1cb6b4168afdf7bb844596147` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:38.857050 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77edd03-cf89-47c3-92b4-bfac59c6fa51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d419df1cb6b4168afdf7bb844596147)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:38.858988 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77edd03-cf89-47c3-92b4-bfac59c6fa51 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:38.907949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e77edd03-cf89-47c3-92b4-bfac59c6fa51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d419df1cb6b4168afdf7bb844596147', 'request_id': 'req-e77edd03-cf89-47c3-92b4-bfac59c6fa51'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:38.913998 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e77edd03-cf89-47c3-92b4-bfac59c6fa51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d419df1cb6b4168afdf7bb844596147', 'request_id': 'req-e77edd03-cf89-47c3-92b4-bfac59c6fa51'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:38.923547 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e77edd03-cf89-47c3-92b4-bfac59c6fa51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d419df1cb6b4168afdf7bb844596147', 'request_id': 'req-e77edd03-cf89-47c3-92b4-bfac59c6fa51'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:38.935088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e77edd03-cf89-47c3-92b4-bfac59c6fa51 admin admin] The token cache is being invalidate because project 3d419df1cb6b4168afdf7bb844596147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:32:38.935367 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e77edd03-cf89-47c3-92b4-bfac59c6fa51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:38.936050 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e77edd03-cf89-47c3-92b4-bfac59c6fa51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:38.937639 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1381/2736] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:32:38 2022] DELETE /identity/v3/projects/3d419df1cb6b4168afdf7bb844596147 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:32:38.946016 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad18e9-e9b4-43d1-aea6-0c8448f68604 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:38.946516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad18e9-e9b4-43d1-aea6-0c8448f68604 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:38.946516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad18e9-e9b4-43d1-aea6-0c8448f68604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:38.966051 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-acad18e9-e9b4-43d1-aea6-0c8448f68604 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:38.967298 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-acad18e9-e9b4-43d1-aea6-0c8448f68604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:39.040187 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1356/2737] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:39.053210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e9413-98a8-4dbc-aacc-9ce74361f0a0 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:39.053565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e9413-98a8-4dbc-aacc-9ce74361f0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:39.053951 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e9413-98a8-4dbc-aacc-9ce74361f0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:39.075323 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-367e9413-98a8-4dbc-aacc-9ce74361f0a0 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:39.076540 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-367e9413-98a8-4dbc-aacc-9ce74361f0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:39.085303 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1382/2738] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:39.089724 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad18e9-e9b4-43d1-aea6-0c8448f68604 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:39.099777 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad18e9-e9b4-43d1-aea6-0c8448f68604 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:39.105722 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018b1bc-cb19-46a6-9f13-df683382801c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:39.106315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018b1bc-cb19-46a6-9f13-df683382801c admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:39.106628 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018b1bc-cb19-46a6-9f13-df683382801c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:39.106885 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018b1bc-cb19-46a6-9f13-df683382801c admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:39.107653 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018b1bc-cb19-46a6-9f13-df683382801c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:32:39.107957 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018b1bc-cb19-46a6-9f13-df683382801c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:39.109550 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018b1bc-cb19-46a6-9f13-df683382801c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:39.121109 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1357/2739] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 07:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:32:39.125552 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e9413-98a8-4dbc-aacc-9ce74361f0a0 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:39.134856 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e9413-98a8-4dbc-aacc-9ce74361f0a0 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:39.140085 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbb559-eef7-4fc7-8f21-240ca8f595f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:39.141088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbb559-eef7-4fc7-8f21-240ca8f595f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:39.141373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbb559-eef7-4fc7-8f21-240ca8f595f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:39.141653 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbb559-eef7-4fc7-8f21-240ca8f595f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:39.142358 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbb559-eef7-4fc7-8f21-240ca8f595f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:39.144311 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbb559-eef7-4fc7-8f21-240ca8f595f2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:39.172557 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1383/2740] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:32:39 2022] POST /identity/v3/projects => generated 397 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:32:39.176673 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018b1bc-cb19-46a6-9f13-df683382801c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:39.186685 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018b1bc-cb19-46a6-9f13-df683382801c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:39.243208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195194d-7b48-4170-b217-215dd7d9dba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:39.243875 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195194d-7b48-4170-b217-215dd7d9dba7 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:39.244161 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195194d-7b48-4170-b217-215dd7d9dba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:39.244437 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195194d-7b48-4170-b217-215dd7d9dba7 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:39.245141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195194d-7b48-4170-b217-215dd7d9dba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:39.247094 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195194d-7b48-4170-b217-215dd7d9dba7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:39.271299 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1358/2741] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:32:39 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:32:39.276215 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbb559-eef7-4fc7-8f21-240ca8f595f2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:39.287526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbb559-eef7-4fc7-8f21-240ca8f595f2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:39.292641 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ab357-ef0f-4bfb-9667-dea3fff9300c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:39.293420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ab357-ef0f-4bfb-9667-dea3fff9300c admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:39.293778 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ab357-ef0f-4bfb-9667-dea3fff9300c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:39.294151 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ab357-ef0f-4bfb-9667-dea3fff9300c admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:39.294898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ab357-ef0f-4bfb-9667-dea3fff9300c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:39.296563 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ab357-ef0f-4bfb-9667-dea3fff9300c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:39.308296 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1384/2742] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:32:39.312665 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195194d-7b48-4170-b217-215dd7d9dba7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:39.323324 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195194d-7b48-4170-b217-215dd7d9dba7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:39.328598 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec721318-0453-4a87-8aa6-8bdd8c2d1e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:39.329270 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec721318-0453-4a87-8aa6-8bdd8c2d1e1c admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:39.329555 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec721318-0453-4a87-8aa6-8bdd8c2d1e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:39.329830 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec721318-0453-4a87-8aa6-8bdd8c2d1e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:39.330569 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec721318-0453-4a87-8aa6-8bdd8c2d1e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:39.332221 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec721318-0453-4a87-8aa6-8bdd8c2d1e1c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:39.342786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1359/2743] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:32:39.347732 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ab357-ef0f-4bfb-9667-dea3fff9300c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:39.363403 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ab357-ef0f-4bfb-9667-dea3fff9300c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:39.371446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6d26a-a131-4e63-9d38-7ff53fb70370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:39.372703 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6d26a-a131-4e63-9d38-7ff53fb70370 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:39.372985 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6d26a-a131-4e63-9d38-7ff53fb70370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:39.373260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6d26a-a131-4e63-9d38-7ff53fb70370 admin admin] PATH_INFO: `/v3/projects/b4172734e986492ab67d4498b92ad130/users/778f491c9f2e4be9a4a5f3ce4515cfdd/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:39.388595 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6d26a-a131-4e63-9d38-7ff53fb70370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4172734e986492ab67d4498b92ad130, user_id=778f491c9f2e4be9a4a5f3ce4515cfdd, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:39.391629 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6d26a-a131-4e63-9d38-7ff53fb70370 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:39.407273 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1385/2744] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:32:39 2022] PUT /identity/v3/projects/b4172734e986492ab67d4498b92ad130/users/778f491c9f2e4be9a4a5f3ce4515cfdd/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:32:39.423203 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6df1d-3bbc-4bfe-82da-88428b853f46 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:39.423498 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6df1d-3bbc-4bfe-82da-88428b853f46 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:39.423754 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6df1d-3bbc-4bfe-82da-88428b853f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:39.452641 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-73f6df1d-3bbc-4bfe-82da-88428b853f46 None None] MFA Rules not processed for user `778f491c9f2e4be9a4a5f3ce4515cfdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:39.453861 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-73f6df1d-3bbc-4bfe-82da-88428b853f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:39.519917 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1360/2745] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:32:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:32:39.531589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6d26a-a131-4e63-9d38-7ff53fb70370 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:39.533424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-64e6d26a-a131-4e63-9d38-7ff53fb70370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:39.601042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6d26a-a131-4e63-9d38-7ff53fb70370 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:39.607854 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d1265-d9af-48b9-beba-0d7120814f46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:39.608508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d1265-d9af-48b9-beba-0d7120814f46 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:39.608786 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d1265-d9af-48b9-beba-0d7120814f46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:39.609060 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d1265-d9af-48b9-beba-0d7120814f46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:39.618122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d1265-d9af-48b9-beba-0d7120814f46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:39.619532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d1265-d9af-48b9-beba-0d7120814f46 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:39.628901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1386/2746] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:32:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:48.812192 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6df1d-3bbc-4bfe-82da-88428b853f46 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:48.889287 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6df1d-3bbc-4bfe-82da-88428b853f46 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:48.895075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae8e7b-70b2-4fef-879b-6d302de54115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:48.895953 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae8e7b-70b2-4fef-879b-6d302de54115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:48.896231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae8e7b-70b2-4fef-879b-6d302de54115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:48.896504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae8e7b-70b2-4fef-879b-6d302de54115 admin admin] PATH_INFO: `/v3/users/778f491c9f2e4be9a4a5f3ce4515cfdd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:48.897807 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae8e7b-70b2-4fef-879b-6d302de54115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=778f491c9f2e4be9a4a5f3ce4515cfdd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:48.899773 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae8e7b-70b2-4fef-879b-6d302de54115 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:48.955382 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2cae8e7b-70b2-4fef-879b-6d302de54115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '778f491c9f2e4be9a4a5f3ce4515cfdd'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:48.967880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2cae8e7b-70b2-4fef-879b-6d302de54115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '778f491c9f2e4be9a4a5f3ce4515cfdd'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:48.968750 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2cae8e7b-70b2-4fef-879b-6d302de54115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '778f491c9f2e4be9a4a5f3ce4515cfdd'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:48.969349 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2cae8e7b-70b2-4fef-879b-6d302de54115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '778f491c9f2e4be9a4a5f3ce4515cfdd'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:48.978197 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2cae8e7b-70b2-4fef-879b-6d302de54115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '778f491c9f2e4be9a4a5f3ce4515cfdd'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:48.990936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1361/2747] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:32:48 2022] DELETE /identity/v3/users/778f491c9f2e4be9a4a5f3ce4515cfdd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:32:48.995517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd931d-dfa9-441c-885d-2e046033eb05 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:48.996002 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd931d-dfa9-441c-885d-2e046033eb05 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:48.996099 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd931d-dfa9-441c-885d-2e046033eb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:49.014089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-59dd931d-dfa9-441c-885d-2e046033eb05 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:49.015367 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-59dd931d-dfa9-441c-885d-2e046033eb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:49.072936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1387/2748] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:49.084136 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae8e7b-70b2-4fef-879b-6d302de54115 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:49.086514 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2cae8e7b-70b2-4fef-879b-6d302de54115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:49.152842 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae8e7b-70b2-4fef-879b-6d302de54115 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:49.157319 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ccd63-5e23-40c1-a485-05386ab73415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:49.157963 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ccd63-5e23-40c1-a485-05386ab73415 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:49.158246 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ccd63-5e23-40c1-a485-05386ab73415 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:49.158528 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ccd63-5e23-40c1-a485-05386ab73415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:49.167936 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ccd63-5e23-40c1-a485-05386ab73415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:49.169372 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ccd63-5e23-40c1-a485-05386ab73415 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:49.178826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1362/2749] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:49.452804 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd931d-dfa9-441c-885d-2e046033eb05 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:49.454299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-59dd931d-dfa9-441c-885d-2e046033eb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:49.468730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd931d-dfa9-441c-885d-2e046033eb05 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:49.474651 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91b9e7-4657-4156-ac01-8fbd16b75c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:49.475589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91b9e7-4657-4156-ac01-8fbd16b75c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:49.475944 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91b9e7-4657-4156-ac01-8fbd16b75c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:49.476063 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91b9e7-4657-4156-ac01-8fbd16b75c21 admin admin] PATH_INFO: `/v3/projects/b4172734e986492ab67d4498b92ad130` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:49.477375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91b9e7-4657-4156-ac01-8fbd16b75c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4172734e986492ab67d4498b92ad130)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:49.479508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91b9e7-4657-4156-ac01-8fbd16b75c21 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:49.529303 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3e91b9e7-4657-4156-ac01-8fbd16b75c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4172734e986492ab67d4498b92ad130', 'request_id': 'req-3e91b9e7-4657-4156-ac01-8fbd16b75c21'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:49.535570 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3e91b9e7-4657-4156-ac01-8fbd16b75c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4172734e986492ab67d4498b92ad130', 'request_id': 'req-3e91b9e7-4657-4156-ac01-8fbd16b75c21'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:49.544821 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3e91b9e7-4657-4156-ac01-8fbd16b75c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4172734e986492ab67d4498b92ad130', 'request_id': 'req-3e91b9e7-4657-4156-ac01-8fbd16b75c21'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:49.555124 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3e91b9e7-4657-4156-ac01-8fbd16b75c21 admin admin] The token cache is being invalidate because project b4172734e986492ab67d4498b92ad130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:32:49.555407 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3e91b9e7-4657-4156-ac01-8fbd16b75c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:49.556083 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3e91b9e7-4657-4156-ac01-8fbd16b75c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:32:49.557688 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1388/2750] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:32:49 2022] DELETE /identity/v3/projects/b4172734e986492ab67d4498b92ad130 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:32:49.563058 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa04fda-9397-4ff5-871e-618c55076932 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:49.563357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa04fda-9397-4ff5-871e-618c55076932 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:49.563635 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa04fda-9397-4ff5-871e-618c55076932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:49.583484 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-cfa04fda-9397-4ff5-871e-618c55076932 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:49.584630 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cfa04fda-9397-4ff5-871e-618c55076932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:49.647342 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1363/2751] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:49.656550 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45368365-4a6c-4e13-8d1e-a437f90fb819 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:49.656839 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45368365-4a6c-4e13-8d1e-a437f90fb819 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:49.657110 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45368365-4a6c-4e13-8d1e-a437f90fb819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:49.676954 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-45368365-4a6c-4e13-8d1e-a437f90fb819 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:49.678145 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-45368365-4a6c-4e13-8d1e-a437f90fb819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:49.686790 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1389/2752] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:49.690991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa04fda-9397-4ff5-871e-618c55076932 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:49.701213 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa04fda-9397-4ff5-871e-618c55076932 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:49.707179 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a7afd-6a50-409d-948f-578972379b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:49.707838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a7afd-6a50-409d-948f-578972379b17 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:49.708118 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a7afd-6a50-409d-948f-578972379b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:49.708389 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a7afd-6a50-409d-948f-578972379b17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:49.709117 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a7afd-6a50-409d-948f-578972379b17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:32:49.709419 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a7afd-6a50-409d-948f-578972379b17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:49.711020 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a7afd-6a50-409d-948f-578972379b17 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:49.722975 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1364/2753] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 07:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:32:49.727255 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45368365-4a6c-4e13-8d1e-a437f90fb819 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:49.736796 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45368365-4a6c-4e13-8d1e-a437f90fb819 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:49.742462 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ec263-35be-4653-8449-fad201707c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:49.743189 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ec263-35be-4653-8449-fad201707c48 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:49.743499 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ec263-35be-4653-8449-fad201707c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:49.743766 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ec263-35be-4653-8449-fad201707c48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:49.744463 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ec263-35be-4653-8449-fad201707c48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:49.746369 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ec263-35be-4653-8449-fad201707c48 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:49.779894 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1390/2754] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:32:49 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:32:49.784176 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a7afd-6a50-409d-948f-578972379b17 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:49.794281 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a7afd-6a50-409d-948f-578972379b17 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:49.861663 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558c3ab-d139-452b-8f16-870015dda4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:49.862306 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558c3ab-d139-452b-8f16-870015dda4fe admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:49.862647 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558c3ab-d139-452b-8f16-870015dda4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:49.862924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558c3ab-d139-452b-8f16-870015dda4fe admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:49.863664 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558c3ab-d139-452b-8f16-870015dda4fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:49.865720 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558c3ab-d139-452b-8f16-870015dda4fe admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:49.886796 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1365/2755] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:32:49 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:32:49.891868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ec263-35be-4653-8449-fad201707c48 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:49.902595 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ec263-35be-4653-8449-fad201707c48 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:49.908318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0199b-ceb5-4472-9767-cb5a73179669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:49.908988 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0199b-ceb5-4472-9767-cb5a73179669 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:49.909298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0199b-ceb5-4472-9767-cb5a73179669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:49.909589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0199b-ceb5-4472-9767-cb5a73179669 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:49.910306 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0199b-ceb5-4472-9767-cb5a73179669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:49.911958 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0199b-ceb5-4472-9767-cb5a73179669 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:49.923323 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1391/2756] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:32:49.927447 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558c3ab-d139-452b-8f16-870015dda4fe admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:49.937878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558c3ab-d139-452b-8f16-870015dda4fe admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:49.943476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a22f99-a6ee-49f2-a33f-e9f6af54734c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:49.944134 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a22f99-a6ee-49f2-a33f-e9f6af54734c admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:49.944410 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a22f99-a6ee-49f2-a33f-e9f6af54734c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:49.944678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a22f99-a6ee-49f2-a33f-e9f6af54734c admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:49.945399 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a22f99-a6ee-49f2-a33f-e9f6af54734c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:49.946999 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a22f99-a6ee-49f2-a33f-e9f6af54734c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:49.957302 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1366/2757] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:32:49.961446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0199b-ceb5-4472-9767-cb5a73179669 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:49.971929 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0199b-ceb5-4472-9767-cb5a73179669 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:49.977604 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dfafc-f385-4f93-bfcf-daec395491f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:49.978535 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dfafc-f385-4f93-bfcf-daec395491f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:49.978877 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dfafc-f385-4f93-bfcf-daec395491f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:49.979182 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dfafc-f385-4f93-bfcf-daec395491f4 admin admin] PATH_INFO: `/v3/projects/7235fa7902e641be820d2043ce0c75d1/users/091ecb0ab33e483d9f8a3b76b84ef039/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:49.995275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935dfafc-f385-4f93-bfcf-daec395491f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7235fa7902e641be820d2043ce0c75d1, user_id=091ecb0ab33e483d9f8a3b76b84ef039, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:49.998021 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935dfafc-f385-4f93-bfcf-daec395491f4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:50.014422 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1392/2758] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:32:49 2022] PUT /identity/v3/projects/7235fa7902e641be820d2043ce0c75d1/users/091ecb0ab33e483d9f8a3b76b84ef039/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:32:50.019943 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531d6c9-f391-4644-9019-433c7b1153b8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:50.020231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531d6c9-f391-4644-9019-433c7b1153b8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:50.020524 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531d6c9-f391-4644-9019-433c7b1153b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:50.038722 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a531d6c9-f391-4644-9019-433c7b1153b8 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:50.040516 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a531d6c9-f391-4644-9019-433c7b1153b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:50.098851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1367/2759] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:50.109271 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dfafc-f385-4f93-bfcf-daec395491f4 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:50.111066 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-935dfafc-f385-4f93-bfcf-daec395491f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:50.174469 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dfafc-f385-4f93-bfcf-daec395491f4 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:50.179298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f8c25-ae7e-47b6-b0c6-22c71b65743a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:50.179983 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f8c25-ae7e-47b6-b0c6-22c71b65743a service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:50.180264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f8c25-ae7e-47b6-b0c6-22c71b65743a service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:50.180538 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f8c25-ae7e-47b6-b0c6-22c71b65743a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:50.191095 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f8c25-ae7e-47b6-b0c6-22c71b65743a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:50.192535 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f8c25-ae7e-47b6-b0c6-22c71b65743a service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:50.202448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1393/2760] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:32:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:54.171979 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb743591-d89e-4004-af8e-9fa36865a64b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:54.172519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb743591-d89e-4004-af8e-9fa36865a64b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:54.172519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb743591-d89e-4004-af8e-9fa36865a64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:54.204990 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-bb743591-d89e-4004-af8e-9fa36865a64b None None] MFA Rules not processed for user `091ecb0ab33e483d9f8a3b76b84ef039`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:54.206444 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bb743591-d89e-4004-af8e-9fa36865a64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:54.280151 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1368/2761] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:32:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:54.284573 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f8c25-ae7e-47b6-b0c6-22c71b65743a service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:54.295138 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f8c25-ae7e-47b6-b0c6-22c71b65743a service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:54.299753 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96955098-9bdd-4433-b8bf-8dd6831d550d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:54.300424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96955098-9bdd-4433-b8bf-8dd6831d550d admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:54.300736 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96955098-9bdd-4433-b8bf-8dd6831d550d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:54.301013 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96955098-9bdd-4433-b8bf-8dd6831d550d admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:54.301727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96955098-9bdd-4433-b8bf-8dd6831d550d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:54.303680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96955098-9bdd-4433-b8bf-8dd6831d550d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:54.334339 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1394/2762] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:32:54 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:32:54.335724 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb743591-d89e-4004-af8e-9fa36865a64b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:54.346773 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb743591-d89e-4004-af8e-9fa36865a64b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:54.413278 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6baddb-0ecd-4e9f-83ef-12d3a8602338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:54.414181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6baddb-0ecd-4e9f-83ef-12d3a8602338 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:54.414466 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6baddb-0ecd-4e9f-83ef-12d3a8602338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:54.414803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6baddb-0ecd-4e9f-83ef-12d3a8602338 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:54.415611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6baddb-0ecd-4e9f-83ef-12d3a8602338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:54.418212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6baddb-0ecd-4e9f-83ef-12d3a8602338 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:54.441808 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1369/2763] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:32:54 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:32:54.445883 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96955098-9bdd-4433-b8bf-8dd6831d550d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:54.456975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96955098-9bdd-4433-b8bf-8dd6831d550d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:54.461879 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ade52-f875-4e77-aa78-3f2dce777384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:54.462661 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ade52-f875-4e77-aa78-3f2dce777384 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:54.462835 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ade52-f875-4e77-aa78-3f2dce777384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:54.463155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ade52-f875-4e77-aa78-3f2dce777384 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:54.464077 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ade52-f875-4e77-aa78-3f2dce777384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:54.465702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ade52-f875-4e77-aa78-3f2dce777384 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:54.476849 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1395/2764] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:32:54.481068 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6baddb-0ecd-4e9f-83ef-12d3a8602338 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:54.491900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6baddb-0ecd-4e9f-83ef-12d3a8602338 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:54.496809 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fdc6e-c99b-4aa6-ae6d-c8faee48d29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:54.497788 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fdc6e-c99b-4aa6-ae6d-c8faee48d29b admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:54.498068 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fdc6e-c99b-4aa6-ae6d-c8faee48d29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:54.498341 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fdc6e-c99b-4aa6-ae6d-c8faee48d29b admin admin] PATH_INFO: `/v3/projects/84aaf0ee5b264b83a7ca4c80e7bd446d/users/36acd2c394444f6c9e2b8ea65a5305a3/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:54.514461 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fdc6e-c99b-4aa6-ae6d-c8faee48d29b admin admin] RBAC: Authorizing `identity:create_grant(project_id=84aaf0ee5b264b83a7ca4c80e7bd446d, user_id=36acd2c394444f6c9e2b8ea65a5305a3, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:54.517695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fdc6e-c99b-4aa6-ae6d-c8faee48d29b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:54.532943 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1370/2765] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:32:54 2022] PUT /identity/v3/projects/84aaf0ee5b264b83a7ca4c80e7bd446d/users/36acd2c394444f6c9e2b8ea65a5305a3/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:32:54.536887 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ade52-f875-4e77-aa78-3f2dce777384 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:54.547456 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ade52-f875-4e77-aa78-3f2dce777384 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:54.609150 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc82184-1c64-4006-88d2-0beee62ebd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:54.609985 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc82184-1c64-4006-88d2-0beee62ebd4f admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:54.610274 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc82184-1c64-4006-88d2-0beee62ebd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:54.610684 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc82184-1c64-4006-88d2-0beee62ebd4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:54.611522 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc82184-1c64-4006-88d2-0beee62ebd4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:54.613097 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc82184-1c64-4006-88d2-0beee62ebd4f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:54.624619 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1396/2766] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:32:54.628522 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fdc6e-c99b-4aa6-ae6d-c8faee48d29b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:54.639478 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fdc6e-c99b-4aa6-ae6d-c8faee48d29b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:54.645003 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5248bc0-9396-401c-87b0-ce5d9b2973a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:54.645955 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5248bc0-9396-401c-87b0-ce5d9b2973a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:54.646234 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5248bc0-9396-401c-87b0-ce5d9b2973a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:54.646693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5248bc0-9396-401c-87b0-ce5d9b2973a7 admin admin] PATH_INFO: `/v3/projects/84aaf0ee5b264b83a7ca4c80e7bd446d/users/36acd2c394444f6c9e2b8ea65a5305a3/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:54.648798 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5248bc0-9396-401c-87b0-ce5d9b2973a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84aaf0ee5b264b83a7ca4c80e7bd446d, user_id=36acd2c394444f6c9e2b8ea65a5305a3, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:54.651509 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5248bc0-9396-401c-87b0-ce5d9b2973a7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:54.663536 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1371/2767] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:32:54 2022] PUT /identity/v3/projects/84aaf0ee5b264b83a7ca4c80e7bd446d/users/36acd2c394444f6c9e2b8ea65a5305a3/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:32:59.112242 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff623ac-9d97-44a6-a03e-92ee687a70dd None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:59.112787 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff623ac-9d97-44a6-a03e-92ee687a70dd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:59.112900 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff623ac-9d97-44a6-a03e-92ee687a70dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:59.139773 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6ff623ac-9d97-44a6-a03e-92ee687a70dd None None] MFA Rules not processed for user `36acd2c394444f6c9e2b8ea65a5305a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:59.141354 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6ff623ac-9d97-44a6-a03e-92ee687a70dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:59.214021 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1397/2768] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:32:59 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:59.228216 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5248bc0-9396-401c-87b0-ce5d9b2973a7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:59.230160 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a5248bc0-9396-401c-87b0-ce5d9b2973a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:59.316884 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5248bc0-9396-401c-87b0-ce5d9b2973a7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:59.324056 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c346a1-520e-48f6-9645-093a826ef58c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:59.325039 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c346a1-520e-48f6-9645-093a826ef58c service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:59.325324 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c346a1-520e-48f6-9645-093a826ef58c service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:59.325601 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c346a1-520e-48f6-9645-093a826ef58c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:59.385115 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c346a1-520e-48f6-9645-093a826ef58c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:59.386714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c346a1-520e-48f6-9645-093a826ef58c service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:59.397101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1372/2769] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:32:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:33:00.381708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fcb37-86f9-4a90-a446-58d6b0f3a50c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:00.382243 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fcb37-86f9-4a90-a446-58d6b0f3a50c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:00.382384 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fcb37-86f9-4a90-a446-58d6b0f3a50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:00.412609 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-df9fcb37-86f9-4a90-a446-58d6b0f3a50c None None] MFA Rules not processed for user `091ecb0ab33e483d9f8a3b76b84ef039`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:00.414970 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-df9fcb37-86f9-4a90-a446-58d6b0f3a50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:00.424264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1398/2770] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:13.588657 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c346a1-520e-48f6-9645-093a826ef58c service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:13.590091 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e8c346a1-520e-48f6-9645-093a826ef58c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:13.646994 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c346a1-520e-48f6-9645-093a826ef58c service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:13.650693 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec6642-b441-46c2-88ea-18500ec58b3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:13.651366 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec6642-b441-46c2-88ea-18500ec58b3b service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:13.651651 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec6642-b441-46c2-88ea-18500ec58b3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:13.651926 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec6642-b441-46c2-88ea-18500ec58b3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:13.654076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-78ec6642-b441-46c2-88ea-18500ec58b3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:13.722480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec6642-b441-46c2-88ea-18500ec58b3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:13.724121 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec6642-b441-46c2-88ea-18500ec58b3b service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:13.737960 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1373/2771] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:33:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:33:16.983944 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fcb37-86f9-4a90-a446-58d6b0f3a50c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:16.985654 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-df9fcb37-86f9-4a90-a446-58d6b0f3a50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:16.999975 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fcb37-86f9-4a90-a446-58d6b0f3a50c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:17.005009 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cfd5d7-72bc-456a-8ec3-330bc5c20c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:17.005960 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfd5d7-72bc-456a-8ec3-330bc5c20c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:17.006170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfd5d7-72bc-456a-8ec3-330bc5c20c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:17.006441 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfd5d7-72bc-456a-8ec3-330bc5c20c33 admin admin] PATH_INFO: `/v3/users/3abe8bdd0c8948eb97dcc7292359520c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:17.007730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cfd5d7-72bc-456a-8ec3-330bc5c20c33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3abe8bdd0c8948eb97dcc7292359520c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:17.009770 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cfd5d7-72bc-456a-8ec3-330bc5c20c33 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:17.059256 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-69cfd5d7-72bc-456a-8ec3-330bc5c20c33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3abe8bdd0c8948eb97dcc7292359520c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:17.070325 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-69cfd5d7-72bc-456a-8ec3-330bc5c20c33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3abe8bdd0c8948eb97dcc7292359520c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:17.071068 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-69cfd5d7-72bc-456a-8ec3-330bc5c20c33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3abe8bdd0c8948eb97dcc7292359520c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:17.071740 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-69cfd5d7-72bc-456a-8ec3-330bc5c20c33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3abe8bdd0c8948eb97dcc7292359520c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:17.081341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-69cfd5d7-72bc-456a-8ec3-330bc5c20c33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3abe8bdd0c8948eb97dcc7292359520c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:17.093102 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1399/2772] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:33:16 2022] DELETE /identity/v3/users/3abe8bdd0c8948eb97dcc7292359520c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:17.283953 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec6642-b441-46c2-88ea-18500ec58b3b service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:17.296850 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec6642-b441-46c2-88ea-18500ec58b3b service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:17.356073 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab28be-7f8b-4625-8489-7108605d75d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:17.356944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab28be-7f8b-4625-8489-7108605d75d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:17.357204 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab28be-7f8b-4625-8489-7108605d75d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:17.357477 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab28be-7f8b-4625-8489-7108605d75d5 admin admin] PATH_INFO: `/v3/projects/96f7562e6730438588a7aee055e82ab9` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:17.358695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab28be-7f8b-4625-8489-7108605d75d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96f7562e6730438588a7aee055e82ab9)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:17.360632 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab28be-7f8b-4625-8489-7108605d75d5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:17.411317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43ab28be-7f8b-4625-8489-7108605d75d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96f7562e6730438588a7aee055e82ab9', 'request_id': 'req-43ab28be-7f8b-4625-8489-7108605d75d5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:17.417414 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43ab28be-7f8b-4625-8489-7108605d75d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96f7562e6730438588a7aee055e82ab9', 'request_id': 'req-43ab28be-7f8b-4625-8489-7108605d75d5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:17.427852 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43ab28be-7f8b-4625-8489-7108605d75d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96f7562e6730438588a7aee055e82ab9', 'request_id': 'req-43ab28be-7f8b-4625-8489-7108605d75d5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:17.438420 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43ab28be-7f8b-4625-8489-7108605d75d5 admin admin] The token cache is being invalidate because project 96f7562e6730438588a7aee055e82ab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:33:17.438696 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43ab28be-7f8b-4625-8489-7108605d75d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:17.439406 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43ab28be-7f8b-4625-8489-7108605d75d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:17.440998 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1374/2773] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:33:17 2022] DELETE /identity/v3/projects/96f7562e6730438588a7aee055e82ab9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:17.447532 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f1a65-8ddf-43dd-b690-bba8f2e064a0 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:17.447817 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f1a65-8ddf-43dd-b690-bba8f2e064a0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:17.448112 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f1a65-8ddf-43dd-b690-bba8f2e064a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:17.466681 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4c3f1a65-8ddf-43dd-b690-bba8f2e064a0 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:17.467983 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4c3f1a65-8ddf-43dd-b690-bba8f2e064a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:17.532931 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1400/2774] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:17.540844 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8816da6-646e-4363-ac2c-1800408cc143 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:17.541121 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8816da6-646e-4363-ac2c-1800408cc143 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:17.541390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8816da6-646e-4363-ac2c-1800408cc143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:17.561028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b8816da6-646e-4363-ac2c-1800408cc143 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:17.562229 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b8816da6-646e-4363-ac2c-1800408cc143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:17.570873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1375/2775] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:17.575298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f1a65-8ddf-43dd-b690-bba8f2e064a0 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:17.585677 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f1a65-8ddf-43dd-b690-bba8f2e064a0 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:17.591617 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180248c8-9db9-45f1-9183-5656a770c62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:17.592276 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180248c8-9db9-45f1-9183-5656a770c62a admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:17.592556 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180248c8-9db9-45f1-9183-5656a770c62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:17.592824 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180248c8-9db9-45f1-9183-5656a770c62a admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:17.593565 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180248c8-9db9-45f1-9183-5656a770c62a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:33:17.593851 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180248c8-9db9-45f1-9183-5656a770c62a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:17.595496 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180248c8-9db9-45f1-9183-5656a770c62a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:17.607494 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1401/2776] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 07:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:33:17.612127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8816da6-646e-4363-ac2c-1800408cc143 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:17.621353 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8816da6-646e-4363-ac2c-1800408cc143 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:17.627663 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3f6c6-6e6c-4417-bdad-8138846e6fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:17.628334 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3f6c6-6e6c-4417-bdad-8138846e6fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:17.628611 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3f6c6-6e6c-4417-bdad-8138846e6fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:17.628884 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3f6c6-6e6c-4417-bdad-8138846e6fe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:17.629568 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3f6c6-6e6c-4417-bdad-8138846e6fe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:17.631475 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3f6c6-6e6c-4417-bdad-8138846e6fe7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:17.659754 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1376/2777] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:33:17 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:33:17.663937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180248c8-9db9-45f1-9183-5656a770c62a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:17.674431 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180248c8-9db9-45f1-9183-5656a770c62a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:17.741109 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4690f96-27ab-49fa-8fd8-59bc20e773ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:17.741795 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4690f96-27ab-49fa-8fd8-59bc20e773ed admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:17.742099 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4690f96-27ab-49fa-8fd8-59bc20e773ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:17.742370 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4690f96-27ab-49fa-8fd8-59bc20e773ed admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:17.743169 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4690f96-27ab-49fa-8fd8-59bc20e773ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:17.745526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4690f96-27ab-49fa-8fd8-59bc20e773ed admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:17.770217 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1402/2778] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:33:17 2022] POST /identity/v3/users => generated 302 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:33:17.774047 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3f6c6-6e6c-4417-bdad-8138846e6fe7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:17.784873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3f6c6-6e6c-4417-bdad-8138846e6fe7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:17.790094 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdaf87-d0a6-495b-b27d-bb6d3f0d0e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:17.790806 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdaf87-d0a6-495b-b27d-bb6d3f0d0e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:17.791114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdaf87-d0a6-495b-b27d-bb6d3f0d0e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:17.791391 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdaf87-d0a6-495b-b27d-bb6d3f0d0e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:17.792126 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bdaf87-d0a6-495b-b27d-bb6d3f0d0e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:17.793734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bdaf87-d0a6-495b-b27d-bb6d3f0d0e91 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:17.804545 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1377/2779] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:33:17.808771 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4690f96-27ab-49fa-8fd8-59bc20e773ed admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:17.819646 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4690f96-27ab-49fa-8fd8-59bc20e773ed admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:17.825300 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793c440-c279-40e7-847f-0e85eeefff99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:17.826255 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793c440-c279-40e7-847f-0e85eeefff99 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:17.826534 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793c440-c279-40e7-847f-0e85eeefff99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:17.826801 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793c440-c279-40e7-847f-0e85eeefff99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:17.827575 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793c440-c279-40e7-847f-0e85eeefff99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:17.829163 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793c440-c279-40e7-847f-0e85eeefff99 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:17.840517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1403/2780] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:33:17.845442 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdaf87-d0a6-495b-b27d-bb6d3f0d0e91 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:17.856832 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdaf87-d0a6-495b-b27d-bb6d3f0d0e91 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:17.862079 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbc5de-050d-443f-a9eb-31016a6b3029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:17.862972 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbc5de-050d-443f-a9eb-31016a6b3029 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:17.863265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbc5de-050d-443f-a9eb-31016a6b3029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:17.863531 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbc5de-050d-443f-a9eb-31016a6b3029 admin admin] PATH_INFO: `/v3/projects/3c8aad62b3e94634824e59d713e1f3fa/users/0b724bfad03940aabf7f6f420e5474a4/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:17.878631 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbc5de-050d-443f-a9eb-31016a6b3029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8aad62b3e94634824e59d713e1f3fa, user_id=0b724bfad03940aabf7f6f420e5474a4, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:17.881299 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbc5de-050d-443f-a9eb-31016a6b3029 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:17.897044 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1378/2781] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:33:17 2022] PUT /identity/v3/projects/3c8aad62b3e94634824e59d713e1f3fa/users/0b724bfad03940aabf7f6f420e5474a4/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:17.907939 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727f050-fe2b-4e44-9bb1-1f02016e00a6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:17.908251 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727f050-fe2b-4e44-9bb1-1f02016e00a6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:17.908513 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727f050-fe2b-4e44-9bb1-1f02016e00a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:17.936154 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1727f050-fe2b-4e44-9bb1-1f02016e00a6 None None] MFA Rules not processed for user `0b724bfad03940aabf7f6f420e5474a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:17.937410 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1727f050-fe2b-4e44-9bb1-1f02016e00a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:18.004449 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1404/2782] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:18.009963 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbc5de-050d-443f-a9eb-31016a6b3029 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:18.073221 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbc5de-050d-443f-a9eb-31016a6b3029 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:18.078978 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980bd65-8ccf-4b34-ad66-c551e4bd2f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:18.079697 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980bd65-8ccf-4b34-ad66-c551e4bd2f91 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:18.079977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980bd65-8ccf-4b34-ad66-c551e4bd2f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:18.080277 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980bd65-8ccf-4b34-ad66-c551e4bd2f91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:18.080984 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980bd65-8ccf-4b34-ad66-c551e4bd2f91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:18.082895 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980bd65-8ccf-4b34-ad66-c551e4bd2f91 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:18.111455 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1379/2783] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:33:18 2022] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:33:18.115661 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727f050-fe2b-4e44-9bb1-1f02016e00a6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:18.127152 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727f050-fe2b-4e44-9bb1-1f02016e00a6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:18.183511 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fee7ca-6cf3-4869-8c57-5e3c63695605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:18.184180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fee7ca-6cf3-4869-8c57-5e3c63695605 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:18.184459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fee7ca-6cf3-4869-8c57-5e3c63695605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:18.184736 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fee7ca-6cf3-4869-8c57-5e3c63695605 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:18.185440 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fee7ca-6cf3-4869-8c57-5e3c63695605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:18.187402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fee7ca-6cf3-4869-8c57-5e3c63695605 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:18.209062 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1405/2784] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:33:18 2022] POST /identity/v3/users => generated 309 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:33:18.213220 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980bd65-8ccf-4b34-ad66-c551e4bd2f91 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:18.223733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980bd65-8ccf-4b34-ad66-c551e4bd2f91 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:18.229827 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4da0d-f134-4533-b4ea-8809d8dceb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:18.230513 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4da0d-f134-4533-b4ea-8809d8dceb76 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:18.230789 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4da0d-f134-4533-b4ea-8809d8dceb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:18.231094 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4da0d-f134-4533-b4ea-8809d8dceb76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:18.231855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4da0d-f134-4533-b4ea-8809d8dceb76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:18.233484 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4da0d-f134-4533-b4ea-8809d8dceb76 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:18.244864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1380/2785] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:33:18.249122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fee7ca-6cf3-4869-8c57-5e3c63695605 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:18.259610 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fee7ca-6cf3-4869-8c57-5e3c63695605 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:18.265764 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b530bb5-c1f2-483d-994b-5baeca982bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:18.266656 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b530bb5-c1f2-483d-994b-5baeca982bab admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:18.266940 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b530bb5-c1f2-483d-994b-5baeca982bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:18.267264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b530bb5-c1f2-483d-994b-5baeca982bab admin admin] PATH_INFO: `/v3/projects/e87dcd9cf3264c78a3cc5457a24cb92a/users/098aced9e10848be97c83153a0707c60/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:18.282901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b530bb5-c1f2-483d-994b-5baeca982bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e87dcd9cf3264c78a3cc5457a24cb92a, user_id=098aced9e10848be97c83153a0707c60, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:18.285610 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b530bb5-c1f2-483d-994b-5baeca982bab admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:18.301845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1406/2786] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:33:18 2022] PUT /identity/v3/projects/e87dcd9cf3264c78a3cc5457a24cb92a/users/098aced9e10848be97c83153a0707c60/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:18.305920 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4da0d-f134-4533-b4ea-8809d8dceb76 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:18.315778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4da0d-f134-4533-b4ea-8809d8dceb76 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:18.374822 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6121164-ffd3-430b-99d9-ffb598799007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:18.375484 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6121164-ffd3-430b-99d9-ffb598799007 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:18.375766 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6121164-ffd3-430b-99d9-ffb598799007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:18.376043 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6121164-ffd3-430b-99d9-ffb598799007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:18.376784 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6121164-ffd3-430b-99d9-ffb598799007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:18.378377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6121164-ffd3-430b-99d9-ffb598799007 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:18.388316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1381/2787] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:33:18.393107 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b530bb5-c1f2-483d-994b-5baeca982bab admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:18.404039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b530bb5-c1f2-483d-994b-5baeca982bab admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:18.408810 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5da14-971b-4297-93e1-87ea4b512702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:18.409700 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5da14-971b-4297-93e1-87ea4b512702 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:18.409982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5da14-971b-4297-93e1-87ea4b512702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:18.410255 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5da14-971b-4297-93e1-87ea4b512702 admin admin] PATH_INFO: `/v3/projects/e87dcd9cf3264c78a3cc5457a24cb92a/users/098aced9e10848be97c83153a0707c60/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:18.412267 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5da14-971b-4297-93e1-87ea4b512702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e87dcd9cf3264c78a3cc5457a24cb92a, user_id=098aced9e10848be97c83153a0707c60, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:18.414952 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5da14-971b-4297-93e1-87ea4b512702 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:18.425645 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1407/2788] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:33:18 2022] PUT /identity/v3/projects/e87dcd9cf3264c78a3cc5457a24cb92a/users/098aced9e10848be97c83153a0707c60/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:18.436914 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f51c8f-8e3b-44b1-83d7-f5e30463ac82 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:18.437338 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f51c8f-8e3b-44b1-83d7-f5e30463ac82 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:18.437733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f51c8f-8e3b-44b1-83d7-f5e30463ac82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:18.468647 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b5f51c8f-8e3b-44b1-83d7-f5e30463ac82 None None] MFA Rules not processed for user `098aced9e10848be97c83153a0707c60`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:18.469893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b5f51c8f-8e3b-44b1-83d7-f5e30463ac82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:18.537614 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1382/2789] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:18 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:18.548616 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5da14-971b-4297-93e1-87ea4b512702 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:18.550554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-46b5da14-971b-4297-93e1-87ea4b512702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:18.607277 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5da14-971b-4297-93e1-87ea4b512702 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:18.611373 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd04e38-3ab4-4251-b71c-deaee49f0bec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:18.612019 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd04e38-3ab4-4251-b71c-deaee49f0bec service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:18.612297 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd04e38-3ab4-4251-b71c-deaee49f0bec service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:18.612573 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd04e38-3ab4-4251-b71c-deaee49f0bec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:18.622642 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd04e38-3ab4-4251-b71c-deaee49f0bec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:18.624121 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd04e38-3ab4-4251-b71c-deaee49f0bec service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:18.634250 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1408/2790] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:33:18 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:33:18.791144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f51c8f-8e3b-44b1-83d7-f5e30463ac82 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:18.856404 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f51c8f-8e3b-44b1-83d7-f5e30463ac82 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:18.861619 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58194f-f1d5-48d6-8fb3-367bfe16f391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:18.862472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58194f-f1d5-48d6-8fb3-367bfe16f391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:18.862786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58194f-f1d5-48d6-8fb3-367bfe16f391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:18.863089 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58194f-f1d5-48d6-8fb3-367bfe16f391 admin admin] PATH_INFO: `/v3/users/0b724bfad03940aabf7f6f420e5474a4` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:18.864322 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58194f-f1d5-48d6-8fb3-367bfe16f391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b724bfad03940aabf7f6f420e5474a4)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:18.866250 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58194f-f1d5-48d6-8fb3-367bfe16f391 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:18.919870 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8a58194f-f1d5-48d6-8fb3-367bfe16f391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b724bfad03940aabf7f6f420e5474a4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:18.931733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8a58194f-f1d5-48d6-8fb3-367bfe16f391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b724bfad03940aabf7f6f420e5474a4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:18.932437 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8a58194f-f1d5-48d6-8fb3-367bfe16f391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b724bfad03940aabf7f6f420e5474a4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:18.933114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8a58194f-f1d5-48d6-8fb3-367bfe16f391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b724bfad03940aabf7f6f420e5474a4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:18.941989 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8a58194f-f1d5-48d6-8fb3-367bfe16f391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b724bfad03940aabf7f6f420e5474a4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:18.954359 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1383/2791] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:33:18 2022] DELETE /identity/v3/users/0b724bfad03940aabf7f6f420e5474a4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:18.959299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7af3c0-03b5-4757-9b6a-71a2d4736268 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:18.959584 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7af3c0-03b5-4757-9b6a-71a2d4736268 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:18.959852 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7af3c0-03b5-4757-9b6a-71a2d4736268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:18.977430 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0e7af3c0-03b5-4757-9b6a-71a2d4736268 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:18.978642 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0e7af3c0-03b5-4757-9b6a-71a2d4736268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:19.053336 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1409/2792] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:19.067165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58194f-f1d5-48d6-8fb3-367bfe16f391 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:19.069604 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8a58194f-f1d5-48d6-8fb3-367bfe16f391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:19.129755 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58194f-f1d5-48d6-8fb3-367bfe16f391 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:19.134231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbaa81-286d-4204-953e-1277cb78390d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:19.134895 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbaa81-286d-4204-953e-1277cb78390d service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:19.135190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbaa81-286d-4204-953e-1277cb78390d service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:19.135464 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbaa81-286d-4204-953e-1277cb78390d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:19.145525 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbaa81-286d-4204-953e-1277cb78390d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:19.146987 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbaa81-286d-4204-953e-1277cb78390d service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:19.156395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1384/2793] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:33:19.429747 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7af3c0-03b5-4757-9b6a-71a2d4736268 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:19.431296 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0e7af3c0-03b5-4757-9b6a-71a2d4736268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:19.443999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7af3c0-03b5-4757-9b6a-71a2d4736268 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:19.448626 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6c4d1-62e5-4f7b-9372-7557d7baa83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:19.449525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6c4d1-62e5-4f7b-9372-7557d7baa83e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:19.449806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6c4d1-62e5-4f7b-9372-7557d7baa83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:19.450053 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6c4d1-62e5-4f7b-9372-7557d7baa83e admin admin] PATH_INFO: `/v3/projects/3c8aad62b3e94634824e59d713e1f3fa` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:19.451439 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6c4d1-62e5-4f7b-9372-7557d7baa83e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c8aad62b3e94634824e59d713e1f3fa)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:19.453380 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6c4d1-62e5-4f7b-9372-7557d7baa83e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:19.505926 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fce6c4d1-62e5-4f7b-9372-7557d7baa83e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8aad62b3e94634824e59d713e1f3fa', 'request_id': 'req-fce6c4d1-62e5-4f7b-9372-7557d7baa83e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:19.511953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fce6c4d1-62e5-4f7b-9372-7557d7baa83e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8aad62b3e94634824e59d713e1f3fa', 'request_id': 'req-fce6c4d1-62e5-4f7b-9372-7557d7baa83e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:19.521547 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fce6c4d1-62e5-4f7b-9372-7557d7baa83e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8aad62b3e94634824e59d713e1f3fa', 'request_id': 'req-fce6c4d1-62e5-4f7b-9372-7557d7baa83e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:19.531554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fce6c4d1-62e5-4f7b-9372-7557d7baa83e admin admin] The token cache is being invalidate because project 3c8aad62b3e94634824e59d713e1f3fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:33:19.531835 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fce6c4d1-62e5-4f7b-9372-7557d7baa83e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:19.532436 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fce6c4d1-62e5-4f7b-9372-7557d7baa83e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:19.533981 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1410/2794] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:33:19 2022] DELETE /identity/v3/projects/3c8aad62b3e94634824e59d713e1f3fa => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:19.538212 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbaa81-286d-4204-953e-1277cb78390d service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:19.548572 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbaa81-286d-4204-953e-1277cb78390d service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:19.607059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669fe90-5398-4f3e-bb9d-58f32574133b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:19.607981 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669fe90-5398-4f3e-bb9d-58f32574133b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:19.608260 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669fe90-5398-4f3e-bb9d-58f32574133b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:19.608504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669fe90-5398-4f3e-bb9d-58f32574133b admin admin] PATH_INFO: `/v3/users/098aced9e10848be97c83153a0707c60` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:19.609738 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669fe90-5398-4f3e-bb9d-58f32574133b admin admin] RBAC: Authorizing `identity:delete_user(user_id=098aced9e10848be97c83153a0707c60)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:19.611700 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669fe90-5398-4f3e-bb9d-58f32574133b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:19.665151 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9669fe90-5398-4f3e-bb9d-58f32574133b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '098aced9e10848be97c83153a0707c60'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:19.676141 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9669fe90-5398-4f3e-bb9d-58f32574133b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '098aced9e10848be97c83153a0707c60'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:19.676716 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9669fe90-5398-4f3e-bb9d-58f32574133b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '098aced9e10848be97c83153a0707c60'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:19.677310 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9669fe90-5398-4f3e-bb9d-58f32574133b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '098aced9e10848be97c83153a0707c60'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:19.685795 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9669fe90-5398-4f3e-bb9d-58f32574133b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '098aced9e10848be97c83153a0707c60'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:19.697329 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1385/2795] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:33:19 2022] DELETE /identity/v3/users/098aced9e10848be97c83153a0707c60 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:19.982132 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6c4d1-62e5-4f7b-9372-7557d7baa83e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:19.983626 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fce6c4d1-62e5-4f7b-9372-7557d7baa83e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:19.997245 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6c4d1-62e5-4f7b-9372-7557d7baa83e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:20.068299 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f65ff4-4f20-4680-8a10-0f6a70d140a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:20.069175 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f65ff4-4f20-4680-8a10-0f6a70d140a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:20.069452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f65ff4-4f20-4680-8a10-0f6a70d140a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:20.069726 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f65ff4-4f20-4680-8a10-0f6a70d140a6 admin admin] PATH_INFO: `/v3/projects/e87dcd9cf3264c78a3cc5457a24cb92a` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:20.071078 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f65ff4-4f20-4680-8a10-0f6a70d140a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e87dcd9cf3264c78a3cc5457a24cb92a)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:20.073031 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f65ff4-4f20-4680-8a10-0f6a70d140a6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:20.122599 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-82f65ff4-4f20-4680-8a10-0f6a70d140a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e87dcd9cf3264c78a3cc5457a24cb92a', 'request_id': 'req-82f65ff4-4f20-4680-8a10-0f6a70d140a6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:20.128769 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-82f65ff4-4f20-4680-8a10-0f6a70d140a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e87dcd9cf3264c78a3cc5457a24cb92a', 'request_id': 'req-82f65ff4-4f20-4680-8a10-0f6a70d140a6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:20.139265 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-82f65ff4-4f20-4680-8a10-0f6a70d140a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e87dcd9cf3264c78a3cc5457a24cb92a', 'request_id': 'req-82f65ff4-4f20-4680-8a10-0f6a70d140a6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:20.150156 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-82f65ff4-4f20-4680-8a10-0f6a70d140a6 admin admin] The token cache is being invalidate because project e87dcd9cf3264c78a3cc5457a24cb92a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:33:20.150483 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-82f65ff4-4f20-4680-8a10-0f6a70d140a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:20.151164 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-82f65ff4-4f20-4680-8a10-0f6a70d140a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:20.152824 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1411/2796] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:33:19 2022] DELETE /identity/v3/projects/e87dcd9cf3264c78a3cc5457a24cb92a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:20.158061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50024b-b509-475b-af61-bc438fa3507e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:20.158349 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50024b-b509-475b-af61-bc438fa3507e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:20.158622 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50024b-b509-475b-af61-bc438fa3507e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:20.177970 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-4f50024b-b509-475b-af61-bc438fa3507e None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:20.179230 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4f50024b-b509-475b-af61-bc438fa3507e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:20.243565 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1386/2797] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:20.254882 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e44e7b-0a9c-461f-8565-1f49c7adf68c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:20.255201 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e44e7b-0a9c-461f-8565-1f49c7adf68c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:20.255473 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e44e7b-0a9c-461f-8565-1f49c7adf68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:20.275872 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f3e44e7b-0a9c-461f-8565-1f49c7adf68c None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:20.277070 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f3e44e7b-0a9c-461f-8565-1f49c7adf68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:20.286209 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1412/2798] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:20.290729 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50024b-b509-475b-af61-bc438fa3507e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:20.301054 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50024b-b509-475b-af61-bc438fa3507e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:20.306761 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c381070-8977-4aff-a754-038536f0bae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:20.307451 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c381070-8977-4aff-a754-038536f0bae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:20.307728 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c381070-8977-4aff-a754-038536f0bae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:20.307998 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c381070-8977-4aff-a754-038536f0bae2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:20.308731 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c381070-8977-4aff-a754-038536f0bae2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:33:20.309034 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c381070-8977-4aff-a754-038536f0bae2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:20.310641 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c381070-8977-4aff-a754-038536f0bae2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:20.323084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1387/2799] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 07:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:33:20.327483 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e44e7b-0a9c-461f-8565-1f49c7adf68c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:20.336908 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e44e7b-0a9c-461f-8565-1f49c7adf68c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:20.342369 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc93dcf-35b5-4ab4-a31a-6716bb2749ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:20.343026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc93dcf-35b5-4ab4-a31a-6716bb2749ce admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:20.343333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc93dcf-35b5-4ab4-a31a-6716bb2749ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:20.343601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc93dcf-35b5-4ab4-a31a-6716bb2749ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:20.344334 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc93dcf-35b5-4ab4-a31a-6716bb2749ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:20.346259 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc93dcf-35b5-4ab4-a31a-6716bb2749ce admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:20.375446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1413/2800] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:33:20 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:33:20.379733 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c381070-8977-4aff-a754-038536f0bae2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:20.390231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c381070-8977-4aff-a754-038536f0bae2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:20.447008 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23188941-4cc2-40ce-be7a-7ca646823381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:20.447682 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23188941-4cc2-40ce-be7a-7ca646823381 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:20.447959 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23188941-4cc2-40ce-be7a-7ca646823381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:20.448226 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23188941-4cc2-40ce-be7a-7ca646823381 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:20.448914 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23188941-4cc2-40ce-be7a-7ca646823381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:20.450865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23188941-4cc2-40ce-be7a-7ca646823381 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:20.471214 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1388/2801] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:33:20 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:33:20.476937 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc93dcf-35b5-4ab4-a31a-6716bb2749ce admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:20.487457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc93dcf-35b5-4ab4-a31a-6716bb2749ce admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:20.492896 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8bb39-0193-4306-9111-dbacf2c5fbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:20.493643 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8bb39-0193-4306-9111-dbacf2c5fbce admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:20.493853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8bb39-0193-4306-9111-dbacf2c5fbce admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:20.494133 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8bb39-0193-4306-9111-dbacf2c5fbce admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:20.494860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8bb39-0193-4306-9111-dbacf2c5fbce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:20.496502 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8bb39-0193-4306-9111-dbacf2c5fbce admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:20.506790 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1414/2802] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:33:20.511344 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23188941-4cc2-40ce-be7a-7ca646823381 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:20.528615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23188941-4cc2-40ce-be7a-7ca646823381 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:20.537780 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528935da-fe6e-4d39-a642-27215655ed20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:20.538710 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528935da-fe6e-4d39-a642-27215655ed20 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:20.539677 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528935da-fe6e-4d39-a642-27215655ed20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:20.539677 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528935da-fe6e-4d39-a642-27215655ed20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:20.540502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528935da-fe6e-4d39-a642-27215655ed20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:20.542487 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528935da-fe6e-4d39-a642-27215655ed20 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:20.552847 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1389/2803] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:33:20.557615 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8bb39-0193-4306-9111-dbacf2c5fbce admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:20.567982 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8bb39-0193-4306-9111-dbacf2c5fbce admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:20.573264 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35026a8a-76c8-4f43-868d-18fd2bf02ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:20.574148 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35026a8a-76c8-4f43-868d-18fd2bf02ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:20.574434 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35026a8a-76c8-4f43-868d-18fd2bf02ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:20.574713 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35026a8a-76c8-4f43-868d-18fd2bf02ca3 admin admin] PATH_INFO: `/v3/projects/42b18b3d39df410f92e7328a2b306597/users/9f699bf8db4c449292f6d23d150694e8/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:20.589799 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35026a8a-76c8-4f43-868d-18fd2bf02ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b18b3d39df410f92e7328a2b306597, user_id=9f699bf8db4c449292f6d23d150694e8, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:20.592497 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35026a8a-76c8-4f43-868d-18fd2bf02ca3 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:20.610869 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1415/2804] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:33:20 2022] PUT /identity/v3/projects/42b18b3d39df410f92e7328a2b306597/users/9f699bf8db4c449292f6d23d150694e8/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:20.628254 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da604b03-ba3d-43d5-b651-2585883e9949 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:20.628567 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da604b03-ba3d-43d5-b651-2585883e9949 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:20.628916 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da604b03-ba3d-43d5-b651-2585883e9949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:20.657647 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-da604b03-ba3d-43d5-b651-2585883e9949 None None] MFA Rules not processed for user `9f699bf8db4c449292f6d23d150694e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:20.658851 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-da604b03-ba3d-43d5-b651-2585883e9949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:20.733608 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1390/2805] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:20.739508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35026a8a-76c8-4f43-868d-18fd2bf02ca3 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:20.811202 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35026a8a-76c8-4f43-868d-18fd2bf02ca3 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:20.817584 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9dffaf-a017-405c-b436-265225eb8a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:20.818254 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9dffaf-a017-405c-b436-265225eb8a35 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:20.818501 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9dffaf-a017-405c-b436-265225eb8a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:20.818785 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9dffaf-a017-405c-b436-265225eb8a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:20.819510 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9dffaf-a017-405c-b436-265225eb8a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:20.821503 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9dffaf-a017-405c-b436-265225eb8a35 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:20.849795 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1416/2806] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:33:20 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:33:20.854627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da604b03-ba3d-43d5-b651-2585883e9949 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:20.869835 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da604b03-ba3d-43d5-b651-2585883e9949 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:20.925768 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735b1a2-4cc7-4979-8fcd-b394d705f379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:20.926466 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735b1a2-4cc7-4979-8fcd-b394d705f379 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:20.926744 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735b1a2-4cc7-4979-8fcd-b394d705f379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:20.927192 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735b1a2-4cc7-4979-8fcd-b394d705f379 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:20.927901 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735b1a2-4cc7-4979-8fcd-b394d705f379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:20.929789 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735b1a2-4cc7-4979-8fcd-b394d705f379 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:20.951688 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1391/2807] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:33:20 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:33:20.955691 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9dffaf-a017-405c-b436-265225eb8a35 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:20.966502 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9dffaf-a017-405c-b436-265225eb8a35 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:20.975105 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824017f3-0a8b-4475-b426-f69767249fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:20.976114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824017f3-0a8b-4475-b426-f69767249fae admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:20.976492 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824017f3-0a8b-4475-b426-f69767249fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:20.976871 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824017f3-0a8b-4475-b426-f69767249fae admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:20.978103 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824017f3-0a8b-4475-b426-f69767249fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:20.980530 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824017f3-0a8b-4475-b426-f69767249fae admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:21.002348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1417/2808] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:33:21.008578 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735b1a2-4cc7-4979-8fcd-b394d705f379 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:21.022601 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735b1a2-4cc7-4979-8fcd-b394d705f379 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:21.029713 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784700d-28e6-466c-9afa-755ef48238cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:21.030736 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784700d-28e6-466c-9afa-755ef48238cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:21.031080 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784700d-28e6-466c-9afa-755ef48238cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:21.031413 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784700d-28e6-466c-9afa-755ef48238cc admin admin] PATH_INFO: `/v3/projects/c6102377d0f5488cb75632072c976a9c/users/fa3fe98539f743378d1fd6b001206c13/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:21.055330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784700d-28e6-466c-9afa-755ef48238cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6102377d0f5488cb75632072c976a9c, user_id=fa3fe98539f743378d1fd6b001206c13, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:21.058111 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784700d-28e6-466c-9afa-755ef48238cc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:21.073525 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1392/2809] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:33:21 2022] PUT /identity/v3/projects/c6102377d0f5488cb75632072c976a9c/users/fa3fe98539f743378d1fd6b001206c13/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:21.077726 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824017f3-0a8b-4475-b426-f69767249fae admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:21.088870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824017f3-0a8b-4475-b426-f69767249fae admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:21.158075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c07460-75e0-484e-8676-fdd0f2f9d917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:21.158748 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c07460-75e0-484e-8676-fdd0f2f9d917 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:21.159061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c07460-75e0-484e-8676-fdd0f2f9d917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:21.159332 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c07460-75e0-484e-8676-fdd0f2f9d917 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:21.160063 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c07460-75e0-484e-8676-fdd0f2f9d917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:21.161683 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c07460-75e0-484e-8676-fdd0f2f9d917 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:21.171831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1418/2810] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:33:21.176373 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784700d-28e6-466c-9afa-755ef48238cc admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:21.187258 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784700d-28e6-466c-9afa-755ef48238cc admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:21.193167 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29b7d9-ba2b-4e2a-b6bc-9ffc0e93917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:21.194200 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29b7d9-ba2b-4e2a-b6bc-9ffc0e93917a admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:21.194473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29b7d9-ba2b-4e2a-b6bc-9ffc0e93917a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:21.194756 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29b7d9-ba2b-4e2a-b6bc-9ffc0e93917a admin admin] PATH_INFO: `/v3/projects/c6102377d0f5488cb75632072c976a9c/users/fa3fe98539f743378d1fd6b001206c13/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:21.197115 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29b7d9-ba2b-4e2a-b6bc-9ffc0e93917a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6102377d0f5488cb75632072c976a9c, user_id=fa3fe98539f743378d1fd6b001206c13, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:21.199785 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29b7d9-ba2b-4e2a-b6bc-9ffc0e93917a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:21.210990 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1393/2811] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:33:21 2022] PUT /identity/v3/projects/c6102377d0f5488cb75632072c976a9c/users/fa3fe98539f743378d1fd6b001206c13/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:21.221375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081b7fb-e11b-4529-9b6c-8b78d1719974 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:21.221665 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081b7fb-e11b-4529-9b6c-8b78d1719974 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:21.221943 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081b7fb-e11b-4529-9b6c-8b78d1719974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:21.249245 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a081b7fb-e11b-4529-9b6c-8b78d1719974 None None] MFA Rules not processed for user `fa3fe98539f743378d1fd6b001206c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:21.250448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a081b7fb-e11b-4529-9b6c-8b78d1719974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:21.319125 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1419/2812] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:21.330726 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29b7d9-ba2b-4e2a-b6bc-9ffc0e93917a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:21.332778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-df29b7d9-ba2b-4e2a-b6bc-9ffc0e93917a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:21.391257 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29b7d9-ba2b-4e2a-b6bc-9ffc0e93917a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:21.395594 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c7dca-a8f7-4b60-98eb-61390469017b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:21.396233 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c7dca-a8f7-4b60-98eb-61390469017b service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:21.396507 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c7dca-a8f7-4b60-98eb-61390469017b service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:21.396777 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c7dca-a8f7-4b60-98eb-61390469017b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:21.405905 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c7dca-a8f7-4b60-98eb-61390469017b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:21.407411 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c7dca-a8f7-4b60-98eb-61390469017b service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:21.416759 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1394/2813] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:33:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:33:21.501286 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081b7fb-e11b-4529-9b6c-8b78d1719974 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:21.511686 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081b7fb-e11b-4529-9b6c-8b78d1719974 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:21.516221 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354c930-bc2c-443d-9ca1-f987f9ac3973 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:21.516872 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354c930-bc2c-443d-9ca1-f987f9ac3973 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:21.517155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354c930-bc2c-443d-9ca1-f987f9ac3973 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:21.517432 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354c930-bc2c-443d-9ca1-f987f9ac3973 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:21.578272 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354c930-bc2c-443d-9ca1-f987f9ac3973 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:21.579680 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354c930-bc2c-443d-9ca1-f987f9ac3973 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:21.590052 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1420/2814] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:33:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:33:31.824218 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c7dca-a8f7-4b60-98eb-61390469017b service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:31.825760 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-417c7dca-a8f7-4b60-98eb-61390469017b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:31.884602 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c7dca-a8f7-4b60-98eb-61390469017b service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:31.888081 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8d522-1c13-4c59-8e74-2d5b8419683b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:31.888723 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8d522-1c13-4c59-8e74-2d5b8419683b service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:31.888998 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8d522-1c13-4c59-8e74-2d5b8419683b service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:31.889273 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8d522-1c13-4c59-8e74-2d5b8419683b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:31.891390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-06e8d522-1c13-4c59-8e74-2d5b8419683b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:31.901273 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8d522-1c13-4c59-8e74-2d5b8419683b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:31.902739 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8d522-1c13-4c59-8e74-2d5b8419683b service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:31.912217 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1395/2815] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:33:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:33:32.361043 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354c930-bc2c-443d-9ca1-f987f9ac3973 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:32.363128 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9354c930-bc2c-443d-9ca1-f987f9ac3973 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:32.432985 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354c930-bc2c-443d-9ca1-f987f9ac3973 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:32.438658 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723abbfc-1ef2-44ac-8663-03de2c28af53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46e2703839e498da8f3e2c3fda1d61c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:32.439416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723abbfc-1ef2-44ac-8663-03de2c28af53 service placement] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:32.439702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723abbfc-1ef2-44ac-8663-03de2c28af53 service placement] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:32.439978 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723abbfc-1ef2-44ac-8663-03de2c28af53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:32.441953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-723abbfc-1ef2-44ac-8663-03de2c28af53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:32.454550 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723abbfc-1ef2-44ac-8663-03de2c28af53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:32.456202 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723abbfc-1ef2-44ac-8663-03de2c28af53 service placement] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:32.466489 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1421/2816] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:33:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:33:34.612462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8d522-1c13-4c59-8e74-2d5b8419683b service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:34.679452 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8d522-1c13-4c59-8e74-2d5b8419683b service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:34.684678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5705b-fd70-4905-a488-99f056872c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:34.685561 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5705b-fd70-4905-a488-99f056872c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:34.685832 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5705b-fd70-4905-a488-99f056872c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:34.686103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5705b-fd70-4905-a488-99f056872c37 admin admin] PATH_INFO: `/v3/users/9f699bf8db4c449292f6d23d150694e8` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:34.687330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5705b-fd70-4905-a488-99f056872c37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f699bf8db4c449292f6d23d150694e8)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:34.689360 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5705b-fd70-4905-a488-99f056872c37 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:34.738379 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f9c5705b-fd70-4905-a488-99f056872c37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f699bf8db4c449292f6d23d150694e8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:34.750470 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f9c5705b-fd70-4905-a488-99f056872c37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f699bf8db4c449292f6d23d150694e8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:34.751213 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f9c5705b-fd70-4905-a488-99f056872c37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f699bf8db4c449292f6d23d150694e8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:34.751839 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f9c5705b-fd70-4905-a488-99f056872c37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f699bf8db4c449292f6d23d150694e8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:34.760688 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f9c5705b-fd70-4905-a488-99f056872c37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f699bf8db4c449292f6d23d150694e8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:34.773403 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1396/2817] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:33:34 2022] DELETE /identity/v3/users/9f699bf8db4c449292f6d23d150694e8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:34.778654 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af678931-b4db-4488-9205-7bbeb0e39236 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:34.779174 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af678931-b4db-4488-9205-7bbeb0e39236 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:34.779367 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af678931-b4db-4488-9205-7bbeb0e39236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:34.799603 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-af678931-b4db-4488-9205-7bbeb0e39236 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:34.800778 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-af678931-b4db-4488-9205-7bbeb0e39236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:34.867131 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1422/2818] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:34.876766 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5705b-fd70-4905-a488-99f056872c37 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:34.878395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f9c5705b-fd70-4905-a488-99f056872c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:34.944008 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5705b-fd70-4905-a488-99f056872c37 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:34.947877 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408620e-ec22-4e6f-9140-6bd56e473304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:34.948558 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408620e-ec22-4e6f-9140-6bd56e473304 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:34.948884 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408620e-ec22-4e6f-9140-6bd56e473304 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:34.949166 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408620e-ec22-4e6f-9140-6bd56e473304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:34.963317 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408620e-ec22-4e6f-9140-6bd56e473304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:34.964794 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408620e-ec22-4e6f-9140-6bd56e473304 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:34.975802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1397/2819] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:33:35.254995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af678931-b4db-4488-9205-7bbeb0e39236 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:35.256542 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-af678931-b4db-4488-9205-7bbeb0e39236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:35.286386 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af678931-b4db-4488-9205-7bbeb0e39236 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:35.306481 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d2949-45e7-4868-ad11-fd64b08d4dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:35.307694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d2949-45e7-4868-ad11-fd64b08d4dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:35.308077 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d2949-45e7-4868-ad11-fd64b08d4dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:35.308455 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d2949-45e7-4868-ad11-fd64b08d4dc4 admin admin] PATH_INFO: `/v3/projects/42b18b3d39df410f92e7328a2b306597` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:35.310558 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d2949-45e7-4868-ad11-fd64b08d4dc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42b18b3d39df410f92e7328a2b306597)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:35.314266 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d2949-45e7-4868-ad11-fd64b08d4dc4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:35.374619 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-829d2949-45e7-4868-ad11-fd64b08d4dc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b18b3d39df410f92e7328a2b306597', 'request_id': 'req-829d2949-45e7-4868-ad11-fd64b08d4dc4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:35.385046 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-829d2949-45e7-4868-ad11-fd64b08d4dc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b18b3d39df410f92e7328a2b306597', 'request_id': 'req-829d2949-45e7-4868-ad11-fd64b08d4dc4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:35.394647 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-829d2949-45e7-4868-ad11-fd64b08d4dc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b18b3d39df410f92e7328a2b306597', 'request_id': 'req-829d2949-45e7-4868-ad11-fd64b08d4dc4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:35.407182 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-829d2949-45e7-4868-ad11-fd64b08d4dc4 admin admin] The token cache is being invalidate because project 42b18b3d39df410f92e7328a2b306597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:33:35.407462 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-829d2949-45e7-4868-ad11-fd64b08d4dc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:35.408275 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-829d2949-45e7-4868-ad11-fd64b08d4dc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:35.415869 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1423/2820] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:33:35 2022] DELETE /identity/v3/projects/42b18b3d39df410f92e7328a2b306597 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:35.416101 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408620e-ec22-4e6f-9140-6bd56e473304 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:35.425493 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408620e-ec22-4e6f-9140-6bd56e473304 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:35.493714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98c8ff-3b90-40bc-80a7-103ba2727964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:35.494797 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98c8ff-3b90-40bc-80a7-103ba2727964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:35.495114 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98c8ff-3b90-40bc-80a7-103ba2727964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:35.495391 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98c8ff-3b90-40bc-80a7-103ba2727964 admin admin] PATH_INFO: `/v3/users/fa3fe98539f743378d1fd6b001206c13` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:35.496640 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98c8ff-3b90-40bc-80a7-103ba2727964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3fe98539f743378d1fd6b001206c13)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:35.498617 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98c8ff-3b90-40bc-80a7-103ba2727964 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:35.552721 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ac98c8ff-3b90-40bc-80a7-103ba2727964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3fe98539f743378d1fd6b001206c13'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:35.564521 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ac98c8ff-3b90-40bc-80a7-103ba2727964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3fe98539f743378d1fd6b001206c13'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:35.565504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ac98c8ff-3b90-40bc-80a7-103ba2727964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3fe98539f743378d1fd6b001206c13'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:35.565945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ac98c8ff-3b90-40bc-80a7-103ba2727964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3fe98539f743378d1fd6b001206c13'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:35.574061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ac98c8ff-3b90-40bc-80a7-103ba2727964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3fe98539f743378d1fd6b001206c13'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:35.586180 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1398/2821] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:33:35 2022] DELETE /identity/v3/users/fa3fe98539f743378d1fd6b001206c13 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:33:35.985024 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d2949-45e7-4868-ad11-fd64b08d4dc4 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:35.986514 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-829d2949-45e7-4868-ad11-fd64b08d4dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:36.004328 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d2949-45e7-4868-ad11-fd64b08d4dc4 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:36.070586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35f982-86cb-4ac9-8feb-ffec2e67e59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:36.071638 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35f982-86cb-4ac9-8feb-ffec2e67e59d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:36.071999 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35f982-86cb-4ac9-8feb-ffec2e67e59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:36.072308 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35f982-86cb-4ac9-8feb-ffec2e67e59d admin admin] PATH_INFO: `/v3/projects/c6102377d0f5488cb75632072c976a9c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:36.073658 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35f982-86cb-4ac9-8feb-ffec2e67e59d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6102377d0f5488cb75632072c976a9c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:36.075651 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35f982-86cb-4ac9-8feb-ffec2e67e59d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:36.127916 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3a35f982-86cb-4ac9-8feb-ffec2e67e59d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6102377d0f5488cb75632072c976a9c', 'request_id': 'req-3a35f982-86cb-4ac9-8feb-ffec2e67e59d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:36.139476 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3a35f982-86cb-4ac9-8feb-ffec2e67e59d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6102377d0f5488cb75632072c976a9c', 'request_id': 'req-3a35f982-86cb-4ac9-8feb-ffec2e67e59d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:36.155484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3a35f982-86cb-4ac9-8feb-ffec2e67e59d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6102377d0f5488cb75632072c976a9c', 'request_id': 'req-3a35f982-86cb-4ac9-8feb-ffec2e67e59d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:36.173469 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3a35f982-86cb-4ac9-8feb-ffec2e67e59d admin admin] The token cache is being invalidate because project c6102377d0f5488cb75632072c976a9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:33:36.173833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3a35f982-86cb-4ac9-8feb-ffec2e67e59d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:36.174576 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3a35f982-86cb-4ac9-8feb-ffec2e67e59d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:36.176433 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1424/2822] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:33:35 2022] DELETE /identity/v3/projects/c6102377d0f5488cb75632072c976a9c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:36.181306 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538e899-5b43-4740-8595-9550bd49d4f2 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:36.181836 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538e899-5b43-4740-8595-9550bd49d4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:36.181943 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538e899-5b43-4740-8595-9550bd49d4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:36.201084 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2538e899-5b43-4740-8595-9550bd49d4f2 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:36.202332 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2538e899-5b43-4740-8595-9550bd49d4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:36.262828 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1399/2823] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:36.272167 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7240a7-3fbd-4c39-8cb7-c17c9f502b11 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:36.272695 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7240a7-3fbd-4c39-8cb7-c17c9f502b11 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:36.273148 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7240a7-3fbd-4c39-8cb7-c17c9f502b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:36.301416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6a7240a7-3fbd-4c39-8cb7-c17c9f502b11 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:36.302864 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6a7240a7-3fbd-4c39-8cb7-c17c9f502b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:36.311620 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1425/2824] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:36.315886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538e899-5b43-4740-8595-9550bd49d4f2 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:36.325973 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538e899-5b43-4740-8595-9550bd49d4f2 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:36.330746 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cecee-47d5-4862-99b4-2f4b036d22c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:36.331459 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cecee-47d5-4862-99b4-2f4b036d22c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:36.331803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cecee-47d5-4862-99b4-2f4b036d22c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:36.332061 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cecee-47d5-4862-99b4-2f4b036d22c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:36.332801 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cecee-47d5-4862-99b4-2f4b036d22c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:33:36.333113 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cecee-47d5-4862-99b4-2f4b036d22c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:36.334722 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cecee-47d5-4862-99b4-2f4b036d22c2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:36.351365 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1400/2825] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 07:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:33:36.355764 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7240a7-3fbd-4c39-8cb7-c17c9f502b11 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:36.366785 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7240a7-3fbd-4c39-8cb7-c17c9f502b11 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:36.371554 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec2352-a092-4da1-b32a-d10467c4aec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:36.372224 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec2352-a092-4da1-b32a-d10467c4aec2 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:36.372507 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec2352-a092-4da1-b32a-d10467c4aec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:36.372780 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec2352-a092-4da1-b32a-d10467c4aec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:36.373484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec2352-a092-4da1-b32a-d10467c4aec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:36.375424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec2352-a092-4da1-b32a-d10467c4aec2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:36.402804 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1426/2826] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:33:36 2022] POST /identity/v3/projects => generated 357 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:33:36.407027 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cecee-47d5-4862-99b4-2f4b036d22c2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:36.416882 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cecee-47d5-4862-99b4-2f4b036d22c2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:36.469805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e640f-2958-40dd-901b-1090c28a8673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:36.470496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e640f-2958-40dd-901b-1090c28a8673 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:36.470751 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e640f-2958-40dd-901b-1090c28a8673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:36.471067 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e640f-2958-40dd-901b-1090c28a8673 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:36.471763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e640f-2958-40dd-901b-1090c28a8673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:36.473704 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e640f-2958-40dd-901b-1090c28a8673 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:36.494398 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1401/2827] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:33:36 2022] POST /identity/v3/users => generated 279 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:33:36.498622 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec2352-a092-4da1-b32a-d10467c4aec2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:36.509692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec2352-a092-4da1-b32a-d10467c4aec2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:36.515341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc52fd-6b77-4b20-a473-2c5215f72b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:36.516020 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc52fd-6b77-4b20-a473-2c5215f72b0e admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:36.516306 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc52fd-6b77-4b20-a473-2c5215f72b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:36.516582 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc52fd-6b77-4b20-a473-2c5215f72b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:36.517326 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc52fd-6b77-4b20-a473-2c5215f72b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:36.518934 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc52fd-6b77-4b20-a473-2c5215f72b0e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:36.529955 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1427/2828] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:33:36.533932 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e640f-2958-40dd-901b-1090c28a8673 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:36.544666 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e640f-2958-40dd-901b-1090c28a8673 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:36.549806 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c6bc0-08fb-40b6-bebb-16a81db8baa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:36.550483 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c6bc0-08fb-40b6-bebb-16a81db8baa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:36.550907 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c6bc0-08fb-40b6-bebb-16a81db8baa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:36.551200 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c6bc0-08fb-40b6-bebb-16a81db8baa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:36.551954 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c6bc0-08fb-40b6-bebb-16a81db8baa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:36.553560 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c6bc0-08fb-40b6-bebb-16a81db8baa6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:36.567146 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1402/2829] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:33:36.568402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc52fd-6b77-4b20-a473-2c5215f72b0e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:36.579342 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc52fd-6b77-4b20-a473-2c5215f72b0e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:36.585487 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce234b-f444-4242-bf5b-8bebe1b09107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:36.586708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce234b-f444-4242-bf5b-8bebe1b09107 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:36.587026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce234b-f444-4242-bf5b-8bebe1b09107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:36.587350 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce234b-f444-4242-bf5b-8bebe1b09107 admin admin] PATH_INFO: `/v3/projects/af12678500434b08946d98ccfd09d96a/users/b0cd3bdfe898412a8cfe24729671e2ca/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:36.603175 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce234b-f444-4242-bf5b-8bebe1b09107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af12678500434b08946d98ccfd09d96a, user_id=b0cd3bdfe898412a8cfe24729671e2ca, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:36.605786 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce234b-f444-4242-bf5b-8bebe1b09107 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:36.619839 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1428/2830] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:33:36 2022] PUT /identity/v3/projects/af12678500434b08946d98ccfd09d96a/users/b0cd3bdfe898412a8cfe24729671e2ca/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:36.679564 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fb5bc-43eb-4711-b7d7-d52c11e1c0a1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:36.679797 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fb5bc-43eb-4711-b7d7-d52c11e1c0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:36.679997 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fb5bc-43eb-4711-b7d7-d52c11e1c0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:36.707239 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c30fb5bc-43eb-4711-b7d7-d52c11e1c0a1 None None] MFA Rules not processed for user `b0cd3bdfe898412a8cfe24729671e2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:36.708455 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c30fb5bc-43eb-4711-b7d7-d52c11e1c0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:36.781330 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1403/2831] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:36 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:36.785995 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce234b-f444-4242-bf5b-8bebe1b09107 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:36.848671 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce234b-f444-4242-bf5b-8bebe1b09107 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:36.854260 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bbd49-175d-4c4d-9587-48aefa6d096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:36.854926 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bbd49-175d-4c4d-9587-48aefa6d096a admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:36.855344 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bbd49-175d-4c4d-9587-48aefa6d096a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:36.855616 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bbd49-175d-4c4d-9587-48aefa6d096a admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:36.856314 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bbd49-175d-4c4d-9587-48aefa6d096a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:36.858219 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bbd49-175d-4c4d-9587-48aefa6d096a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:36.887976 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1429/2832] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:33:36 2022] POST /identity/v3/projects => generated 353 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:33:36.889260 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fb5bc-43eb-4711-b7d7-d52c11e1c0a1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:36.902261 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fb5bc-43eb-4711-b7d7-d52c11e1c0a1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:36.956635 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be577b36-3e2a-4e7a-98ad-72e1e38c19a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:36.957316 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be577b36-3e2a-4e7a-98ad-72e1e38c19a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:36.957596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be577b36-3e2a-4e7a-98ad-72e1e38c19a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:36.957869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be577b36-3e2a-4e7a-98ad-72e1e38c19a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:36.958549 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be577b36-3e2a-4e7a-98ad-72e1e38c19a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:36.960474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be577b36-3e2a-4e7a-98ad-72e1e38c19a2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:36.984210 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1404/2833] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:33:36 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:33:36.985465 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bbd49-175d-4c4d-9587-48aefa6d096a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:36.995931 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bbd49-175d-4c4d-9587-48aefa6d096a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:37.001187 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484afb94-13d0-48b6-b78e-aa807d462e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:37.001870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484afb94-13d0-48b6-b78e-aa807d462e30 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:37.002180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484afb94-13d0-48b6-b78e-aa807d462e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:37.002455 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484afb94-13d0-48b6-b78e-aa807d462e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:37.003237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484afb94-13d0-48b6-b78e-aa807d462e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:37.004875 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484afb94-13d0-48b6-b78e-aa807d462e30 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:37.019279 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1430/2834] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:33:37.020623 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be577b36-3e2a-4e7a-98ad-72e1e38c19a2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:37.030924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be577b36-3e2a-4e7a-98ad-72e1e38c19a2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:37.036016 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81add63-11cb-4e5d-89eb-2d61826aa2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:37.036920 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81add63-11cb-4e5d-89eb-2d61826aa2af admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:37.037303 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81add63-11cb-4e5d-89eb-2d61826aa2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:37.037587 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81add63-11cb-4e5d-89eb-2d61826aa2af admin admin] PATH_INFO: `/v3/projects/3f6d316601cb40c686e765a80d1a2586/users/5c2ea0444c904db29330910d364da52e/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:37.054144 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81add63-11cb-4e5d-89eb-2d61826aa2af admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f6d316601cb40c686e765a80d1a2586, user_id=5c2ea0444c904db29330910d364da52e, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:37.056877 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81add63-11cb-4e5d-89eb-2d61826aa2af admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:37.070790 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1405/2835] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:33:37 2022] PUT /identity/v3/projects/3f6d316601cb40c686e765a80d1a2586/users/5c2ea0444c904db29330910d364da52e/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:33:37.074860 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484afb94-13d0-48b6-b78e-aa807d462e30 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:37.084853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484afb94-13d0-48b6-b78e-aa807d462e30 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:37.142138 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6caaf38-9d6d-42fe-b5c3-03ec842bfbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:37.142841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6caaf38-9d6d-42fe-b5c3-03ec842bfbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:37.143167 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6caaf38-9d6d-42fe-b5c3-03ec842bfbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:37.143441 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6caaf38-9d6d-42fe-b5c3-03ec842bfbc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:37.144180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6caaf38-9d6d-42fe-b5c3-03ec842bfbc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:37.145778 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6caaf38-9d6d-42fe-b5c3-03ec842bfbc9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:37.160977 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1431/2836] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:33:37.167838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81add63-11cb-4e5d-89eb-2d61826aa2af admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:37.180030 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81add63-11cb-4e5d-89eb-2d61826aa2af admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:37.185582 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57e0dc-dfbb-4e5d-9cba-b8337585bcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:37.186490 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57e0dc-dfbb-4e5d-9cba-b8337585bcf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:37.186766 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57e0dc-dfbb-4e5d-9cba-b8337585bcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:37.187071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57e0dc-dfbb-4e5d-9cba-b8337585bcf7 admin admin] PATH_INFO: `/v3/projects/3f6d316601cb40c686e765a80d1a2586/users/5c2ea0444c904db29330910d364da52e/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:37.189244 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57e0dc-dfbb-4e5d-9cba-b8337585bcf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f6d316601cb40c686e765a80d1a2586, user_id=5c2ea0444c904db29330910d364da52e, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:37.191918 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57e0dc-dfbb-4e5d-9cba-b8337585bcf7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:37.203191 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1406/2837] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:33:37 2022] PUT /identity/v3/projects/3f6d316601cb40c686e765a80d1a2586/users/5c2ea0444c904db29330910d364da52e/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:33:37.213792 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4700484-1a98-4ae6-92aa-da616306fcbd None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:37.214080 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4700484-1a98-4ae6-92aa-da616306fcbd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:37.214363 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4700484-1a98-4ae6-92aa-da616306fcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:37.245093 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c4700484-1a98-4ae6-92aa-da616306fcbd None None] MFA Rules not processed for user `5c2ea0444c904db29330910d364da52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:37.246301 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c4700484-1a98-4ae6-92aa-da616306fcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:37.319160 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1432/2838] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:37 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:37.330834 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57e0dc-dfbb-4e5d-9cba-b8337585bcf7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:37.332734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5b57e0dc-dfbb-4e5d-9cba-b8337585bcf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:37.393031 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57e0dc-dfbb-4e5d-9cba-b8337585bcf7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:37.397872 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bf1e9-4d83-4a0b-a455-819b9b208ae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:37.398530 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bf1e9-4d83-4a0b-a455-819b9b208ae3 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:37.398804 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bf1e9-4d83-4a0b-a455-819b9b208ae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:37.399195 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bf1e9-4d83-4a0b-a455-819b9b208ae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:37.409062 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bf1e9-4d83-4a0b-a455-819b9b208ae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:37.410479 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bf1e9-4d83-4a0b-a455-819b9b208ae3 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:37.420095 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1407/2839] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:33:37 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:33:37.498953 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4700484-1a98-4ae6-92aa-da616306fcbd None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:37.508875 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4700484-1a98-4ae6-92aa-da616306fcbd None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:37.512632 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057ffb5-9dbe-4048-b992-3993ead72eb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:37.513303 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057ffb5-9dbe-4048-b992-3993ead72eb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:37.513580 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057ffb5-9dbe-4048-b992-3993ead72eb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:37.513848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057ffb5-9dbe-4048-b992-3993ead72eb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:37.572634 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057ffb5-9dbe-4048-b992-3993ead72eb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:37.574001 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057ffb5-9dbe-4048-b992-3993ead72eb4 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:37.583601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1433/2840] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:33:37 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:33:49.118990 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bf1e9-4d83-4a0b-a455-819b9b208ae3 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:49.120560 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f54bf1e9-4d83-4a0b-a455-819b9b208ae3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:49.202512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bf1e9-4d83-4a0b-a455-819b9b208ae3 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:49.208209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a1182-dbce-4d8a-99e6-075bf29d358f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:49.208869 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a1182-dbce-4d8a-99e6-075bf29d358f service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:49.209149 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a1182-dbce-4d8a-99e6-075bf29d358f service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:49.209425 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a1182-dbce-4d8a-99e6-075bf29d358f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:49.212451 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1c9a1182-dbce-4d8a-99e6-075bf29d358f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:49.224254 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a1182-dbce-4d8a-99e6-075bf29d358f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:49.225837 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a1182-dbce-4d8a-99e6-075bf29d358f service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:49.236288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1408/2841] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:33:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:33:52.455825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057ffb5-9dbe-4048-b992-3993ead72eb4 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:52.489138 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a1182-dbce-4d8a-99e6-075bf29d358f service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:52.490866 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1c9a1182-dbce-4d8a-99e6-075bf29d358f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:52.528137 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057ffb5-9dbe-4048-b992-3993ead72eb4 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:52.533417 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dd990-4167-4930-8832-21f4369e496b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:52.534297 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dd990-4167-4930-8832-21f4369e496b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:52.534575 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dd990-4167-4930-8832-21f4369e496b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:52.534845 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dd990-4167-4930-8832-21f4369e496b admin admin] PATH_INFO: `/v3/users/b0cd3bdfe898412a8cfe24729671e2ca` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:52.536075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650dd990-4167-4930-8832-21f4369e496b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0cd3bdfe898412a8cfe24729671e2ca)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:52.537991 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650dd990-4167-4930-8832-21f4369e496b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:52.546265 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a1182-dbce-4d8a-99e6-075bf29d358f service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:52.549996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fb74f-281b-4170-9a0f-d6ddc8dcbdcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:52.550689 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fb74f-281b-4170-9a0f-d6ddc8dcbdcf service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:52.550996 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fb74f-281b-4170-9a0f-d6ddc8dcbdcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:52.551320 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fb74f-281b-4170-9a0f-d6ddc8dcbdcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:52.553154 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-925fb74f-281b-4170-9a0f-d6ddc8dcbdcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:52.585518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-650dd990-4167-4930-8832-21f4369e496b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0cd3bdfe898412a8cfe24729671e2ca'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:52.600287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-650dd990-4167-4930-8832-21f4369e496b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0cd3bdfe898412a8cfe24729671e2ca'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:52.601042 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-650dd990-4167-4930-8832-21f4369e496b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0cd3bdfe898412a8cfe24729671e2ca'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:52.601638 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-650dd990-4167-4930-8832-21f4369e496b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0cd3bdfe898412a8cfe24729671e2ca'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:52.609820 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-650dd990-4167-4930-8832-21f4369e496b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0cd3bdfe898412a8cfe24729671e2ca'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:52.617104 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fb74f-281b-4170-9a0f-d6ddc8dcbdcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:52.618660 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fb74f-281b-4170-9a0f-d6ddc8dcbdcf service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:52.622971 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1434/2842] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:33:52 2022] DELETE /identity/v3/users/b0cd3bdfe898412a8cfe24729671e2ca => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:52.627454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297f470-bf20-414d-83f4-f5e1526d28bb None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:52.627751 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297f470-bf20-414d-83f4-f5e1526d28bb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:52.628026 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297f470-bf20-414d-83f4-f5e1526d28bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:52.629138 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1409/2843] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:33:52 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:33:52.645744 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6297f470-bf20-414d-83f4-f5e1526d28bb None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:52.646978 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6297f470-bf20-414d-83f4-f5e1526d28bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:52.704006 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1435/2844] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:52.713697 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fb74f-281b-4170-9a0f-d6ddc8dcbdcf service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:52.715159 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-925fb74f-281b-4170-9a0f-d6ddc8dcbdcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:52.726034 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fb74f-281b-4170-9a0f-d6ddc8dcbdcf service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:52.773151 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d1377-9113-4323-af06-18c9b195e26a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:52.773855 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d1377-9113-4323-af06-18c9b195e26a service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:52.774130 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d1377-9113-4323-af06-18c9b195e26a service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:52.774401 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d1377-9113-4323-af06-18c9b195e26a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:52.783786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d1377-9113-4323-af06-18c9b195e26a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:52.785374 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d1377-9113-4323-af06-18c9b195e26a service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:52.796992 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1410/2845] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:33:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:33:53.060850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297f470-bf20-414d-83f4-f5e1526d28bb None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:53.062598 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6297f470-bf20-414d-83f4-f5e1526d28bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:53.081776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297f470-bf20-414d-83f4-f5e1526d28bb None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:53.088083 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07dbd5-6a24-4260-abfe-4eb2834e19d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:53.089070 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07dbd5-6a24-4260-abfe-4eb2834e19d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:53.089360 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07dbd5-6a24-4260-abfe-4eb2834e19d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:53.089638 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07dbd5-6a24-4260-abfe-4eb2834e19d5 admin admin] PATH_INFO: `/v3/projects/af12678500434b08946d98ccfd09d96a` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:53.091097 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07dbd5-6a24-4260-abfe-4eb2834e19d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af12678500434b08946d98ccfd09d96a)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:53.092955 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07dbd5-6a24-4260-abfe-4eb2834e19d5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:53.140927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3e07dbd5-6a24-4260-abfe-4eb2834e19d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af12678500434b08946d98ccfd09d96a', 'request_id': 'req-3e07dbd5-6a24-4260-abfe-4eb2834e19d5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:53.146988 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3e07dbd5-6a24-4260-abfe-4eb2834e19d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af12678500434b08946d98ccfd09d96a', 'request_id': 'req-3e07dbd5-6a24-4260-abfe-4eb2834e19d5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:53.155094 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3e07dbd5-6a24-4260-abfe-4eb2834e19d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af12678500434b08946d98ccfd09d96a', 'request_id': 'req-3e07dbd5-6a24-4260-abfe-4eb2834e19d5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:53.165215 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3e07dbd5-6a24-4260-abfe-4eb2834e19d5 admin admin] The token cache is being invalidate because project af12678500434b08946d98ccfd09d96a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:33:53.165497 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3e07dbd5-6a24-4260-abfe-4eb2834e19d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:53.166126 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3e07dbd5-6a24-4260-abfe-4eb2834e19d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:53.167742 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1436/2846] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:33:53 2022] DELETE /identity/v3/projects/af12678500434b08946d98ccfd09d96a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:53.171758 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d1377-9113-4323-af06-18c9b195e26a service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:53.181271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d1377-9113-4323-af06-18c9b195e26a service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:53.239763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a57a0-f2c6-4b13-b2dd-3508320445ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:53.240644 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a57a0-f2c6-4b13-b2dd-3508320445ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:53.240929 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a57a0-f2c6-4b13-b2dd-3508320445ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:53.241177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a57a0-f2c6-4b13-b2dd-3508320445ba admin admin] PATH_INFO: `/v3/users/5c2ea0444c904db29330910d364da52e` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:53.242439 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a57a0-f2c6-4b13-b2dd-3508320445ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c2ea0444c904db29330910d364da52e)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:53.244458 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a57a0-f2c6-4b13-b2dd-3508320445ba admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:53.294845 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8b2a57a0-f2c6-4b13-b2dd-3508320445ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c2ea0444c904db29330910d364da52e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:53.308277 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8b2a57a0-f2c6-4b13-b2dd-3508320445ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c2ea0444c904db29330910d364da52e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:53.309089 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8b2a57a0-f2c6-4b13-b2dd-3508320445ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c2ea0444c904db29330910d364da52e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:53.309724 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8b2a57a0-f2c6-4b13-b2dd-3508320445ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c2ea0444c904db29330910d364da52e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:53.318880 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8b2a57a0-f2c6-4b13-b2dd-3508320445ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c2ea0444c904db29330910d364da52e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:53.330675 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1411/2847] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:33:53 2022] DELETE /identity/v3/users/5c2ea0444c904db29330910d364da52e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:53.599630 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07dbd5-6a24-4260-abfe-4eb2834e19d5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:53.601153 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3e07dbd5-6a24-4260-abfe-4eb2834e19d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:53.628297 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07dbd5-6a24-4260-abfe-4eb2834e19d5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:53.685393 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba24a5-e797-4555-96ff-863db9adcd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:53.686274 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba24a5-e797-4555-96ff-863db9adcd0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:53.686555 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba24a5-e797-4555-96ff-863db9adcd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:53.686826 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba24a5-e797-4555-96ff-863db9adcd0e admin admin] PATH_INFO: `/v3/projects/3f6d316601cb40c686e765a80d1a2586` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:53.688072 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba24a5-e797-4555-96ff-863db9adcd0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f6d316601cb40c686e765a80d1a2586)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:53.690004 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba24a5-e797-4555-96ff-863db9adcd0e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:53.749696 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8bba24a5-e797-4555-96ff-863db9adcd0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f6d316601cb40c686e765a80d1a2586', 'request_id': 'req-8bba24a5-e797-4555-96ff-863db9adcd0e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:53.756771 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8bba24a5-e797-4555-96ff-863db9adcd0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f6d316601cb40c686e765a80d1a2586', 'request_id': 'req-8bba24a5-e797-4555-96ff-863db9adcd0e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:53.765886 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8bba24a5-e797-4555-96ff-863db9adcd0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f6d316601cb40c686e765a80d1a2586', 'request_id': 'req-8bba24a5-e797-4555-96ff-863db9adcd0e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:53.777236 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8bba24a5-e797-4555-96ff-863db9adcd0e admin admin] The token cache is being invalidate because project 3f6d316601cb40c686e765a80d1a2586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:33:53.777520 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8bba24a5-e797-4555-96ff-863db9adcd0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:53.778149 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8bba24a5-e797-4555-96ff-863db9adcd0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:53.780007 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1437/2848] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:33:53 2022] DELETE /identity/v3/projects/3f6d316601cb40c686e765a80d1a2586 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:53.784678 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eec175-46a4-41e7-97fc-3ff0466beead None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:53.785189 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eec175-46a4-41e7-97fc-3ff0466beead None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:53.785189 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eec175-46a4-41e7-97fc-3ff0466beead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:53.804405 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e3eec175-46a4-41e7-97fc-3ff0466beead None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:53.805512 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e3eec175-46a4-41e7-97fc-3ff0466beead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:53.867103 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1412/2849] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:33:53.874788 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b4801-5908-4f2d-ab30-583383b09f61 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:53.875111 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b4801-5908-4f2d-ab30-583383b09f61 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:53.875390 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b4801-5908-4f2d-ab30-583383b09f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:53.893990 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1c3b4801-5908-4f2d-ab30-583383b09f61 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:53.895287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1c3b4801-5908-4f2d-ab30-583383b09f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:53.904329 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1438/2850] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:53.908675 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eec175-46a4-41e7-97fc-3ff0466beead None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:53.918454 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eec175-46a4-41e7-97fc-3ff0466beead None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:53.923096 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023671e9-c367-4d38-9917-edd98f08ef17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:53.923775 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023671e9-c367-4d38-9917-edd98f08ef17 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:53.924066 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023671e9-c367-4d38-9917-edd98f08ef17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:53.924334 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023671e9-c367-4d38-9917-edd98f08ef17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:53.925095 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023671e9-c367-4d38-9917-edd98f08ef17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:33:53.925400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023671e9-c367-4d38-9917-edd98f08ef17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:53.927016 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023671e9-c367-4d38-9917-edd98f08ef17 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:53.939012 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1413/2851] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 07:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:33:53.943335 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b4801-5908-4f2d-ab30-583383b09f61 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:53.952957 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b4801-5908-4f2d-ab30-583383b09f61 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:53.958246 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7173f8-969d-45b2-ad5b-e6e294fb57c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:53.958911 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7173f8-969d-45b2-ad5b-e6e294fb57c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:53.959231 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7173f8-969d-45b2-ad5b-e6e294fb57c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:53.959510 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7173f8-969d-45b2-ad5b-e6e294fb57c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:53.960221 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7173f8-969d-45b2-ad5b-e6e294fb57c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:53.962216 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7173f8-969d-45b2-ad5b-e6e294fb57c2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:53.993240 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1439/2852] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:33:53 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:33:53.994334 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023671e9-c367-4d38-9917-edd98f08ef17 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:54.004864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023671e9-c367-4d38-9917-edd98f08ef17 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:54.066468 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7fa2b-e46c-453e-bcfb-d2a44a352636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:54.067181 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7fa2b-e46c-453e-bcfb-d2a44a352636 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:54.067465 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7fa2b-e46c-453e-bcfb-d2a44a352636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:54.067742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7fa2b-e46c-453e-bcfb-d2a44a352636 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:54.068440 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7fa2b-e46c-453e-bcfb-d2a44a352636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:54.070395 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7fa2b-e46c-453e-bcfb-d2a44a352636 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:54.099927 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1414/2853] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:33:53 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:33:54.101234 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7173f8-969d-45b2-ad5b-e6e294fb57c2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:54.111661 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7173f8-969d-45b2-ad5b-e6e294fb57c2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:54.117623 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5910ba-dbfe-40e8-ae09-69e7b2e05b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:54.118396 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5910ba-dbfe-40e8-ae09-69e7b2e05b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:54.118677 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5910ba-dbfe-40e8-ae09-69e7b2e05b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:54.118948 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5910ba-dbfe-40e8-ae09-69e7b2e05b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:54.119706 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5910ba-dbfe-40e8-ae09-69e7b2e05b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:54.121308 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5910ba-dbfe-40e8-ae09-69e7b2e05b3e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:54.132370 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1440/2854] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:33:54.136620 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7fa2b-e46c-453e-bcfb-d2a44a352636 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:54.147139 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7fa2b-e46c-453e-bcfb-d2a44a352636 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:54.151950 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0865c82-f1b2-4235-b919-227a710cc24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:54.152612 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0865c82-f1b2-4235-b919-227a710cc24f admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:54.152896 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0865c82-f1b2-4235-b919-227a710cc24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:54.153174 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0865c82-f1b2-4235-b919-227a710cc24f admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:54.153930 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0865c82-f1b2-4235-b919-227a710cc24f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:54.155564 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0865c82-f1b2-4235-b919-227a710cc24f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:54.167209 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1415/2855] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:33:54.171559 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5910ba-dbfe-40e8-ae09-69e7b2e05b3e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:54.181806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5910ba-dbfe-40e8-ae09-69e7b2e05b3e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:54.186727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562fe069-fc8f-41a5-a5c6-4d7a5d5e007c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:54.187650 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fe069-fc8f-41a5-a5c6-4d7a5d5e007c admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:54.187933 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fe069-fc8f-41a5-a5c6-4d7a5d5e007c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:54.188210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fe069-fc8f-41a5-a5c6-4d7a5d5e007c admin admin] PATH_INFO: `/v3/projects/efd7b8b621d64da0aa7cdcf0296f5b52/users/30b24d0c2ce74218ae5ac7d4255ee053/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:54.206353 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562fe069-fc8f-41a5-a5c6-4d7a5d5e007c admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd7b8b621d64da0aa7cdcf0296f5b52, user_id=30b24d0c2ce74218ae5ac7d4255ee053, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:54.209061 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562fe069-fc8f-41a5-a5c6-4d7a5d5e007c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:54.222839 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1441/2856] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:33:54 2022] PUT /identity/v3/projects/efd7b8b621d64da0aa7cdcf0296f5b52/users/30b24d0c2ce74218ae5ac7d4255ee053/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:54.233382 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe61f11-f17d-4b30-a871-24101928e4e9 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:54.233668 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe61f11-f17d-4b30-a871-24101928e4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:54.233949 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe61f11-f17d-4b30-a871-24101928e4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:54.267781 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fbe61f11-f17d-4b30-a871-24101928e4e9 None None] MFA Rules not processed for user `30b24d0c2ce74218ae5ac7d4255ee053`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:54.269698 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fbe61f11-f17d-4b30-a871-24101928e4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:54.293410 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562fe069-fc8f-41a5-a5c6-4d7a5d5e007c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:54.293410 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-562fe069-fc8f-41a5-a5c6-4d7a5d5e007c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:54.348719 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1416/2857] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:54.349968 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe61f11-f17d-4b30-a871-24101928e4e9 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:54.367637 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562fe069-fc8f-41a5-a5c6-4d7a5d5e007c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:54.373364 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a0b83-867d-44f4-8c16-87d75a92bca1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:54.374039 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a0b83-867d-44f4-8c16-87d75a92bca1 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:54.374315 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a0b83-867d-44f4-8c16-87d75a92bca1 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:54.374589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a0b83-867d-44f4-8c16-87d75a92bca1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:54.376569 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a78a0b83-867d-44f4-8c16-87d75a92bca1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:54.390423 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a0b83-867d-44f4-8c16-87d75a92bca1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:54.392067 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a0b83-867d-44f4-8c16-87d75a92bca1 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:54.403621 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1442/2858] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:33:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:33:54.426377 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe61f11-f17d-4b30-a871-24101928e4e9 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:54.431543 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6f917-124d-41bb-b551-fbf9204479aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:54.433627 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6f917-124d-41bb-b551-fbf9204479aa admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:54.433988 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6f917-124d-41bb-b551-fbf9204479aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:54.434327 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6f917-124d-41bb-b551-fbf9204479aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:54.435621 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6f917-124d-41bb-b551-fbf9204479aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:54.437681 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6f917-124d-41bb-b551-fbf9204479aa admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:54.464462 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1417/2859] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:33:54 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:33:54.468551 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a0b83-867d-44f4-8c16-87d75a92bca1 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:54.479544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a0b83-867d-44f4-8c16-87d75a92bca1 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:54.545518 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084e2e8-0e0e-477d-b5b4-5e2d08e2fa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:54.546209 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084e2e8-0e0e-477d-b5b4-5e2d08e2fa0b admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:54.546499 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084e2e8-0e0e-477d-b5b4-5e2d08e2fa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:54.546776 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084e2e8-0e0e-477d-b5b4-5e2d08e2fa0b admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:54.547546 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084e2e8-0e0e-477d-b5b4-5e2d08e2fa0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:54.549471 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084e2e8-0e0e-477d-b5b4-5e2d08e2fa0b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:54.574588 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1443/2860] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:33:54 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:33:54.575826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6f917-124d-41bb-b551-fbf9204479aa admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:54.587727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6f917-124d-41bb-b551-fbf9204479aa admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:54.602888 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382db6b4-f0e8-402e-84bc-b26b09148167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:54.603737 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382db6b4-f0e8-402e-84bc-b26b09148167 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:54.604211 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382db6b4-f0e8-402e-84bc-b26b09148167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:54.604557 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382db6b4-f0e8-402e-84bc-b26b09148167 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:54.605474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382db6b4-f0e8-402e-84bc-b26b09148167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:54.607179 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382db6b4-f0e8-402e-84bc-b26b09148167 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:54.621592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1418/2861] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:33:54.623392 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084e2e8-0e0e-477d-b5b4-5e2d08e2fa0b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:54.633475 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084e2e8-0e0e-477d-b5b4-5e2d08e2fa0b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:54.638990 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a86f8a-00a5-42df-b3e4-286fb39bb15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:54.640316 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a86f8a-00a5-42df-b3e4-286fb39bb15b admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:54.640678 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a86f8a-00a5-42df-b3e4-286fb39bb15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:54.641277 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a86f8a-00a5-42df-b3e4-286fb39bb15b admin admin] PATH_INFO: `/v3/projects/9ba2773141d24b0a944bea70a1fa7e7b/users/0c34a2daf0f249a98846d6991e4e9907/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:54.659191 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a86f8a-00a5-42df-b3e4-286fb39bb15b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba2773141d24b0a944bea70a1fa7e7b, user_id=0c34a2daf0f249a98846d6991e4e9907, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:54.662601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a86f8a-00a5-42df-b3e4-286fb39bb15b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:54.679824 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1444/2862] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:33:54 2022] PUT /identity/v3/projects/9ba2773141d24b0a944bea70a1fa7e7b/users/0c34a2daf0f249a98846d6991e4e9907/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:54.684152 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382db6b4-f0e8-402e-84bc-b26b09148167 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:54.694875 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382db6b4-f0e8-402e-84bc-b26b09148167 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:54.754073 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf67867-ecee-4094-a334-b0a938a17460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:54.755092 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf67867-ecee-4094-a334-b0a938a17460 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:54.755370 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf67867-ecee-4094-a334-b0a938a17460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:54.755643 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf67867-ecee-4094-a334-b0a938a17460 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:54.756369 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf67867-ecee-4094-a334-b0a938a17460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:54.758004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf67867-ecee-4094-a334-b0a938a17460 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:54.770945 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1419/2863] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:33:54.772697 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a86f8a-00a5-42df-b3e4-286fb39bb15b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:54.784484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a86f8a-00a5-42df-b3e4-286fb39bb15b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:54.791286 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4e373-841c-4d57-b002-c936adef99cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:54.792921 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4e373-841c-4d57-b002-c936adef99cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:54.793525 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4e373-841c-4d57-b002-c936adef99cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:54.794076 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4e373-841c-4d57-b002-c936adef99cb admin admin] PATH_INFO: `/v3/projects/9ba2773141d24b0a944bea70a1fa7e7b/users/0c34a2daf0f249a98846d6991e4e9907/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:54.796282 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4e373-841c-4d57-b002-c936adef99cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba2773141d24b0a944bea70a1fa7e7b, user_id=0c34a2daf0f249a98846d6991e4e9907, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:54.799368 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4e373-841c-4d57-b002-c936adef99cb admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:54.810859 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1445/2864] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:33:54 2022] PUT /identity/v3/projects/9ba2773141d24b0a944bea70a1fa7e7b/users/0c34a2daf0f249a98846d6991e4e9907/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:54.821990 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1684e-9c7d-432f-956c-4f23de8826d1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:54.822474 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1684e-9c7d-432f-956c-4f23de8826d1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:54.822566 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1684e-9c7d-432f-956c-4f23de8826d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:54.849577 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e4f1684e-9c7d-432f-956c-4f23de8826d1 None None] MFA Rules not processed for user `0c34a2daf0f249a98846d6991e4e9907`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:54.850788 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e4f1684e-9c7d-432f-956c-4f23de8826d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:54.923173 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1420/2865] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:54 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:54.934541 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4e373-841c-4d57-b002-c936adef99cb admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:54.936381 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f0b4e373-841c-4d57-b002-c936adef99cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:54.994876 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4e373-841c-4d57-b002-c936adef99cb admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:54.998841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261b64a-ea53-46af-87e2-dd8dfdf4a212 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:54.999611 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261b64a-ea53-46af-87e2-dd8dfdf4a212 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:54.999899 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261b64a-ea53-46af-87e2-dd8dfdf4a212 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:55.000178 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261b64a-ea53-46af-87e2-dd8dfdf4a212 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:55.010054 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261b64a-ea53-46af-87e2-dd8dfdf4a212 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:55.011534 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261b64a-ea53-46af-87e2-dd8dfdf4a212 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:55.023524 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1446/2866] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:33:54 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:33:55.102738 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1684e-9c7d-432f-956c-4f23de8826d1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:55.113496 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1684e-9c7d-432f-956c-4f23de8826d1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:55.117676 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019904ab-e81c-4b8c-9898-19a9a00e00c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:55.118328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019904ab-e81c-4b8c-9898-19a9a00e00c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:55.118607 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019904ab-e81c-4b8c-9898-19a9a00e00c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:55.118878 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019904ab-e81c-4b8c-9898-19a9a00e00c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:55.179033 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019904ab-e81c-4b8c-9898-19a9a00e00c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:55.180494 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019904ab-e81c-4b8c-9898-19a9a00e00c8 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:55.190076 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1421/2867] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:33:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:33:57.946827 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261b64a-ea53-46af-87e2-dd8dfdf4a212 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:58.011628 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261b64a-ea53-46af-87e2-dd8dfdf4a212 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:58.017585 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee2227-10a2-4b55-b209-453b48d7bf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:58.018467 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee2227-10a2-4b55-b209-453b48d7bf17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:58.018731 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee2227-10a2-4b55-b209-453b48d7bf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:58.019050 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee2227-10a2-4b55-b209-453b48d7bf17 admin admin] PATH_INFO: `/v3/users/30b24d0c2ce74218ae5ac7d4255ee053` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:58.020355 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee2227-10a2-4b55-b209-453b48d7bf17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30b24d0c2ce74218ae5ac7d4255ee053)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:58.022282 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee2227-10a2-4b55-b209-453b48d7bf17 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:58.077446 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c6ee2227-10a2-4b55-b209-453b48d7bf17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30b24d0c2ce74218ae5ac7d4255ee053'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:58.089459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c6ee2227-10a2-4b55-b209-453b48d7bf17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30b24d0c2ce74218ae5ac7d4255ee053'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:58.090149 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c6ee2227-10a2-4b55-b209-453b48d7bf17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30b24d0c2ce74218ae5ac7d4255ee053'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:58.090786 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c6ee2227-10a2-4b55-b209-453b48d7bf17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30b24d0c2ce74218ae5ac7d4255ee053'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:58.099170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c6ee2227-10a2-4b55-b209-453b48d7bf17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30b24d0c2ce74218ae5ac7d4255ee053'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:58.112764 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1447/2868] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:33:57 2022] DELETE /identity/v3/users/30b24d0c2ce74218ae5ac7d4255ee053 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:58.117500 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b25c35-da98-46b0-be86-149fdbff3afe None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:58.118031 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b25c35-da98-46b0-be86-149fdbff3afe None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:58.118031 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b25c35-da98-46b0-be86-149fdbff3afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:58.138208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d1b25c35-da98-46b0-be86-149fdbff3afe None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:58.139775 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d1b25c35-da98-46b0-be86-149fdbff3afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:58.203456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1422/2869] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:58.213340 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee2227-10a2-4b55-b209-453b48d7bf17 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:58.214778 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c6ee2227-10a2-4b55-b209-453b48d7bf17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:58.273808 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee2227-10a2-4b55-b209-453b48d7bf17 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:58.278180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9330d64-24d9-4fee-90a4-9f6a8efc07c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:58.278825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9330d64-24d9-4fee-90a4-9f6a8efc07c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:58.279143 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9330d64-24d9-4fee-90a4-9f6a8efc07c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:58.279416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9330d64-24d9-4fee-90a4-9f6a8efc07c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:58.290051 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9330d64-24d9-4fee-90a4-9f6a8efc07c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:58.291545 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9330d64-24d9-4fee-90a4-9f6a8efc07c1 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:58.302085 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1448/2870] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:33:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:33:58.573448 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b25c35-da98-46b0-be86-149fdbff3afe None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:58.575073 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d1b25c35-da98-46b0-be86-149fdbff3afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:58.587889 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b25c35-da98-46b0-be86-149fdbff3afe None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:58.593545 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8f517-b802-491e-99e4-124e49aed36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:58.594542 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8f517-b802-491e-99e4-124e49aed36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:58.594783 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8f517-b802-491e-99e4-124e49aed36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:58.594992 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8f517-b802-491e-99e4-124e49aed36f admin admin] PATH_INFO: `/v3/projects/efd7b8b621d64da0aa7cdcf0296f5b52` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:58.596390 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8f517-b802-491e-99e4-124e49aed36f admin admin] RBAC: Authorizing `identity:delete_project(project_id=efd7b8b621d64da0aa7cdcf0296f5b52)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:58.598329 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8f517-b802-491e-99e4-124e49aed36f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:58.644766 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d9a8f517-b802-491e-99e4-124e49aed36f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efd7b8b621d64da0aa7cdcf0296f5b52', 'request_id': 'req-d9a8f517-b802-491e-99e4-124e49aed36f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:58.650833 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d9a8f517-b802-491e-99e4-124e49aed36f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efd7b8b621d64da0aa7cdcf0296f5b52', 'request_id': 'req-d9a8f517-b802-491e-99e4-124e49aed36f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:58.659770 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d9a8f517-b802-491e-99e4-124e49aed36f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efd7b8b621d64da0aa7cdcf0296f5b52', 'request_id': 'req-d9a8f517-b802-491e-99e4-124e49aed36f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:58.670336 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d9a8f517-b802-491e-99e4-124e49aed36f admin admin] The token cache is being invalidate because project efd7b8b621d64da0aa7cdcf0296f5b52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:33:58.670615 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d9a8f517-b802-491e-99e4-124e49aed36f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:58.671271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d9a8f517-b802-491e-99e4-124e49aed36f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:58.672852 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1423/2871] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:33:58 2022] DELETE /identity/v3/projects/efd7b8b621d64da0aa7cdcf0296f5b52 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:58.676925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9330d64-24d9-4fee-90a4-9f6a8efc07c1 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:58.686688 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9330d64-24d9-4fee-90a4-9f6a8efc07c1 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:58.746819 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650ac19-eadf-4422-aefe-030437cbc512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:58.747734 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650ac19-eadf-4422-aefe-030437cbc512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:58.748017 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650ac19-eadf-4422-aefe-030437cbc512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:58.748279 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650ac19-eadf-4422-aefe-030437cbc512 admin admin] PATH_INFO: `/v3/users/0c34a2daf0f249a98846d6991e4e9907` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:58.749528 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650ac19-eadf-4422-aefe-030437cbc512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c34a2daf0f249a98846d6991e4e9907)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:58.751545 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650ac19-eadf-4422-aefe-030437cbc512 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:58.798571 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a650ac19-eadf-4422-aefe-030437cbc512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c34a2daf0f249a98846d6991e4e9907'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:58.809779 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a650ac19-eadf-4422-aefe-030437cbc512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c34a2daf0f249a98846d6991e4e9907'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:58.810470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a650ac19-eadf-4422-aefe-030437cbc512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c34a2daf0f249a98846d6991e4e9907'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:58.811151 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a650ac19-eadf-4422-aefe-030437cbc512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c34a2daf0f249a98846d6991e4e9907'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:58.819201 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a650ac19-eadf-4422-aefe-030437cbc512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c34a2daf0f249a98846d6991e4e9907'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:58.832161 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1449/2872] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:33:58 2022] DELETE /identity/v3/users/0c34a2daf0f249a98846d6991e4e9907 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:59.111774 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8f517-b802-491e-99e4-124e49aed36f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:59.113417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d9a8f517-b802-491e-99e4-124e49aed36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:59.127003 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8f517-b802-491e-99e4-124e49aed36f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:59.183864 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914bf79-4cef-4fd7-aaf3-26f5580ad9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:59.184650 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914bf79-4cef-4fd7-aaf3-26f5580ad9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:59.184924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914bf79-4cef-4fd7-aaf3-26f5580ad9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:59.185201 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914bf79-4cef-4fd7-aaf3-26f5580ad9d3 admin admin] PATH_INFO: `/v3/projects/9ba2773141d24b0a944bea70a1fa7e7b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:59.186430 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914bf79-4cef-4fd7-aaf3-26f5580ad9d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ba2773141d24b0a944bea70a1fa7e7b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:59.188324 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914bf79-4cef-4fd7-aaf3-26f5580ad9d3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:59.235165 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1914bf79-4cef-4fd7-aaf3-26f5580ad9d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ba2773141d24b0a944bea70a1fa7e7b', 'request_id': 'req-1914bf79-4cef-4fd7-aaf3-26f5580ad9d3'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:59.241060 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1914bf79-4cef-4fd7-aaf3-26f5580ad9d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ba2773141d24b0a944bea70a1fa7e7b', 'request_id': 'req-1914bf79-4cef-4fd7-aaf3-26f5580ad9d3'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:59.250002 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1914bf79-4cef-4fd7-aaf3-26f5580ad9d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ba2773141d24b0a944bea70a1fa7e7b', 'request_id': 'req-1914bf79-4cef-4fd7-aaf3-26f5580ad9d3'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:59.260168 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1914bf79-4cef-4fd7-aaf3-26f5580ad9d3 admin admin] The token cache is being invalidate because project 9ba2773141d24b0a944bea70a1fa7e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:33:59.260453 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1914bf79-4cef-4fd7-aaf3-26f5580ad9d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:59.261104 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1914bf79-4cef-4fd7-aaf3-26f5580ad9d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:33:59.262680 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1424/2873] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:33:59 2022] DELETE /identity/v3/projects/9ba2773141d24b0a944bea70a1fa7e7b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:59.268092 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430a27a-7345-4b00-a186-f3f6c956d5be None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:59.268574 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430a27a-7345-4b00-a186-f3f6c956d5be None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:59.268690 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430a27a-7345-4b00-a186-f3f6c956d5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:59.287203 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8430a27a-7345-4b00-a186-f3f6c956d5be None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:59.288408 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8430a27a-7345-4b00-a186-f3f6c956d5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:59.353663 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1450/2874] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:59.362467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6617f-975b-47cf-afb1-11721154e3a0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:59.362900 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6617f-975b-47cf-afb1-11721154e3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:59.363332 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6617f-975b-47cf-afb1-11721154e3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:59.385129 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1bc6617f-975b-47cf-afb1-11721154e3a0 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:59.386339 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1bc6617f-975b-47cf-afb1-11721154e3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:59.397364 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1425/2875] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:59.401923 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430a27a-7345-4b00-a186-f3f6c956d5be None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:59.412811 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430a27a-7345-4b00-a186-f3f6c956d5be None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:59.418985 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12dd56-8d92-46a8-b355-da514469da4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:59.419645 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12dd56-8d92-46a8-b355-da514469da4b admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:59.419905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12dd56-8d92-46a8-b355-da514469da4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:59.420172 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12dd56-8d92-46a8-b355-da514469da4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:59.420901 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12dd56-8d92-46a8-b355-da514469da4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:33:59.421209 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12dd56-8d92-46a8-b355-da514469da4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:59.422842 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12dd56-8d92-46a8-b355-da514469da4b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:59.434601 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1451/2876] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 07:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:33:59.438769 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6617f-975b-47cf-afb1-11721154e3a0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:59.448162 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6617f-975b-47cf-afb1-11721154e3a0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:59.454539 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3bb83-73f2-4cff-ab33-1e2093ab2f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:59.455218 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3bb83-73f2-4cff-ab33-1e2093ab2f2a admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:59.455498 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3bb83-73f2-4cff-ab33-1e2093ab2f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:59.455758 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3bb83-73f2-4cff-ab33-1e2093ab2f2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:59.456439 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3bb83-73f2-4cff-ab33-1e2093ab2f2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:59.458417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3bb83-73f2-4cff-ab33-1e2093ab2f2a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:59.489304 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1426/2877] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:33:59 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:33:59.493730 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12dd56-8d92-46a8-b355-da514469da4b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:59.508563 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12dd56-8d92-46a8-b355-da514469da4b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:59.576599 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3ae54-3fc9-4cab-8224-f6938cd923c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:59.577612 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3ae54-3fc9-4cab-8224-f6938cd923c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:59.577892 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3ae54-3fc9-4cab-8224-f6938cd923c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:59.578162 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3ae54-3fc9-4cab-8224-f6938cd923c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:59.578849 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3ae54-3fc9-4cab-8224-f6938cd923c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:59.580806 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3ae54-3fc9-4cab-8224-f6938cd923c0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:59.604424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1452/2878] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:33:59 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:33:59.608583 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3bb83-73f2-4cff-ab33-1e2093ab2f2a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:59.619115 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3bb83-73f2-4cff-ab33-1e2093ab2f2a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:59.624653 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe7d31-d607-4c9e-97d9-1458e30e6a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:59.625311 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe7d31-d607-4c9e-97d9-1458e30e6a0b admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:59.625582 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe7d31-d607-4c9e-97d9-1458e30e6a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:59.625858 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe7d31-d607-4c9e-97d9-1458e30e6a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:59.626574 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe7d31-d607-4c9e-97d9-1458e30e6a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:59.628205 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe7d31-d607-4c9e-97d9-1458e30e6a0b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:59.638546 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1427/2879] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:33:59.644596 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3ae54-3fc9-4cab-8224-f6938cd923c0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:59.660036 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3ae54-3fc9-4cab-8224-f6938cd923c0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:59.667517 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8017c6-9d1a-4aec-9270-a0627024c88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:59.668185 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8017c6-9d1a-4aec-9270-a0627024c88c admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:59.668465 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8017c6-9d1a-4aec-9270-a0627024c88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:59.668743 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8017c6-9d1a-4aec-9270-a0627024c88c admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:59.669480 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8017c6-9d1a-4aec-9270-a0627024c88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:59.671106 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8017c6-9d1a-4aec-9270-a0627024c88c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:59.681557 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1453/2880] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:33:59.685793 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe7d31-d607-4c9e-97d9-1458e30e6a0b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:59.696190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe7d31-d607-4c9e-97d9-1458e30e6a0b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:59.702027 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b128b7-b1df-469d-b1b9-4bf061b48732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:59.702912 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b128b7-b1df-469d-b1b9-4bf061b48732 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:59.703226 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b128b7-b1df-469d-b1b9-4bf061b48732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:59.703502 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b128b7-b1df-469d-b1b9-4bf061b48732 admin admin] PATH_INFO: `/v3/projects/00ad5f88893744cca09f295da59ee956/users/c2790e9ebb36461fbeee0bac0d06d2ad/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:59.718368 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b128b7-b1df-469d-b1b9-4bf061b48732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00ad5f88893744cca09f295da59ee956, user_id=c2790e9ebb36461fbeee0bac0d06d2ad, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:59.721063 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b128b7-b1df-469d-b1b9-4bf061b48732 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:59.738188 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1428/2881] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:33:59 2022] PUT /identity/v3/projects/00ad5f88893744cca09f295da59ee956/users/c2790e9ebb36461fbeee0bac0d06d2ad/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:33:59.753584 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827615b6-5e6b-46e5-8ecd-92fe6d3a0bcf None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:59.753870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827615b6-5e6b-46e5-8ecd-92fe6d3a0bcf None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:59.754148 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827615b6-5e6b-46e5-8ecd-92fe6d3a0bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:59.782825 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-827615b6-5e6b-46e5-8ecd-92fe6d3a0bcf None None] MFA Rules not processed for user `c2790e9ebb36461fbeee0bac0d06d2ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:59.784070 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-827615b6-5e6b-46e5-8ecd-92fe6d3a0bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:59.853946 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1454/2882] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:33:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:59.858706 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b128b7-b1df-469d-b1b9-4bf061b48732 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:59.928838 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b128b7-b1df-469d-b1b9-4bf061b48732 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:59.934766 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abf873-387f-401a-9271-cbb5e0edc19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:59.935466 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abf873-387f-401a-9271-cbb5e0edc19b admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:59.935742 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abf873-387f-401a-9271-cbb5e0edc19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:59.936075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abf873-387f-401a-9271-cbb5e0edc19b admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:59.936802 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abf873-387f-401a-9271-cbb5e0edc19b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:59.938571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abf873-387f-401a-9271-cbb5e0edc19b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:59.966196 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1429/2883] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:33:59 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:33:59.970305 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827615b6-5e6b-46e5-8ecd-92fe6d3a0bcf None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:59.981104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827615b6-5e6b-46e5-8ecd-92fe6d3a0bcf None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:00.035964 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf04720-cce5-4269-82fc-b783c7b4ea95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:00.036633 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf04720-cce5-4269-82fc-b783c7b4ea95 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:00.036885 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf04720-cce5-4269-82fc-b783c7b4ea95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:00.037156 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf04720-cce5-4269-82fc-b783c7b4ea95 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:00.037851 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf04720-cce5-4269-82fc-b783c7b4ea95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:00.039852 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf04720-cce5-4269-82fc-b783c7b4ea95 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:00.061402 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1455/2884] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:33:59 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:34:00.065530 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abf873-387f-401a-9271-cbb5e0edc19b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:00.076028 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abf873-387f-401a-9271-cbb5e0edc19b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:00.081048 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2ef61-fa4b-46c6-97a3-0a415ca32123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:00.081713 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2ef61-fa4b-46c6-97a3-0a415ca32123 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:00.081997 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2ef61-fa4b-46c6-97a3-0a415ca32123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:00.082269 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2ef61-fa4b-46c6-97a3-0a415ca32123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:00.083033 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2ef61-fa4b-46c6-97a3-0a415ca32123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:00.084636 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2ef61-fa4b-46c6-97a3-0a415ca32123 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:00.095208 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1430/2885] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:34:00.099268 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf04720-cce5-4269-82fc-b783c7b4ea95 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:00.109170 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf04720-cce5-4269-82fc-b783c7b4ea95 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:00.113773 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f7170-843e-4fe6-9562-e066a1349636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:00.114651 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f7170-843e-4fe6-9562-e066a1349636 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:00.114895 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f7170-843e-4fe6-9562-e066a1349636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:00.115226 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f7170-843e-4fe6-9562-e066a1349636 admin admin] PATH_INFO: `/v3/projects/180edfc74cc444dfbf49193debe5a11f/users/4e7224a3641244b9b1c78bf013053b20/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:00.129263 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f7170-843e-4fe6-9562-e066a1349636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=180edfc74cc444dfbf49193debe5a11f, user_id=4e7224a3641244b9b1c78bf013053b20, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:00.131896 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f7170-843e-4fe6-9562-e066a1349636 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:00.145473 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1456/2886] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:34:00 2022] PUT /identity/v3/projects/180edfc74cc444dfbf49193debe5a11f/users/4e7224a3641244b9b1c78bf013053b20/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:34:00.149405 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2ef61-fa4b-46c6-97a3-0a415ca32123 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:00.159599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2ef61-fa4b-46c6-97a3-0a415ca32123 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:00.221695 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f559b-be42-482c-834f-d48840136d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:00.222288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f559b-be42-482c-834f-d48840136d5e admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:00.222574 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f559b-be42-482c-834f-d48840136d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:00.222849 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f559b-be42-482c-834f-d48840136d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:00.223607 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f559b-be42-482c-834f-d48840136d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:00.225205 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f559b-be42-482c-834f-d48840136d5e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:00.234970 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1431/2887] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:34:00.239949 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f7170-843e-4fe6-9562-e066a1349636 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:00.256219 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f7170-843e-4fe6-9562-e066a1349636 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:00.262456 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c31e2-9441-40ef-b986-45346c01a9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:00.263381 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c31e2-9441-40ef-b986-45346c01a9bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:00.263656 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c31e2-9441-40ef-b986-45346c01a9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:00.263927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c31e2-9441-40ef-b986-45346c01a9bc admin admin] PATH_INFO: `/v3/projects/180edfc74cc444dfbf49193debe5a11f/users/4e7224a3641244b9b1c78bf013053b20/roles/5debd8ad07a74bedbf2efd53b11cd7cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:00.266526 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c31e2-9441-40ef-b986-45346c01a9bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=180edfc74cc444dfbf49193debe5a11f, user_id=4e7224a3641244b9b1c78bf013053b20, role_id=5debd8ad07a74bedbf2efd53b11cd7cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:00.269207 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c31e2-9441-40ef-b986-45346c01a9bc admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:00.279703 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1457/2888] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:34:00 2022] PUT /identity/v3/projects/180edfc74cc444dfbf49193debe5a11f/users/4e7224a3641244b9b1c78bf013053b20/roles/5debd8ad07a74bedbf2efd53b11cd7cd => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:34:00.291160 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70cf8a-3090-4fbd-b448-3eee190fc3b1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:00.291581 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70cf8a-3090-4fbd-b448-3eee190fc3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:00.291981 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70cf8a-3090-4fbd-b448-3eee190fc3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:00.319953 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5e70cf8a-3090-4fbd-b448-3eee190fc3b1 None None] MFA Rules not processed for user `4e7224a3641244b9b1c78bf013053b20`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:34:00.321222 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5e70cf8a-3090-4fbd-b448-3eee190fc3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:00.403328 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1432/2889] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:34:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:34:00.415119 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c31e2-9441-40ef-b986-45346c01a9bc admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:00.416583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-299c31e2-9441-40ef-b986-45346c01a9bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:00.483817 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c31e2-9441-40ef-b986-45346c01a9bc admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:00.488702 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ac0cd-b387-4b51-9089-560e96e00814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:00.489361 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ac0cd-b387-4b51-9089-560e96e00814 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:00.489647 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ac0cd-b387-4b51-9089-560e96e00814 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:00.489925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ac0cd-b387-4b51-9089-560e96e00814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:00.500063 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ac0cd-b387-4b51-9089-560e96e00814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:00.501509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ac0cd-b387-4b51-9089-560e96e00814 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:00.512716 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1458/2890] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:34:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:34:00.898380 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70cf8a-3090-4fbd-b448-3eee190fc3b1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:00.961537 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70cf8a-3090-4fbd-b448-3eee190fc3b1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:00.967302 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f410e-f828-4dce-b663-695d194b1533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:00.968177 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f410e-f828-4dce-b663-695d194b1533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:00.968456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f410e-f828-4dce-b663-695d194b1533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:00.968723 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f410e-f828-4dce-b663-695d194b1533 admin admin] PATH_INFO: `/v3/users/c2790e9ebb36461fbeee0bac0d06d2ad` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:00.970036 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f410e-f828-4dce-b663-695d194b1533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2790e9ebb36461fbeee0bac0d06d2ad)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:00.972004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f410e-f828-4dce-b663-695d194b1533 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:01.026047 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-937f410e-f828-4dce-b663-695d194b1533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2790e9ebb36461fbeee0bac0d06d2ad'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:01.037655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-937f410e-f828-4dce-b663-695d194b1533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2790e9ebb36461fbeee0bac0d06d2ad'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:01.038444 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-937f410e-f828-4dce-b663-695d194b1533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2790e9ebb36461fbeee0bac0d06d2ad'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:01.039071 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-937f410e-f828-4dce-b663-695d194b1533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2790e9ebb36461fbeee0bac0d06d2ad'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:01.047248 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-937f410e-f828-4dce-b663-695d194b1533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2790e9ebb36461fbeee0bac0d06d2ad'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:01.058874 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1433/2891] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:34:00 2022] DELETE /identity/v3/users/c2790e9ebb36461fbeee0bac0d06d2ad => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:34:01.063559 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfacd59-8c4f-48e5-bdbc-87e046d5e1e7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:01.063832 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfacd59-8c4f-48e5-bdbc-87e046d5e1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:01.064110 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfacd59-8c4f-48e5-bdbc-87e046d5e1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:01.081635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-edfacd59-8c4f-48e5-bdbc-87e046d5e1e7 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:34:01.082841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-edfacd59-8c4f-48e5-bdbc-87e046d5e1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:01.148708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1459/2892] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:34:01.159348 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f410e-f828-4dce-b663-695d194b1533 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:01.160958 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-937f410e-f828-4dce-b663-695d194b1533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:01.220190 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f410e-f828-4dce-b663-695d194b1533 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:01.224626 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a5ce8-2962-4384-8080-446d7466c773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:01.225268 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a5ce8-2962-4384-8080-446d7466c773 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:01.225544 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a5ce8-2962-4384-8080-446d7466c773 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:01.225816 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a5ce8-2962-4384-8080-446d7466c773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:01.235465 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a5ce8-2962-4384-8080-446d7466c773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:01.236886 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a5ce8-2962-4384-8080-446d7466c773 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:01.246376 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1434/2893] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:34:01.527699 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfacd59-8c4f-48e5-bdbc-87e046d5e1e7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:01.529303 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-edfacd59-8c4f-48e5-bdbc-87e046d5e1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:01.542199 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfacd59-8c4f-48e5-bdbc-87e046d5e1e7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:01.547122 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f703ff-e82d-4779-9c88-0418b814b3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:01.549080 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f703ff-e82d-4779-9c88-0418b814b3ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:01.549182 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f703ff-e82d-4779-9c88-0418b814b3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:01.549480 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f703ff-e82d-4779-9c88-0418b814b3ff admin admin] PATH_INFO: `/v3/projects/00ad5f88893744cca09f295da59ee956` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:01.550796 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f703ff-e82d-4779-9c88-0418b814b3ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=00ad5f88893744cca09f295da59ee956)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:01.552763 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f703ff-e82d-4779-9c88-0418b814b3ff admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:01.599090 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-72f703ff-e82d-4779-9c88-0418b814b3ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00ad5f88893744cca09f295da59ee956', 'request_id': 'req-72f703ff-e82d-4779-9c88-0418b814b3ff'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:01.605531 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-72f703ff-e82d-4779-9c88-0418b814b3ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00ad5f88893744cca09f295da59ee956', 'request_id': 'req-72f703ff-e82d-4779-9c88-0418b814b3ff'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:01.614118 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-72f703ff-e82d-4779-9c88-0418b814b3ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00ad5f88893744cca09f295da59ee956', 'request_id': 'req-72f703ff-e82d-4779-9c88-0418b814b3ff'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:01.625215 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-72f703ff-e82d-4779-9c88-0418b814b3ff admin admin] The token cache is being invalidate because project 00ad5f88893744cca09f295da59ee956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:34:01.627084 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-72f703ff-e82d-4779-9c88-0418b814b3ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:01.629470 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-72f703ff-e82d-4779-9c88-0418b814b3ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:01.631104 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1460/2894] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:34:01 2022] DELETE /identity/v3/projects/00ad5f88893744cca09f295da59ee956 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:34:01.635406 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a5ce8-2962-4384-8080-446d7466c773 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:01.650286 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a5ce8-2962-4384-8080-446d7466c773 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:01.721613 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ce836-faf6-4572-8556-8a73b5bcf65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:01.722472 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ce836-faf6-4572-8556-8a73b5bcf65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:01.722751 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ce836-faf6-4572-8556-8a73b5bcf65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:01.723049 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ce836-faf6-4572-8556-8a73b5bcf65f admin admin] PATH_INFO: `/v3/users/4e7224a3641244b9b1c78bf013053b20` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:01.724260 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ce836-faf6-4572-8556-8a73b5bcf65f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e7224a3641244b9b1c78bf013053b20)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:01.726223 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ce836-faf6-4572-8556-8a73b5bcf65f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:01.793258 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f33ce836-faf6-4572-8556-8a73b5bcf65f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e7224a3641244b9b1c78bf013053b20'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:01.805743 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f33ce836-faf6-4572-8556-8a73b5bcf65f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e7224a3641244b9b1c78bf013053b20'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:01.806415 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f33ce836-faf6-4572-8556-8a73b5bcf65f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e7224a3641244b9b1c78bf013053b20'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:01.807050 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f33ce836-faf6-4572-8556-8a73b5bcf65f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e7224a3641244b9b1c78bf013053b20'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:01.815304 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f33ce836-faf6-4572-8556-8a73b5bcf65f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e7224a3641244b9b1c78bf013053b20'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:01.827697 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1435/2895] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:34:01 2022] DELETE /identity/v3/users/4e7224a3641244b9b1c78bf013053b20 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:34:02.093452 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f703ff-e82d-4779-9c88-0418b814b3ff admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:02.095062 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-72f703ff-e82d-4779-9c88-0418b814b3ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:02.110243 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f703ff-e82d-4779-9c88-0418b814b3ff admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:02.173979 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e2237-8110-4933-988c-336461bd5d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:02.174850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e2237-8110-4933-988c-336461bd5d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:02.175155 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e2237-8110-4933-988c-336461bd5d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:02.175415 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e2237-8110-4933-988c-336461bd5d36 admin admin] PATH_INFO: `/v3/projects/180edfc74cc444dfbf49193debe5a11f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:02.176727 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e2237-8110-4933-988c-336461bd5d36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=180edfc74cc444dfbf49193debe5a11f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:02.178636 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e2237-8110-4933-988c-336461bd5d36 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:02.224487 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-883e2237-8110-4933-988c-336461bd5d36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '180edfc74cc444dfbf49193debe5a11f', 'request_id': 'req-883e2237-8110-4933-988c-336461bd5d36'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:02.230464 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-883e2237-8110-4933-988c-336461bd5d36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '180edfc74cc444dfbf49193debe5a11f', 'request_id': 'req-883e2237-8110-4933-988c-336461bd5d36'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:02.239147 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-883e2237-8110-4933-988c-336461bd5d36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '180edfc74cc444dfbf49193debe5a11f', 'request_id': 'req-883e2237-8110-4933-988c-336461bd5d36'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:02.250106 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-883e2237-8110-4933-988c-336461bd5d36 admin admin] The token cache is being invalidate because project 180edfc74cc444dfbf49193debe5a11f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:34:02.250347 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-883e2237-8110-4933-988c-336461bd5d36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:02.251045 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-883e2237-8110-4933-988c-336461bd5d36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:02.252576 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1461/2896] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:34:02 2022] DELETE /identity/v3/projects/180edfc74cc444dfbf49193debe5a11f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:34:02.258284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c3f0d-4bc0-4895-abb4-a4077d75cd18 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:02.258767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c3f0d-4bc0-4895-abb4-a4077d75cd18 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:02.258865 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c3f0d-4bc0-4895-abb4-a4077d75cd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:02.276962 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-911c3f0d-4bc0-4895-abb4-a4077d75cd18 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:34:02.278162 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-911c3f0d-4bc0-4895-abb4-a4077d75cd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:02.337417 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1436/2897] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:34:02.345434 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ad390-eb87-4032-9d7a-7f94499d7484 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:02.345722 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ad390-eb87-4032-9d7a-7f94499d7484 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:02.346003 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ad390-eb87-4032-9d7a-7f94499d7484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:02.365255 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bc7ad390-eb87-4032-9d7a-7f94499d7484 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:34:02.366478 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bc7ad390-eb87-4032-9d7a-7f94499d7484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:02.375598 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1462/2898] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:34:02.379997 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c3f0d-4bc0-4895-abb4-a4077d75cd18 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:02.390392 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c3f0d-4bc0-4895-abb4-a4077d75cd18 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:02.395893 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe4122-7e32-4053-b4e0-6059f03573b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:02.396546 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe4122-7e32-4053-b4e0-6059f03573b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:02.396820 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe4122-7e32-4053-b4e0-6059f03573b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:02.397094 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe4122-7e32-4053-b4e0-6059f03573b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:02.397844 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe4122-7e32-4053-b4e0-6059f03573b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:34:02.398112 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe4122-7e32-4053-b4e0-6059f03573b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:02.399812 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe4122-7e32-4053-b4e0-6059f03573b7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:02.413614 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1437/2899] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 07:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:34:02.418735 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ad390-eb87-4032-9d7a-7f94499d7484 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:02.432503 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ad390-eb87-4032-9d7a-7f94499d7484 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:02.440379 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd1c3b-78d3-452a-b5dd-eb6ed29bda14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:02.441075 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd1c3b-78d3-452a-b5dd-eb6ed29bda14 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:02.441348 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd1c3b-78d3-452a-b5dd-eb6ed29bda14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:02.441652 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd1c3b-78d3-452a-b5dd-eb6ed29bda14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:02.442341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd1c3b-78d3-452a-b5dd-eb6ed29bda14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:02.444337 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd1c3b-78d3-452a-b5dd-eb6ed29bda14 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:02.473116 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1463/2900] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:34:02 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:34:02.477122 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe4122-7e32-4053-b4e0-6059f03573b7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:02.487476 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe4122-7e32-4053-b4e0-6059f03573b7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:02.546839 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a3210-ce1c-48d5-91cb-c7994dd301f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:02.547527 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a3210-ce1c-48d5-91cb-c7994dd301f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:02.547807 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a3210-ce1c-48d5-91cb-c7994dd301f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:02.548075 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a3210-ce1c-48d5-91cb-c7994dd301f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:02.548757 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a3210-ce1c-48d5-91cb-c7994dd301f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:02.550684 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a3210-ce1c-48d5-91cb-c7994dd301f3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:02.572944 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1438/2901] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:34:02 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:34:02.577222 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd1c3b-78d3-452a-b5dd-eb6ed29bda14 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:02.588241 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd1c3b-78d3-452a-b5dd-eb6ed29bda14 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:02.593811 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2defd-0f41-498d-a9d9-6b6329da15d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:02.594466 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2defd-0f41-498d-a9d9-6b6329da15d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:02.594756 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2defd-0f41-498d-a9d9-6b6329da15d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:02.595032 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2defd-0f41-498d-a9d9-6b6329da15d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:02.595833 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2defd-0f41-498d-a9d9-6b6329da15d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:02.597449 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2defd-0f41-498d-a9d9-6b6329da15d4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:02.609757 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1464/2902] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:34:02.613982 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a3210-ce1c-48d5-91cb-c7994dd301f3 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:02.624572 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a3210-ce1c-48d5-91cb-c7994dd301f3 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:02.629982 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbf3e4-e045-431d-bc43-d75c85ee2c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:02.630640 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbf3e4-e045-431d-bc43-d75c85ee2c98 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:02.630916 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbf3e4-e045-431d-bc43-d75c85ee2c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:02.631227 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbf3e4-e045-431d-bc43-d75c85ee2c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:02.631955 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbf3e4-e045-431d-bc43-d75c85ee2c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:02.633606 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbf3e4-e045-431d-bc43-d75c85ee2c98 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:02.644156 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1439/2903] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:34:02.648459 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2defd-0f41-498d-a9d9-6b6329da15d4 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:02.659657 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2defd-0f41-498d-a9d9-6b6329da15d4 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:02.665983 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2dd99a-a1b5-44e7-945e-1bd85de8d31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:02.666863 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dd99a-a1b5-44e7-945e-1bd85de8d31f admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:02.667333 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dd99a-a1b5-44e7-945e-1bd85de8d31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:02.667694 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dd99a-a1b5-44e7-945e-1bd85de8d31f admin admin] PATH_INFO: `/v3/projects/ba42ead5d7cb4e50ab75c43ed2e2fc63/users/af236f5cd4bd4650ade16bd04fcbbd1f/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:02.686099 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2dd99a-a1b5-44e7-945e-1bd85de8d31f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba42ead5d7cb4e50ab75c43ed2e2fc63, user_id=af236f5cd4bd4650ade16bd04fcbbd1f, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:02.697722 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2dd99a-a1b5-44e7-945e-1bd85de8d31f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:02.716586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1465/2904] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:34:02 2022] PUT /identity/v3/projects/ba42ead5d7cb4e50ab75c43ed2e2fc63/users/af236f5cd4bd4650ade16bd04fcbbd1f/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:34:02.731795 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf416f-8121-4a18-a975-54a57a69c73e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:02.732077 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf416f-8121-4a18-a975-54a57a69c73e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:02.732351 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf416f-8121-4a18-a975-54a57a69c73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:02.759458 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-48bf416f-8121-4a18-a975-54a57a69c73e None None] MFA Rules not processed for user `af236f5cd4bd4650ade16bd04fcbbd1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:34:02.760658 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-48bf416f-8121-4a18-a975-54a57a69c73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:02.825163 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1440/2905] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:34:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:34:02.836698 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2dd99a-a1b5-44e7-945e-1bd85de8d31f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:02.838710 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8a2dd99a-a1b5-44e7-945e-1bd85de8d31f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:02.895254 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2dd99a-a1b5-44e7-945e-1bd85de8d31f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:02.900805 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71612b0-b2bd-4e20-b2c2-74603a921c16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:02.901722 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71612b0-b2bd-4e20-b2c2-74603a921c16 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:02.902217 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71612b0-b2bd-4e20-b2c2-74603a921c16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:02.902500 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71612b0-b2bd-4e20-b2c2-74603a921c16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:02.911613 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71612b0-b2bd-4e20-b2c2-74603a921c16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:02.913057 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71612b0-b2bd-4e20-b2c2-74603a921c16 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:02.922378 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1466/2906] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:34:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:34:05.488092 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf416f-8121-4a18-a975-54a57a69c73e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:05.556242 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf416f-8121-4a18-a975-54a57a69c73e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:05.561686 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cfaed-b54a-46cf-aaae-12520bb00f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:05.562560 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cfaed-b54a-46cf-aaae-12520bb00f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:05.562843 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cfaed-b54a-46cf-aaae-12520bb00f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:05.563151 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cfaed-b54a-46cf-aaae-12520bb00f83 admin admin] PATH_INFO: `/v3/users/af236f5cd4bd4650ade16bd04fcbbd1f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:05.564400 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cfaed-b54a-46cf-aaae-12520bb00f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af236f5cd4bd4650ade16bd04fcbbd1f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:05.566321 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cfaed-b54a-46cf-aaae-12520bb00f83 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:05.615104 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-fb1cfaed-b54a-46cf-aaae-12520bb00f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af236f5cd4bd4650ade16bd04fcbbd1f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:05.626231 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-fb1cfaed-b54a-46cf-aaae-12520bb00f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af236f5cd4bd4650ade16bd04fcbbd1f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:05.626923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-fb1cfaed-b54a-46cf-aaae-12520bb00f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af236f5cd4bd4650ade16bd04fcbbd1f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:05.627599 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-fb1cfaed-b54a-46cf-aaae-12520bb00f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af236f5cd4bd4650ade16bd04fcbbd1f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:05.636800 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-fb1cfaed-b54a-46cf-aaae-12520bb00f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af236f5cd4bd4650ade16bd04fcbbd1f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:05.648747 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1441/2907] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:34:05 2022] DELETE /identity/v3/users/af236f5cd4bd4650ade16bd04fcbbd1f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:34:05.653395 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5846c33-8646-44c7-8a41-cc58a127bf58 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:05.653910 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5846c33-8646-44c7-8a41-cc58a127bf58 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:05.654012 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5846c33-8646-44c7-8a41-cc58a127bf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:05.671394 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b5846c33-8646-44c7-8a41-cc58a127bf58 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:34:05.672621 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b5846c33-8646-44c7-8a41-cc58a127bf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:05.735216 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1467/2908] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:34:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:34:05.746102 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cfaed-b54a-46cf-aaae-12520bb00f83 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:05.747803 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fb1cfaed-b54a-46cf-aaae-12520bb00f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:05.807717 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cfaed-b54a-46cf-aaae-12520bb00f83 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:05.813315 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773afa4-f69b-44a0-a6e2-d3ea445be27b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:05.815467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773afa4-f69b-44a0-a6e2-d3ea445be27b service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:05.815467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773afa4-f69b-44a0-a6e2-d3ea445be27b service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:05.815467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773afa4-f69b-44a0-a6e2-d3ea445be27b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:05.826047 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773afa4-f69b-44a0-a6e2-d3ea445be27b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:05.828271 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773afa4-f69b-44a0-a6e2-d3ea445be27b service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:05.840662 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1442/2909] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:34:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:34:06.128674 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5846c33-8646-44c7-8a41-cc58a127bf58 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:06.130249 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b5846c33-8646-44c7-8a41-cc58a127bf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:06.146015 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5846c33-8646-44c7-8a41-cc58a127bf58 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:06.152509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d2d05-8959-4708-9822-3d8f07a0a6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:06.153602 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d2d05-8959-4708-9822-3d8f07a0a6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:06.154102 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d2d05-8959-4708-9822-3d8f07a0a6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:06.154416 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d2d05-8959-4708-9822-3d8f07a0a6d5 admin admin] PATH_INFO: `/v3/projects/ba42ead5d7cb4e50ab75c43ed2e2fc63` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:06.155929 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d2d05-8959-4708-9822-3d8f07a0a6d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba42ead5d7cb4e50ab75c43ed2e2fc63)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:06.157898 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d2d05-8959-4708-9822-3d8f07a0a6d5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:06.207024 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8a9d2d05-8959-4708-9822-3d8f07a0a6d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba42ead5d7cb4e50ab75c43ed2e2fc63', 'request_id': 'req-8a9d2d05-8959-4708-9822-3d8f07a0a6d5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:06.213237 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8a9d2d05-8959-4708-9822-3d8f07a0a6d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba42ead5d7cb4e50ab75c43ed2e2fc63', 'request_id': 'req-8a9d2d05-8959-4708-9822-3d8f07a0a6d5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:06.222338 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8a9d2d05-8959-4708-9822-3d8f07a0a6d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba42ead5d7cb4e50ab75c43ed2e2fc63', 'request_id': 'req-8a9d2d05-8959-4708-9822-3d8f07a0a6d5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:06.233140 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8a9d2d05-8959-4708-9822-3d8f07a0a6d5 admin admin] The token cache is being invalidate because project ba42ead5d7cb4e50ab75c43ed2e2fc63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:34:06.233428 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8a9d2d05-8959-4708-9822-3d8f07a0a6d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:06.234089 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8a9d2d05-8959-4708-9822-3d8f07a0a6d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:06.235724 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1468/2910] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:34:06 2022] DELETE /identity/v3/projects/ba42ead5d7cb4e50ab75c43ed2e2fc63 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:34:06.240722 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046fdcf-3537-4695-948c-a27c595f0cb8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:06.241008 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046fdcf-3537-4695-948c-a27c595f0cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:06.241279 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046fdcf-3537-4695-948c-a27c595f0cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:06.259734 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e046fdcf-3537-4695-948c-a27c595f0cb8 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:34:06.260937 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e046fdcf-3537-4695-948c-a27c595f0cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:06.322593 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1443/2911] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:34:06.331253 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527bd92-3465-481c-9ec8-669cf84f3158 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:06.331610 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527bd92-3465-481c-9ec8-669cf84f3158 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:06.332025 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527bd92-3465-481c-9ec8-669cf84f3158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:06.354524 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3527bd92-3465-481c-9ec8-669cf84f3158 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:34:06.355815 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3527bd92-3465-481c-9ec8-669cf84f3158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:06.364180 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1469/2912] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:34:06.368486 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046fdcf-3537-4695-948c-a27c595f0cb8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:06.377971 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046fdcf-3537-4695-948c-a27c595f0cb8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:06.383264 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da17787-4c8f-4e73-8609-01b56519d1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:06.384267 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da17787-4c8f-4e73-8609-01b56519d1bc admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:06.384553 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da17787-4c8f-4e73-8609-01b56519d1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:06.384826 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da17787-4c8f-4e73-8609-01b56519d1bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:06.385554 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da17787-4c8f-4e73-8609-01b56519d1bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:34:06.385857 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da17787-4c8f-4e73-8609-01b56519d1bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:06.387479 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da17787-4c8f-4e73-8609-01b56519d1bc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:06.399168 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1444/2913] 10.222.0.77 () {58 vars in 1152 bytes} [Wed May 11 07:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:34:06.403473 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527bd92-3465-481c-9ec8-669cf84f3158 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:06.412905 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527bd92-3465-481c-9ec8-669cf84f3158 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:06.418308 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622b75e-e08f-4b0e-8e6f-30501b737ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:06.418990 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622b75e-e08f-4b0e-8e6f-30501b737ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:06.419284 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622b75e-e08f-4b0e-8e6f-30501b737ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:06.419573 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622b75e-e08f-4b0e-8e6f-30501b737ab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:06.420387 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622b75e-e08f-4b0e-8e6f-30501b737ab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:06.422289 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622b75e-e08f-4b0e-8e6f-30501b737ab4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:06.450827 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1470/2914] 10.222.0.77 () {60 vars in 1152 bytes} [Wed May 11 07:34:06 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:34:06.455986 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da17787-4c8f-4e73-8609-01b56519d1bc admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:06.471643 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da17787-4c8f-4e73-8609-01b56519d1bc admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:06.532631 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf40930-8466-4448-8132-bde6656686cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:06.533284 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf40930-8466-4448-8132-bde6656686cb admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:06.533571 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf40930-8466-4448-8132-bde6656686cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:06.533847 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf40930-8466-4448-8132-bde6656686cb admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:06.534539 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf40930-8466-4448-8132-bde6656686cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:06.536480 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf40930-8466-4448-8132-bde6656686cb admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:06.557991 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1445/2915] 10.222.0.77 () {60 vars in 1143 bytes} [Wed May 11 07:34:06 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:34:06.562357 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622b75e-e08f-4b0e-8e6f-30501b737ab4 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:06.573396 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622b75e-e08f-4b0e-8e6f-30501b737ab4 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:06.579308 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c235e88-1517-4e91-8ac2-dc2b344593e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:06.579965 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c235e88-1517-4e91-8ac2-dc2b344593e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:06.580250 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c235e88-1517-4e91-8ac2-dc2b344593e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:06.580524 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c235e88-1517-4e91-8ac2-dc2b344593e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:06.581248 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c235e88-1517-4e91-8ac2-dc2b344593e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:06.582850 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c235e88-1517-4e91-8ac2-dc2b344593e7 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:06.593484 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1471/2916] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:34:06.598068 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf40930-8466-4448-8132-bde6656686cb admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:06.610752 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf40930-8466-4448-8132-bde6656686cb admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:06.618197 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a6e48-1b29-49f1-9625-40daa1369a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:06.618856 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a6e48-1b29-49f1-9625-40daa1369a14 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:06.619170 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a6e48-1b29-49f1-9625-40daa1369a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:06.619444 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a6e48-1b29-49f1-9625-40daa1369a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:06.620170 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a6e48-1b29-49f1-9625-40daa1369a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:06.621832 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a6e48-1b29-49f1-9625-40daa1369a14 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:06.632304 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1446/2917] 10.222.0.77 () {58 vars in 1121 bytes} [Wed May 11 07:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:34:06.636538 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c235e88-1517-4e91-8ac2-dc2b344593e7 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:06.646773 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c235e88-1517-4e91-8ac2-dc2b344593e7 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:06.651888 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a3aca-8dfd-45fd-9669-03c2047463c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:06.652771 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a3aca-8dfd-45fd-9669-03c2047463c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:06.653043 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a3aca-8dfd-45fd-9669-03c2047463c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:06.653310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a3aca-8dfd-45fd-9669-03c2047463c4 admin admin] PATH_INFO: `/v3/projects/1b318313a9f04a1eadae5213caf32e38/users/388436aac3294bec85c0d3e9a4881b03/roles/f8d42be71f034e1a88784699c04e7a89` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:06.668708 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a3aca-8dfd-45fd-9669-03c2047463c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b318313a9f04a1eadae5213caf32e38, user_id=388436aac3294bec85c0d3e9a4881b03, role_id=f8d42be71f034e1a88784699c04e7a89)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:06.671441 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a3aca-8dfd-45fd-9669-03c2047463c4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:06.685099 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1472/2918] 10.222.0.77 () {60 vars in 1482 bytes} [Wed May 11 07:34:06 2022] PUT /identity/v3/projects/1b318313a9f04a1eadae5213caf32e38/users/388436aac3294bec85c0d3e9a4881b03/roles/f8d42be71f034e1a88784699c04e7a89 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:34:06.695539 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f86467-28f3-4e42-aaaf-a253e07a4052 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:06.695825 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f86467-28f3-4e42-aaaf-a253e07a4052 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:06.696129 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f86467-28f3-4e42-aaaf-a253e07a4052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:06.722592 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-77f86467-28f3-4e42-aaaf-a253e07a4052 None None] MFA Rules not processed for user `388436aac3294bec85c0d3e9a4881b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:34:06.723819 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-77f86467-28f3-4e42-aaaf-a253e07a4052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:06.788238 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1447/2919] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:34:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:34:06.802671 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a3aca-8dfd-45fd-9669-03c2047463c4 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:06.805014 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f39a3aca-8dfd-45fd-9669-03c2047463c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:06.876936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a3aca-8dfd-45fd-9669-03c2047463c4 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:06.883201 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69492418-7258-4965-a76e-2b19fb5fd945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '628e4779afa24fb187c4b10a3765af9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:06.883861 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69492418-7258-4965-a76e-2b19fb5fd945 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:06.884141 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69492418-7258-4965-a76e-2b19fb5fd945 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:06.884443 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69492418-7258-4965-a76e-2b19fb5fd945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:06.894156 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69492418-7258-4965-a76e-2b19fb5fd945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:06.895815 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69492418-7258-4965-a76e-2b19fb5fd945 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:06.905248 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1473/2920] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:34:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:34:08.280467 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21573b15-0daa-4d84-8b60-73dbc8d6fc31 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:08.281004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21573b15-0daa-4d84-8b60-73dbc8d6fc31 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:08.281004 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21573b15-0daa-4d84-8b60-73dbc8d6fc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:08.302763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-21573b15-0daa-4d84-8b60-73dbc8d6fc31 None None] MFA Rules not processed for user `388436aac3294bec85c0d3e9a4881b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:34:08.304860 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-21573b15-0daa-4d84-8b60-73dbc8d6fc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:08.312923 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1448/2921] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:34:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:34:25.998401 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8991848-dd07-4860-8424-c21e5eede239 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:25.998906 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8991848-dd07-4860-8424-c21e5eede239 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:25.999028 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8991848-dd07-4860-8424-c21e5eede239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:26.017401 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e8991848-dd07-4860-8424-c21e5eede239 None None] MFA Rules not processed for user `99cbf80fc74c4183a6eed3e97f7196f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:34:26.018594 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e8991848-dd07-4860-8424-c21e5eede239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:26.085028 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1474/2922] 10.222.0.77 () {58 vars in 1009 bytes} [Wed May 11 07:34:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:34:26.133059 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21573b15-0daa-4d84-8b60-73dbc8d6fc31 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:26.134572 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-21573b15-0daa-4d84-8b60-73dbc8d6fc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:26.205473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21573b15-0daa-4d84-8b60-73dbc8d6fc31 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:26.211047 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c8f7f-0b37-41e3-b36c-b4c0f8deb597 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f726f58d30734be7abf15400bff89533', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:26.211688 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c8f7f-0b37-41e3-b36c-b4c0f8deb597 service swift] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:26.211977 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c8f7f-0b37-41e3-b36c-b4c0f8deb597 service swift] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:26.212244 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c8f7f-0b37-41e3-b36c-b4c0f8deb597 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:26.220551 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c8f7f-0b37-41e3-b36c-b4c0f8deb597 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:26.222127 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c8f7f-0b37-41e3-b36c-b4c0f8deb597 service swift] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:26.230292 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1449/2923] 10.222.0.77 () {60 vars in 1384 bytes} [Wed May 11 07:34:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:34:26.744318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4e08b-a52a-4979-9679-f902bccffbcd None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:26.744606 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4e08b-a52a-4979-9679-f902bccffbcd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:26.744883 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4e08b-a52a-4979-9679-f902bccffbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:26.763448 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-02d4e08b-a52a-4979-9679-f902bccffbcd None None] MFA Rules not processed for user `99cbf80fc74c4183a6eed3e97f7196f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:34:26.764962 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-02d4e08b-a52a-4979-9679-f902bccffbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:26.773398 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1475/2924] 10.222.0.77 () {58 vars in 967 bytes} [Wed May 11 07:34:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:34:26.786203 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c8f7f-0b37-41e3-b36c-b4c0f8deb597 service swift] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:26.802314 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c8f7f-0b37-41e3-b36c-b4c0f8deb597 service swift] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:26.809519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2050d1-97ef-43bb-a9d1-824a76aa569b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f726f58d30734be7abf15400bff89533', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:26.810176 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2050d1-97ef-43bb-a9d1-824a76aa569b service swift] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:26.810432 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2050d1-97ef-43bb-a9d1-824a76aa569b service swift] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:26.810703 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2050d1-97ef-43bb-a9d1-824a76aa569b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:26.819064 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2050d1-97ef-43bb-a9d1-824a76aa569b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:26.820642 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2050d1-97ef-43bb-a9d1-824a76aa569b service swift] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:26.828469 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1450/2925] 10.222.0.77 () {60 vars in 1384 bytes} [Wed May 11 07:34:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:34:27.023154 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bcbe4-5df1-4539-9cf1-1fc7247865e8 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:27.023622 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bcbe4-5df1-4539-9cf1-1fc7247865e8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:27.023759 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bcbe4-5df1-4539-9cf1-1fc7247865e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:27.041728 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a57bcbe4-5df1-4539-9cf1-1fc7247865e8 None None] MFA Rules not processed for user `99cbf80fc74c4183a6eed3e97f7196f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:34:27.042936 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a57bcbe4-5df1-4539-9cf1-1fc7247865e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:27.050298 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1476/2926] 10.222.0.77 () {58 vars in 1009 bytes} [Wed May 11 07:34:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:34:27.062253 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2050d1-97ef-43bb-a9d1-824a76aa569b service swift] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:27.073042 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2050d1-97ef-43bb-a9d1-824a76aa569b service swift] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:27.079529 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172d001-06c0-4679-838a-f3f78e3c0cf5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f726f58d30734be7abf15400bff89533', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:27.080198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172d001-06c0-4679-838a-f3f78e3c0cf5 service swift] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:27.080426 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172d001-06c0-4679-838a-f3f78e3c0cf5 service swift] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:27.080714 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172d001-06c0-4679-838a-f3f78e3c0cf5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:27.089349 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3172d001-06c0-4679-838a-f3f78e3c0cf5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:27.090993 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3172d001-06c0-4679-838a-f3f78e3c0cf5 service swift] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:27.099150 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1451/2927] 10.222.0.77 () {60 vars in 1384 bytes} [Wed May 11 07:34:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:34:27.422594 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa3747-ecc0-4867-a9d2-53c8b568f9ce None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:27.422893 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa3747-ecc0-4867-a9d2-53c8b568f9ce None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:27.423210 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa3747-ecc0-4867-a9d2-53c8b568f9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:27.441772 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-07fa3747-ecc0-4867-a9d2-53c8b568f9ce None None] MFA Rules not processed for user `99cbf80fc74c4183a6eed3e97f7196f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:34:27.442988 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-07fa3747-ecc0-4867-a9d2-53c8b568f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:27.450665 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1477/2928] 10.222.0.77 () {58 vars in 967 bytes} [Wed May 11 07:34:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:34:27.462847 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172d001-06c0-4679-838a-f3f78e3c0cf5 service swift] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:27.473942 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172d001-06c0-4679-838a-f3f78e3c0cf5 service swift] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:27.479901 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7196e-d1b0-4ae0-a2d2-149f30da65c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f726f58d30734be7abf15400bff89533', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:27.480479 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7196e-d1b0-4ae0-a2d2-149f30da65c9 service swift] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:27.480763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7196e-d1b0-4ae0-a2d2-149f30da65c9 service swift] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:27.481045 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7196e-d1b0-4ae0-a2d2-149f30da65c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:27.489357 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7196e-d1b0-4ae0-a2d2-149f30da65c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:27.490917 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7196e-d1b0-4ae0-a2d2-149f30da65c9 service swift] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:27.498995 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1452/2929] 10.222.0.77 () {60 vars in 1384 bytes} [Wed May 11 07:34:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:34:29.566574 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa3747-ecc0-4867-a9d2-53c8b568f9ce None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:29.641509 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa3747-ecc0-4867-a9d2-53c8b568f9ce None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:29.646472 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf4535-4572-4a9d-aa5d-3024fcd9376c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:29.647389 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf4535-4572-4a9d-aa5d-3024fcd9376c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:29.647668 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf4535-4572-4a9d-aa5d-3024fcd9376c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:29.647934 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf4535-4572-4a9d-aa5d-3024fcd9376c admin admin] PATH_INFO: `/v3/users/388436aac3294bec85c0d3e9a4881b03` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:29.649723 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf4535-4572-4a9d-aa5d-3024fcd9376c admin admin] RBAC: Authorizing `identity:delete_user(user_id=388436aac3294bec85c0d3e9a4881b03)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:29.652928 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf4535-4572-4a9d-aa5d-3024fcd9376c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:29.705114 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-addf4535-4572-4a9d-aa5d-3024fcd9376c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '388436aac3294bec85c0d3e9a4881b03'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:29.717589 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-addf4535-4572-4a9d-aa5d-3024fcd9376c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '388436aac3294bec85c0d3e9a4881b03'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:29.718245 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-addf4535-4572-4a9d-aa5d-3024fcd9376c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '388436aac3294bec85c0d3e9a4881b03'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:29.718867 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-addf4535-4572-4a9d-aa5d-3024fcd9376c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '388436aac3294bec85c0d3e9a4881b03'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:29.728062 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-addf4535-4572-4a9d-aa5d-3024fcd9376c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '388436aac3294bec85c0d3e9a4881b03'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:29.743349 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1478/2930] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:34:29 2022] DELETE /identity/v3/users/388436aac3294bec85c0d3e9a4881b03 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:34:29.750375 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6a72c-b4ea-44ff-9931-183975e7a064 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:29.750873 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6a72c-b4ea-44ff-9931-183975e7a064 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:29.750997 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6a72c-b4ea-44ff-9931-183975e7a064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:29.771820 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-03f6a72c-b4ea-44ff-9931-183975e7a064 None None] MFA Rules not processed for user `7a9fbdd0a78349c9b11108cb751273ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:34:29.773107 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-03f6a72c-b4ea-44ff-9931-183975e7a064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:29.833020 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1453/2931] 10.222.0.77 () {58 vars in 957 bytes} [Wed May 11 07:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:34:29.842804 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf4535-4572-4a9d-aa5d-3024fcd9376c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:29.844436 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-addf4535-4572-4a9d-aa5d-3024fcd9376c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:29.902322 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf4535-4572-4a9d-aa5d-3024fcd9376c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:29.906367 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9f259-bb46-42b2-bf83-92534d65b4f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:29.907008 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9f259-bb46-42b2-bf83-92534d65b4f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:29.907318 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9f259-bb46-42b2-bf83-92534d65b4f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:29.907587 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9f259-bb46-42b2-bf83-92534d65b4f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:29.917699 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9f259-bb46-42b2-bf83-92534d65b4f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:29.919164 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9f259-bb46-42b2-bf83-92534d65b4f1 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:29.929212 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1479/2932] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:34:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:34:30.108218 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6a72c-b4ea-44ff-9931-183975e7a064 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:30.109764 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-03f6a72c-b4ea-44ff-9931-183975e7a064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:30.124067 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6a72c-b4ea-44ff-9931-183975e7a064 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:30.129722 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6e05e-0e0e-4be8-a20c-ee2b9145da52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:30.130606 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6e05e-0e0e-4be8-a20c-ee2b9145da52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:30.130882 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6e05e-0e0e-4be8-a20c-ee2b9145da52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:30.131235 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6e05e-0e0e-4be8-a20c-ee2b9145da52 admin admin] PATH_INFO: `/v3/projects/1b318313a9f04a1eadae5213caf32e38` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:30.132654 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6e05e-0e0e-4be8-a20c-ee2b9145da52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b318313a9f04a1eadae5213caf32e38)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:30.134613 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6e05e-0e0e-4be8-a20c-ee2b9145da52 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:30.181763 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8de6e05e-0e0e-4be8-a20c-ee2b9145da52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b318313a9f04a1eadae5213caf32e38', 'request_id': 'req-8de6e05e-0e0e-4be8-a20c-ee2b9145da52'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:30.188405 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8de6e05e-0e0e-4be8-a20c-ee2b9145da52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b318313a9f04a1eadae5213caf32e38', 'request_id': 'req-8de6e05e-0e0e-4be8-a20c-ee2b9145da52'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:30.197947 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8de6e05e-0e0e-4be8-a20c-ee2b9145da52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b318313a9f04a1eadae5213caf32e38', 'request_id': 'req-8de6e05e-0e0e-4be8-a20c-ee2b9145da52'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:30.208273 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8de6e05e-0e0e-4be8-a20c-ee2b9145da52 admin admin] The token cache is being invalidate because project 1b318313a9f04a1eadae5213caf32e38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:34:30.208613 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8de6e05e-0e0e-4be8-a20c-ee2b9145da52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:30.209237 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8de6e05e-0e0e-4be8-a20c-ee2b9145da52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:30.210778 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1454/2933] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:34:30 2022] DELETE /identity/v3/projects/1b318313a9f04a1eadae5213caf32e38 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:34:34.529841 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9f259-bb46-42b2-bf83-92534d65b4f1 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:34.531531 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-33a9f259-bb46-42b2-bf83-92534d65b4f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:34.603709 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9f259-bb46-42b2-bf83-92534d65b4f1 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:34.668267 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b75e34-3544-4bf4-81bc-364fab257924 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46e2703839e498da8f3e2c3fda1d61c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:34.668930 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b75e34-3544-4bf4-81bc-364fab257924 service placement] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:34.669186 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b75e34-3544-4bf4-81bc-364fab257924 service placement] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:34.669457 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b75e34-3544-4bf4-81bc-364fab257924 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:34.671538 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f3b75e34-3544-4bf4-81bc-364fab257924 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:34.683479 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b75e34-3544-4bf4-81bc-364fab257924 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:34.685072 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b75e34-3544-4bf4-81bc-364fab257924 service placement] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:34.695357 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1480/2934] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:34:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:36:27.627980 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fd669-2d4d-4a07-b814-2d462ae6b6fb None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:27.628575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fd669-2d4d-4a07-b814-2d462ae6b6fb None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:27.628575 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fd669-2d4d-4a07-b814-2d462ae6b6fb None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:27.630199 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1455/2935] 10.222.0.77 () {54 vars in 921 bytes} [Wed May 11 07:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:36:27.636870 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f781d-41bb-416a-a730-f2096ad35285 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:27.637514 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f781d-41bb-416a-a730-f2096ad35285 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:27.637800 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f781d-41bb-416a-a730-f2096ad35285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:27.670699 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-986f781d-41bb-416a-a730-f2096ad35285 None None] MFA Rules not processed for user `3c92f4b777a644ad8055f15b1a8bd0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:36:27.671977 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-986f781d-41bb-416a-a730-f2096ad35285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:36:27.727549 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1481/2936] 10.222.0.77 () {58 vars in 1018 bytes} [Wed May 11 07:36:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:36:27.743388 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fd669-2d4d-4a07-b814-2d462ae6b6fb None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:36:27.745393 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c09fd669-2d4d-4a07-b814-2d462ae6b6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:36:27.762582 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fd669-2d4d-4a07-b814-2d462ae6b6fb None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:36:27.766547 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97550c9-b269-446b-ac3d-a6862ddfa925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:36:27.767300 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97550c9-b269-446b-ac3d-a6862ddfa925 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:27.767766 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97550c9-b269-446b-ac3d-a6862ddfa925 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:27.768052 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97550c9-b269-446b-ac3d-a6862ddfa925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:27.777343 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97550c9-b269-446b-ac3d-a6862ddfa925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:36:27.778785 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97550c9-b269-446b-ac3d-a6862ddfa925 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:36:27.786929 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1456/2937] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:36:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:36:27.871635 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2161845-5b17-482c-9f0b-84b60f3c91b3 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:27.871927 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2161845-5b17-482c-9f0b-84b60f3c91b3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:27.872206 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2161845-5b17-482c-9f0b-84b60f3c91b3 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:27.873615 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1482/2938] 10.222.0.77 () {54 vars in 921 bytes} [Wed May 11 07:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:36:27.878932 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b237158-04f0-4b33-ba89-546f1e6e9891 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:27.879259 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b237158-04f0-4b33-ba89-546f1e6e9891 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:27.879498 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b237158-04f0-4b33-ba89-546f1e6e9891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:27.899341 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9b237158-04f0-4b33-ba89-546f1e6e9891 None None] MFA Rules not processed for user `edf9d57de89a4701ba1a5b079d0ad348`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:36:27.900583 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9b237158-04f0-4b33-ba89-546f1e6e9891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:36:27.980756 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1457/2939] 10.222.0.77 () {58 vars in 1018 bytes} [Wed May 11 07:36:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:36:27.994848 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2161845-5b17-482c-9f0b-84b60f3c91b3 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:36:28.008286 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2161845-5b17-482c-9f0b-84b60f3c91b3 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:36:28.012887 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bb935-f2da-4d47-94fb-eccdc9336454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:36:28.013557 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bb935-f2da-4d47-94fb-eccdc9336454 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:28.013840 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bb935-f2da-4d47-94fb-eccdc9336454 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:28.014120 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bb935-f2da-4d47-94fb-eccdc9336454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:28.024676 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bb935-f2da-4d47-94fb-eccdc9336454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:36:28.026119 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bb935-f2da-4d47-94fb-eccdc9336454 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:36:28.036864 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1483/2940] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:36:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:36:29.652740 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b237158-04f0-4b33-ba89-546f1e6e9891 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:36:29.654486 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9b237158-04f0-4b33-ba89-546f1e6e9891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:36:29.667451 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b237158-04f0-4b33-ba89-546f1e6e9891 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:36:29.671839 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450e6fb-06ba-4188-a9be-c86b1d9fd34c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:36:29.672487 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450e6fb-06ba-4188-a9be-c86b1d9fd34c service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:29.672764 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450e6fb-06ba-4188-a9be-c86b1d9fd34c service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:29.673030 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450e6fb-06ba-4188-a9be-c86b1d9fd34c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:29.675024 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6450e6fb-06ba-4188-a9be-c86b1d9fd34c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:36:29.684720 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450e6fb-06ba-4188-a9be-c86b1d9fd34c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:36:29.686143 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450e6fb-06ba-4188-a9be-c86b1d9fd34c service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:36:29.694577 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1458/2941] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:36:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:13.014420 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bb935-f2da-4d47-94fb-eccdc9336454 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:13.023831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bb935-f2da-4d47-94fb-eccdc9336454 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:13.028380 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0828a30-7e26-4635-9184-411342879672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:13.029067 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0828a30-7e26-4635-9184-411342879672 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:13.029339 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0828a30-7e26-4635-9184-411342879672 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:13.029610 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0828a30-7e26-4635-9184-411342879672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:13.032037 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c0828a30-7e26-4635-9184-411342879672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:13.101548 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0828a30-7e26-4635-9184-411342879672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:13.103000 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0828a30-7e26-4635-9184-411342879672 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:13.112287 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1484/2942] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:38:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:14.046416 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450e6fb-06ba-4188-a9be-c86b1d9fd34c service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:14.047860 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6450e6fb-06ba-4188-a9be-c86b1d9fd34c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:14.099811 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450e6fb-06ba-4188-a9be-c86b1d9fd34c service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:14.105789 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848776f-7d0d-420b-a2df-973946ccf005 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf9d57de89a4701ba1a5b079d0ad348', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:14.106641 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848776f-7d0d-420b-a2df-973946ccf005 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:14.106990 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848776f-7d0d-420b-a2df-973946ccf005 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:14.107948 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848776f-7d0d-420b-a2df-973946ccf005 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:14.109422 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f848776f-7d0d-420b-a2df-973946ccf005 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:14.123924 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848776f-7d0d-420b-a2df-973946ccf005 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:14.125911 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848776f-7d0d-420b-a2df-973946ccf005 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:14.138773 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1459/2943] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:38:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:14.226424 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0828a30-7e26-4635-9184-411342879672 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:14.235088 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0828a30-7e26-4635-9184-411342879672 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:14.238774 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccdeb0a-1b29-4092-bc99-48a92af2617d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:14.239478 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccdeb0a-1b29-4092-bc99-48a92af2617d service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:14.239814 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccdeb0a-1b29-4092-bc99-48a92af2617d service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:14.240119 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccdeb0a-1b29-4092-bc99-48a92af2617d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:14.242120 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2ccdeb0a-1b29-4092-bc99-48a92af2617d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:14.256341 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccdeb0a-1b29-4092-bc99-48a92af2617d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:14.257925 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccdeb0a-1b29-4092-bc99-48a92af2617d service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:14.269508 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1485/2944] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:38:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:15.442424 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848776f-7d0d-420b-a2df-973946ccf005 service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:15.452508 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848776f-7d0d-420b-a2df-973946ccf005 service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:15.457288 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3114e8-e703-4269-b1f8-b289de7d336a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:15.457942 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3114e8-e703-4269-b1f8-b289de7d336a service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:15.458224 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3114e8-e703-4269-b1f8-b289de7d336a service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:15.458481 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3114e8-e703-4269-b1f8-b289de7d336a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:15.460584 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3c3114e8-e703-4269-b1f8-b289de7d336a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:15.475601 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3114e8-e703-4269-b1f8-b289de7d336a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:15.477070 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3114e8-e703-4269-b1f8-b289de7d336a service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:15.488662 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1460/2945] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:38:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:17.998232 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccdeb0a-1b29-4092-bc99-48a92af2617d service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:18.007775 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccdeb0a-1b29-4092-bc99-48a92af2617d service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:18.012244 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d317f-874f-4062-8987-56c9df2ddbd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c92f4b777a644ad8055f15b1a8bd0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:18.013022 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d317f-874f-4062-8987-56c9df2ddbd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:18.013310 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d317f-874f-4062-8987-56c9df2ddbd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:18.013593 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d317f-874f-4062-8987-56c9df2ddbd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:18.015618 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-951d317f-874f-4062-8987-56c9df2ddbd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:18.097868 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d317f-874f-4062-8987-56c9df2ddbd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:18.099290 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d317f-874f-4062-8987-56c9df2ddbd3 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:18.118389 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1486/2946] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:24.317765 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3114e8-e703-4269-b1f8-b289de7d336a service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:24.319504 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3c3114e8-e703-4269-b1f8-b289de7d336a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:24.342925 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3114e8-e703-4269-b1f8-b289de7d336a service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:24.347473 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7be08-aee3-41cd-b961-30b7b1be7ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:24.348727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7be08-aee3-41cd-b961-30b7b1be7ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:24.349008 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7be08-aee3-41cd-b961-30b7b1be7ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:24.349282 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7be08-aee3-41cd-b961-30b7b1be7ec5 admin admin] PATH_INFO: `/v3/users/091ecb0ab33e483d9f8a3b76b84ef039` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:24.350586 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7be08-aee3-41cd-b961-30b7b1be7ec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=091ecb0ab33e483d9f8a3b76b84ef039)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:24.352519 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7be08-aee3-41cd-b961-30b7b1be7ec5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:24.401331 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-cde7be08-aee3-41cd-b961-30b7b1be7ec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '091ecb0ab33e483d9f8a3b76b84ef039'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:24.413897 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-cde7be08-aee3-41cd-b961-30b7b1be7ec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '091ecb0ab33e483d9f8a3b76b84ef039'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:24.414657 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-cde7be08-aee3-41cd-b961-30b7b1be7ec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '091ecb0ab33e483d9f8a3b76b84ef039'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:24.415337 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-cde7be08-aee3-41cd-b961-30b7b1be7ec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '091ecb0ab33e483d9f8a3b76b84ef039'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:24.424489 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-cde7be08-aee3-41cd-b961-30b7b1be7ec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '091ecb0ab33e483d9f8a3b76b84ef039'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:24.437200 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1461/2947] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:38:24 2022] DELETE /identity/v3/users/091ecb0ab33e483d9f8a3b76b84ef039 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:24.618627 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d317f-874f-4062-8987-56c9df2ddbd3 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:24.628725 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d317f-874f-4062-8987-56c9df2ddbd3 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:24.685661 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921fed5-f2ed-4135-bc44-c92e8390a932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:24.686544 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921fed5-f2ed-4135-bc44-c92e8390a932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:24.686831 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921fed5-f2ed-4135-bc44-c92e8390a932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:24.687148 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921fed5-f2ed-4135-bc44-c92e8390a932 admin admin] PATH_INFO: `/v3/projects/7235fa7902e641be820d2043ce0c75d1` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:24.688464 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921fed5-f2ed-4135-bc44-c92e8390a932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7235fa7902e641be820d2043ce0c75d1)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:24.690412 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921fed5-f2ed-4135-bc44-c92e8390a932 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:24.742398 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e921fed5-f2ed-4135-bc44-c92e8390a932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7235fa7902e641be820d2043ce0c75d1', 'request_id': 'req-e921fed5-f2ed-4135-bc44-c92e8390a932'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:24.748411 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e921fed5-f2ed-4135-bc44-c92e8390a932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7235fa7902e641be820d2043ce0c75d1', 'request_id': 'req-e921fed5-f2ed-4135-bc44-c92e8390a932'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:24.757454 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e921fed5-f2ed-4135-bc44-c92e8390a932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7235fa7902e641be820d2043ce0c75d1', 'request_id': 'req-e921fed5-f2ed-4135-bc44-c92e8390a932'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:24.768586 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e921fed5-f2ed-4135-bc44-c92e8390a932 admin admin] The token cache is being invalidate because project 7235fa7902e641be820d2043ce0c75d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:38:24.768866 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e921fed5-f2ed-4135-bc44-c92e8390a932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:24.769534 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e921fed5-f2ed-4135-bc44-c92e8390a932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:24.771153 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1487/2948] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:38:24 2022] DELETE /identity/v3/projects/7235fa7902e641be820d2043ce0c75d1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:24.775287 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7be08-aee3-41cd-b961-30b7b1be7ec5 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:24.776792 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cde7be08-aee3-41cd-b961-30b7b1be7ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:24.790064 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7be08-aee3-41cd-b961-30b7b1be7ec5 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:24.846597 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdffbc9-bb1e-4171-be26-c2b626b5673c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:24.847727 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdffbc9-bb1e-4171-be26-c2b626b5673c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:24.848008 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdffbc9-bb1e-4171-be26-c2b626b5673c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:24.848283 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdffbc9-bb1e-4171-be26-c2b626b5673c admin admin] PATH_INFO: `/v3/users/36acd2c394444f6c9e2b8ea65a5305a3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:24.849596 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdffbc9-bb1e-4171-be26-c2b626b5673c admin admin] RBAC: Authorizing `identity:delete_user(user_id=36acd2c394444f6c9e2b8ea65a5305a3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:24.851655 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdffbc9-bb1e-4171-be26-c2b626b5673c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:24.898414 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6fdffbc9-bb1e-4171-be26-c2b626b5673c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36acd2c394444f6c9e2b8ea65a5305a3'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:24.910308 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6fdffbc9-bb1e-4171-be26-c2b626b5673c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36acd2c394444f6c9e2b8ea65a5305a3'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:24.911121 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6fdffbc9-bb1e-4171-be26-c2b626b5673c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36acd2c394444f6c9e2b8ea65a5305a3'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:24.911820 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6fdffbc9-bb1e-4171-be26-c2b626b5673c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36acd2c394444f6c9e2b8ea65a5305a3'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:24.920567 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6fdffbc9-bb1e-4171-be26-c2b626b5673c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36acd2c394444f6c9e2b8ea65a5305a3'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:24.933805 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1462/2949] 10.222.0.77 () {58 vars in 1223 bytes} [Wed May 11 07:38:24 2022] DELETE /identity/v3/users/36acd2c394444f6c9e2b8ea65a5305a3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:25.124145 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921fed5-f2ed-4135-bc44-c92e8390a932 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:25.125807 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e921fed5-f2ed-4135-bc44-c92e8390a932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:25.142227 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921fed5-f2ed-4135-bc44-c92e8390a932 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:25.198853 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec0d8b-566b-4e0e-84dc-0aa0dd0d2e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a9fbdd0a78349c9b11108cb751273ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '486e01030b5e4bfaac8284834098ad35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:25.199764 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec0d8b-566b-4e0e-84dc-0aa0dd0d2e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:25.200063 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec0d8b-566b-4e0e-84dc-0aa0dd0d2e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:25.200359 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec0d8b-566b-4e0e-84dc-0aa0dd0d2e43 admin admin] PATH_INFO: `/v3/projects/84aaf0ee5b264b83a7ca4c80e7bd446d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:25.201583 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec0d8b-566b-4e0e-84dc-0aa0dd0d2e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84aaf0ee5b264b83a7ca4c80e7bd446d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:25.203515 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec0d8b-566b-4e0e-84dc-0aa0dd0d2e43 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:25.249885 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8cec0d8b-566b-4e0e-84dc-0aa0dd0d2e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84aaf0ee5b264b83a7ca4c80e7bd446d', 'request_id': 'req-8cec0d8b-566b-4e0e-84dc-0aa0dd0d2e43'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:25.255811 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8cec0d8b-566b-4e0e-84dc-0aa0dd0d2e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84aaf0ee5b264b83a7ca4c80e7bd446d', 'request_id': 'req-8cec0d8b-566b-4e0e-84dc-0aa0dd0d2e43'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:25.264759 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8cec0d8b-566b-4e0e-84dc-0aa0dd0d2e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84aaf0ee5b264b83a7ca4c80e7bd446d', 'request_id': 'req-8cec0d8b-566b-4e0e-84dc-0aa0dd0d2e43'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:25.277375 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8cec0d8b-566b-4e0e-84dc-0aa0dd0d2e43 admin admin] The token cache is being invalidate because project 84aaf0ee5b264b83a7ca4c80e7bd446d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:38:25.277706 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8cec0d8b-566b-4e0e-84dc-0aa0dd0d2e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:25.278692 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8cec0d8b-566b-4e0e-84dc-0aa0dd0d2e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:25.280455 dv-cinder-778193-26-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1488/2950] 10.222.0.77 () {58 vars in 1232 bytes} [Wed May 11 07:38:25 2022] DELETE /identity/v3/projects/84aaf0ee5b264b83a7ca4c80e7bd446d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:39:38.473456 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdffbc9-bb1e-4171-be26-c2b626b5673c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:38.475786 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6fdffbc9-bb1e-4171-be26-c2b626b5673c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:38.634767 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdffbc9-bb1e-4171-be26-c2b626b5673c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:38.697394 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d09c62-45c2-4d70-aa40-497a5c19151e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd46e2703839e498da8f3e2c3fda1d61c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f573a9de6904664ace6287072a8a7dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:38.698048 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d09c62-45c2-4d70-aa40-497a5c19151e service placement] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:38.698297 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d09c62-45c2-4d70-aa40-497a5c19151e service placement] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:38.698647 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d09c62-45c2-4d70-aa40-497a5c19151e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:38.700772 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-65d09c62-45c2-4d70-aa40-497a5c19151e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:38.712198 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d09c62-45c2-4d70-aa40-497a5c19151e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:38.713780 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d09c62-45c2-4d70-aa40-497a5c19151e service placement] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:38.723661 dv-cinder-778193-26-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1463/2951] 10.222.0.77 () {60 vars in 1365 bytes} [Wed May 11 07:39:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)